A Scale for Evaluating the Methodological Quality of Studies Based on Observational Methodology

Background: To date, no studies have shown validity evidence of a scale that measures the methodological quality of studies based on observational methodology (SBOM). This study presents validity evidence of the Methodological Quality Scale for Studies based on Observational Methodology (MQSOM) base...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Psicothema Jg. 37; H. 1; S. 1 - 10
Hauptverfasser: Sanduvete-Chaves, Susana, Chacón-Moscoso, Salvador, López-Arenas, Daniel, Anguera, M. Teresa
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Spain Colegio Oficial de Psicólogos (PSICODOC) 01.01.2025
Schlagworte:
Discriminant analysis
Factor Analysis, Statistical
Humans
Observational Studies as Topic - methods
Observational Studies as Topic - standards
Reproducibility of Results
Research Design - standards
ISSN:0214-9915, 1886-144X, 1886-144X
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Background: To date, no studies have shown validity evidence of a scale that measures the methodological quality of studies based on observational methodology (SBOM). This study presents validity evidence of the Methodological Quality Scale for Studies based on Observational Methodology (MQSOM) based on its internal structure. Method: MQSOM was applied to 650 journal articles that used observational methodology. The Intraclass Correlation Coefficient (ICC) was calculated to obtain evidence of inter- and intracoder reliability. Parallel analysis was done using optimal implementation to study the dimensionality of the scale before conducting an exploratory factor analysis with a randomly-selected half of the sample, followed by a confirmatory factor analysis with the remaining half. Results: Both inter- and intra-coder reliability were adequate, ICC > .73. Parallel analysis suggested a lack of unidimensionality, UniCo = .41; ECV = .31. A second-order factor structure (general factor: Methodological quality) with two first-order factors (F1 Design, F2 Measurement and Analysis) was obtained, RMSEA = 0.000, NNFI = 1, GFI = .98, AGFI = .97, with adequate reliability and discrimination results. Conclusions: MQSOM is a short (11 items), useful instrument for professionals, researchers or assessment commissions when designing, implementing, or evaluating SBOM.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:0214-9915
1886-144X
1886-144X
DOI:10.70478/psicothema.2025.37.01