Primary Study Quality in Psychological Meta-Analyses: An Empirical Assessment of Recent Practice

Peer reviewed: 
Yes, item is peer reviewed.
Scholarly level: 
Graduate student (PhD)
Final version published as: 

Hohn RE, Slaney KL and Tafreshi D (2019) Primary Study Quality in Psychological Meta-Analyses: An Empirical Assessment of Recent Practice. Front. Psychol. 9:2667. doi: 10.3389/fpsyg.2018.02667

Date created: 
2019-01-09
Keywords: 
Meta-analysis
Meta-analysis reporting standards (MARS)
Reporting practices
Study quality
Risk of bias
Primary study quality
Study quality assessment
Study quality assessment criteria
Abstract: 

As meta-analytic research has come to occupy a sizeable contingent of published work in the psychological sciences, clarity in the reporting of such work is crucial to its interpretability and reproducibility. This is especially true regarding the assessment of primary study quality, as notions of study quality can vary across research domains. The present study examines the general state of reporting practices related to primary study quality in a sample of 382 published psychological meta-analyses, as well as the reporting decisions and motivations of the authors that published them. Our findings suggest adherence to reporting standards has remained poor for assessments of primary study quality and that the discipline remains inconsistent in its reporting practices generally. We discuss several potential reasons for the poor adherence to reporting standards in our sample, including whether quality assessments are being conducted in the first place, whether standards are well-known within the discipline, and the potential conflation of assessing primary study quality with other facets of conducting a meta-analysis. The implications of suboptimal reporting practices related to primary study quality are discussed.

Language: 
English
Document type: 
Article
File(s): 
Sponsor(s): 
Social Sciences and Humanities Research Council of Canada (SSHRC)
Statistics: