A meta-research study revealed susceptibility of Covid-19 treatment research to white hat bias: First, do no harm

Abstract

Objective

: To investigate the presence of white hat bias in Covid-19 treatment research by evaluating the effects of citation and reporting bias.

Study design and setting

: Citation bias was investigated by assessing the degree of agreement between evidence provided by a remdesivir randomized controlled trial and its citing articles. The dissimilarity of outcomes derived from non-randomized and randomized studies was tested by a meta-analysis of hydroxychloroquine effects on mortality. The differential influence of studies with beneficial over those with neutral results was evaluated by a bibliometric analysis.

Results

: The articles citing the ACTT-1 remdesivir trial preferentially presented its positive outcomes in 55.83% and its negative outcomes in 6.43% of cases. The hydroxychloroquine indicated no significant effect by randomized studies, but a significant survival benefit by non-randomized ones. Citation mapping revealed that the study reporting survival benefit from the hydroxychloroquine-azithromycin combination was the most influential, despite subsequent studies reporting potential harmful effects.

Conclusion

: The present study raises concerns about citation bias and a predilection of reporting beneficial over harmful effects in the Covid-19 treatment research, potentially in the context of white hat bias. Pre-registration, data sharing and avoidance of selective reporting are crucial to ensure the credibility of future research.