J Korean Med Sci. 2020 Jul 13;35(27):e256. English.
Published online Jul 08, 2020.
© 2020 The Korean Academy of Medical Sciences.
Original Article

Information and Misinformation on COVID-19: a Cross-Sectional Survey Study

Latika Gupta,1 Armen Yuri Gasparyan,2 Durga Prasanna Misra,1 Vikas Agarwal,1 Olena Zimba,3 and Marlen Yessirkepov4
    • 1Department of Clinical Immunology and Rheumatology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow, India.
    • 2Departments of Rheumatology and Research and Development, Dudley Group NHS Foundation Trust (Teaching Trust of the University of Birmingham, UK), Russells Hall Hospital, Dudley, West Midlands, UK.
    • 3Department of Internal Medicine No. 2, Danylo Halytsky Lviv National Medical University, Lviv, Ukraine.
    • 4Department of Biology and Biochemistry, South Kazakhstan Medical Academy, Shymkent, Kazakhstan.
Received June 25, 2020; Accepted June 30, 2020.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The coronavirus disease 2019 (COVID-19) pandemic has led to a large volume of publications, a barrage of non-reviewed preprints on various professional repositories and a slew of retractions in a short amount of time.

Methods

We conducted an e-survey using a cloud-based website to gauge the potential sources of trustworthy information and misinformation and analyzed researchers', clinicians', and academics' attitude toward unpublished items, and pre- and post-publication quality checks in this challenging time.

Results

Among 128 respondents (mean age, 43.2 years; M:F, 1.1:1), 60 (46.9%) were scholarly journal editors and editorial board members. Social media channels were distinguished as the most important sources of information as well as misinformation (81 [63.3%] and 86 [67.2%]). Nearly two in five (62, 48.4%) respondents blamed reviewers, editors, and misinterpretation by readers as additional contributors alongside authors for misinformation. A higher risk of plagiarism was perceived by the majority (70, 58.6%), especially plagiarism of ideas (64.1%) followed by inappropriate paraphrasing (54.7%). Opinion was divided on the utility of preprints for changing practice and changing retraction rates during the pandemic period, and higher rejections were not supported by most (76.6%) while the importance of peer review was agreed upon by a majority (80, 62.5%). More stringent screening by journal editors (61.7%), and facilitating open access plagiarism software (59.4%), including Artificial Intelligence (AI)-based algorithms (43.8%) were among the suggested solutions. Most (74.2%) supported the need to launch a specialist bibliographic database for COVID-19, with information indexed (62.3%), available as open-access (82.8%), after expanding search terms (52.3%) and following due verification by academics (66.4%), and journal editors (52.3%).

Conclusion

While identifying social media as a potential source of misinformation on COVID-19, and a perceived high risk of plagiarism, more stringent peer review and skilled post-publication promotion are advisable. Journal editors should play a more active role in streamlining publication and promotion of trustworthy information on COVID-19.

Graphical Abstract

Keywords
Coronavirus Disease 2019; COVID-19; Information; Publishing; Social Media; Periodicals as Topic

INTRODUCTION

The coronavirus disease 2019 (COVID-19) pandemic and consequent need for boosting immunity and following hygiene and social distancing regulations to mitigate infection risks have led researchers, clinicians and journal editors around the world to search for rational hypotheses, ideas, and emerging evidence for prevention and management of this new disease.1, 2 While established scholarly platforms continue publishing and disseminating peer-reviewed and validated items on the new coronavirus, numerous online channels with variable quality checks are emerging and supplying their users with statements, instructions, and recommendations on various aspects of COVID-19.3 The scarcity of highly skilled professionals, primarily physicians with diverse interests in virology, immunology and thrombology, capable of moderating the unprecedented flow of information via the established and alternative communication channels paves the way for circulation of poorly checked and misleading hypotheses, ideas, and research outcomes. While lay public and professionals scramble to gather more about the current situation, the massive flux of unverified information creates uncertainties due to the infodemic and risks thousands of lives globally.4, 5

Apart from a large volume of publications on COVID-19, a barrage of non-reviewed preprints on various professional repositories and a slew of retractions amplify the confusion further.6 Amid the urge to obtain more research results on the new coronavirus and prevention and management of COVID-19, on the background of the mass proliferation of related articles, experts have raised concerns over the deficiencies in the whole process of research management and publishing in these challenging times.7 By adversely impacting prevention and management of COVID-19, poorly managed research and publishing enterprise carry lasting implications for the trustworthiness of scholarly communication channels. Journal editors may take the lead by responsibly processing medical information on COVID-19, ethically promoting relevant items on social media, and contributing to the accumulation of evidence base.5 With this in mind, we aimed to explore potential sources of information and misinformation on COVID-19 by distributing a questionnaire on the role of social media attention notes, published and unpublished items, peer review, and post-publication quality checks among researchers, clinicians, and academics.

METHODS

Questionnaire design

Our questionnaire featured 22 questions, 19 of which were multiple choice. The survey was designed to arrive at the resources of information and misinformation (4), preprint archiving (1), peer review (1), plagiarism (4), retractions (1) and probable solutions (4) for improved publication methods and ethics. Seven questions aimed to characterize the respondent populations demographic profile (2), expertise (4) and location (1). All individuals from the authors' team participated in the assessment of the rationale of the survey and face-validity. Following this, the final survey was preliminarily filled by three individual respondents to identify mistakes in wording, grammar or syntax, and critically evaluate the modifications from the original survey. The questionnaire underwent nine rounds of revisions. The average survey time was five minutes. The respondents could change the answers before submission but not after it. All questions were mandatory. The survey was completely anonymized.

Population selection

The questionnaire was widely disseminated over social-media platforms (Twitter, Facebook and WhatsApp) with the hashtags #misinformation and #COVID-19 to be voluntarily filled by researchers, clinicians, academics, and journal editors. The survey e-link was distributed via the official social media accounts of the Indian J Rheumatol. There was no particular sampling technique used, and all those who agreed to participate were included in the survey. The eligible participants were given three weeks to voluntarily complete the questionnaire from May 22 to June 13, 2020. Informed consent was taken at the beginning of the survey, and no incentives were offered for survey completion.

Analysis

Descriptive analyses were employed, and results figures were downloaded from https://www.surveymonkey.com.

Ethics statement

An exemption from review was obtained from the institute ethics committee of Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow, India as per local guidelines (2020-110-IP-EXP-16).3 We adhered to the Checklist for Reporting Results of Internet E-surveys to report the data.8

RESULTS

Among 128 respondents (mean age, 43.2 years; M:F, 1.1:1), 60 (46.9%) were scholarly journal editors and editorial board members. Sixty-nine (54%) were academics, and 42 (33%) were researchers. Nearly one-third (32.8%) were rheumatologists, with a sizable representation from India (41, 32%), Turkey (33, 25.8%) and Kazakhstan (14, 11%) (Table 1).

Table 1
Coronavirus disease 2019 information and misinformation survey respondent characteristics

Social media channels were distinguished as the most important sources of information and, at the same time, misinformation by 81 (63.3%) and 86 (67.2%) respondents, respectively. Digital libraries and publishers' repositories constituted the other most important sources of information on COVID-19. Nearly half (45.3%) found misinformation on television. While two-third respondents (83, 64.8%) felt that scientific authors themselves are responsible for misinformation in scholarly journals. Almost two in five (62, 48.4%) respondents blamed reviewers, editors, and misinterpretation by readers as additional contributors to misinformation (Table 2).

Table 2
Analysis of survey results on COVID-19 information and misinformation

Nearly half (50.8%) felt that preprints could not be relied upon to change COVID-19 management practices, though another 30% opined that an exception could be made sometimes. A total of 80 (62.5%) affirmed that peer review is a mandatory system for prepublication checks despite the need for fast processing and dissemination of scholarly articles on COVID-19. Furthermore, 70 (58.6%) perceived the risk of more frequent plagiarism in the time of crisis, with plagiarism of ideas (64.1%) followed by inappropriate paraphrasing (54.7%) being the most likely. Commercial editing agents and novice authors were pointed out as the most likely offenders by 51.6% and 43.8% respondents, respectively (Fig. 1).

Fig. 1
Perception of sources of misinformation, plagiarism, and reliability of preprints by physicians and academics.
COVID-19 = coronavirus disease 2019.

More stringent screening by journal editors (61.7%) and facilitating open access plagiarism software (59.4%) were the suggested solutions. A little less than half, 43.8%, proposed Artificial Intelligence (AI)-driven software algorithms. One in five (18.8%) proposed establishing academic police network for the task, while 10.1% felt conventional cyber police should do so (Fig. 1).

The opinion on changing retraction practices during this period was divided, with 23.4% proposing lower threshold, 31.3% suggesting otherwise, and another 36.7% being not sure. Most (74.2%) supported the need to launch a specialist bibliographic database for COVID-19, with information indexed (62.3%) after due verification. More stringent peer review, by seeking evaluations of a higher number of reviewers was proposed by 68%, though higher rejection and retraction rates were supported by 23.4% and 13.3%, respectively. Nearly two-thirds (66.4%) believed that academics could constitute the platform for verified information, in addition to journal editors (52.3%), while 32% thought all clinicians could form it. A mere 7% supported the presence of students on this platform (Fig. 1).

Respondents were of the opinion that global bibliographic databases may respond to the COVID-19 pandemic by contributing more to the Open Access global initiative (82.8%), expanding search terms (52.3%), and delineating the highly accessed articles (39.1%), particularly those with meticulous methodology (33.6%). The Lancet was highlighted as the most trustworthy scholarly journal covering COVID-19 issues by 68 (53.1%) responders, followed by the N Engl J Med (66, 51.6%) and Nature (63, 49.2%).

DISCUSSION

In our survey comprising a large proportion of journal editors, social media channels were deemed the most common resource on COVID-19, albeit with the greatest potential for misinformation. While the opinion on preprints and retraction practices was divided, peer review was deemed mandatory in view of the heightened risk of plagiarism of ideas and inappropriate paraphrasing in this period.

Although most peer-reviewed journals have embarked on fast-track processing of COVID-19 submissions, pre-publication archiving at various preprint servers is also encouraged by large publishers to prioritize and avoid delays in dissemination of potentially valuable scientific hypotheses and research results. Praised as essential tools of the Open Access initiative,9 countless specialist preprint platforms have emerged over the past few months, with medRxiv.org and bioRxiv.org becoming the main hubs of unpublished reports and opinion pieces on COVID-19. Some, but not all of these items, enter the peer review and get published in scholarly journals. Traditionally, unpublished sources are not recommended for citations to ensure the validity of references.10 Nonetheless, preprints are exponentially increasing and actively attracting social media mentions and citations, at times giving a false impression of the global scholarly community approval.11, 12

Preprint servers offer formatting and digital object identifier tags to improve the cross-referencing. But experts still point to incomplete reporting and poor editing at these servers, disseminating potentially dangerous news on antiviral and antimalarial drugs.13 Unsurprisingly, our survey revealed negative attitude toward preprints among 51% of respondents. Of the various solutions offered by our respondents, organizing a trustworthy COVID-19 database and promoting the Open Access global initiative were supported by a majority.

This pandemic has witnessed numerous instances of publication ethics violations,14 possibly due to poor understanding of the ethical norms. This deluge of information on COVID-19 has brought alongside enormous volumes of misinformation. The WHO recently collaborated with the UK government to run an awareness campaign regarding the risks of incorrect and false information related to COVID-19.15 Nature recently acknowledged that scientists are well placed to regulate the situation, although it may amount to a time-consuming and arduous task.2 Experts opined that the ubiquity and popularity of social media platforms suggest that the subscribers do not just passively absorb them. Instead, misinformation is actively created, modified, and disseminated, lending this infodemic a unique and greatly amplified dynamic. This situation is distinctively more challenging than ever encountered while fighting previous pandemics.16

Scientific facts and oddities may amount to a significant lack of consensus in certain domains and interpreting these as binary variables may cause the lay public as well as scientists to be misled, and amount to falsehood. However, a disaster of such magnitude also requires humankind to be well-informed in the preparedness of the times ahead. Thus, actively seeking correct information, verifying it, and curating it for dissemination to appropriate sections of the society assumes an important role. Publications in journals may be the best platform, to begin with, with more stringent checks at the portals of regulation by involving closer scrutiny by journal editors and a larger number of reviewers. Social media editors may also play a role by selectively promoting the most trustworthy articles which are free of any conflicts of interest.5

Some of the most popular articles on COVID-19 that supported the use of hydroxychloroquine as a “magic bullet” have been recently retracted17 and raised concerns over the quality of peer review at leading evidence-based journals. Even a single such retraction may disorient authors and readers in this time of the pandemic.18 Most respondents of our survey agreed that journal editors and reviewers share the responsibility with authors for misinformation in poorly checked manuscripts. While reviewing is usually a voluntary activity by motivated scholars, distinct provision of time and added incentives for the effort may turn it into a more gainful exercise.19 Self-cleansing of falsified information as errata is the therapeutic choice when preventative measures fail. Re-publishing the correct information among erroneous or falsified data is another grey area.20

The massive overload of information also brings in the risk of plagiarism. AI-based tools are proposed for both detecting plagiarism and data mining through databases. StatReviewer, an AI algorithm identified errors missed by human reviewers, suggesting a role in complementing review.21 Various algorithms have been developed for paraphrasing plagiarized phrases and passages of text, using semantic word normalization and refinement for plagiarisms in a multilingual environment.22 It may seem plausible to explore their role as the screening algorithm for identifying papers that may not need to go into peer review, saving human effort.21

To avoid lay public and doctors being misguided by falsehoods, it may be prudent to embark on planning how to monitor platforms with the greatest flux of information among an ever-expansive audience. Social media use is rampant among clinicians, with certain platforms such as WhatsApp being more popular in some countries, and Twitter across most developed and Anglophone countries.23, 24 This may require collaborations with techie enterprises, such as WhatsApp, which have launched a chatbox together with the International Fact-Checking Network (IFCN) to identify misinformation.25 Furthermore, contributions from databases toward the Open Access initiative may further facilitate the availability of scholarly articles for wider dissemination and post-publication commenting. Expanding search terms can enhance visibility and be useful for appropriate classification while delineating the items with meticulous methods can set the bar for quality as well as segregate literature resource for comparisons using manual and AI-driven approaches.16

Finally, it is necessary to discuss potential limitations of the study caused by a relatively short period of survey and a relatively small sample size. However, unique insights of this pilot study may pave the way for a larger and a more diversified global study. The strength of our survey is that nearly half of the respondents were associated with journal editing, lending greater credibility to the academic observations.

In conclusion, social media channels and television are currently believed to be the main sources of misinformation on COVID-19. Perceived high risk of plagiarism warrants more stringent peer review by scarcely available scholars. There is an urgent need for highly skilled scholars to assume a greater role in moderating information flow on COVID-19 via established and emerging platforms for scholarly communication.

Notes

Disclosure:The authors have no potential conflicts of interest to disclose.

Author Contributions:

  • Conceptualization: Gupta L, Gasparyan AY, Yessirkepov M, Zimba O.

  • Methodology: Gupta L, Gasparyan AY, Misra DP, Agarwal V, Zimba O.

  • Writing - original draft: Gupta L, Gasparyan AY.

  • Writing - review & editing: Gupta L, Gasparyan AY, Misra DP, Agarwal V, Zimba O, Yessirkepov M.

ACKNOWLEDGMENTS

All views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any institution or association.

References

    1. Gasparyan AY, Misra DP, Yessirkepov M, Zimba O. Perspectives of immune therapy in coronavirus disease 2019. J Korean Med Sci 2020;35(18):e176
    1. Fleming N. Coronavirus misinformation, and how scientists can help to fight it. [Updated June 24, 2020]. [Accessed June 25, 2020].
    1. Gupta L, Misra DP, Agarwal V, Balan S, Agarwal V. Management of rheumatic diseases in the time of COVID-19 pandemic: perspectives of rheumatology practitioners from India. Ann Rheum Dis. 2020 [doi: 10.1136/annrheumdis-2020-217509]
      Forthcoming.
    1. Llewellyn S. Covid-19: how to be careful with trust and expertise on social media. BMJ 2020;368:m1160.
    1. Goel A, Gupta L. Social media in the times of COVID-19. J Clin Rheumatol. 2020 [doi: 10.1097/RHU.0000000000001508]
      Forthcoming.
    1. Ledford H, Van Noorden R. High-profile coronavirus retractions raise concerns about data oversight. Nature 2020;582(7811):160–160.
    1. Bauchner H, Golub RM, Zylke J. Editorial concern—Possible reporting of the same patients with COVID-19 in different reports. JAMA 2020;323(13):1256.
    1. Eysenbach G. Improving the quality of web surveys: the checklist for reporting results of internet e-surveys (CHERRIES). J Med Internet Res 2004;6(3):e34
    1. Gasparyan AY, Yessirkepov M, Voronov AA, Koroleva AM, Kitas GD. Comprehensive approach to open access publishing: platforms and tools. J Korean Med Sci 2019;34(27):e184
    1. Gasparyan AY, Yessirkepov M, Voronov AA, Gerasimov AN, Kostyukova EI, Kitas GD. Preserving the integrity of citations and references by all stakeholders of science communication. J Korean Med Sci 2015;30(11):1545–1552.
    1. Kwon D. How swamped preprint servers are blocking bad coronavirus research. Nature 2020;581(7807):130–131.
    1. Callaway E. Will the pandemic permanently alter scientific publishing? Nature 2020;582(7811):167–168.
    1. Glasziou PP, Sanders S, Hoffmann T. Waste in covid-19 research. BMJ 2020;369:m1847.
    1. Misra D, Agarwal V. To act…….or to wait for the evidence: ethics in the time of covid-19!. Indian J Rheumatol 2020;15(1):3–4.
    1. World Health Organization. Countering misinformation about COVID-19. [Updated May 13, 2020]. [Accessed June 25, 2020].
    1. Pazzanese C. Battling the ‘pandemic of misinformation.’. [Updated May 8, 2020]. [Accessed June 25, 2020].
    1. Retraction Watch. Lancet, NEJM retract controversial COVID-19 studies based on Surgisphere data. [Updated June 4, 2020]. [Accessed June 25, 2020].
    1. Gasparyan AY, Ayvazyan L, Akazhanov NA, Kitas GD. Self-correction in biomedical publications and the scientific impact. Croat Med J 2014;55(1):61–72.
    1. Gasparyan AY, Gerasimov AN, Voronov AA, Kitas GD. Rewarding peer reviewers: maintaining the integrity of science communication. J Korean Med Sci 2015;30(4):360–364.
    1. Gewin V. Retractions: a clean slate. Nature 2014;507(7492):389–391.
    1. Heaven D. AI peer reviewers unleashed to ease publishing grind. Nature 2018;563(7733):609–610.
    1. Gang L, Quan Z, Guang L. Cross-language plagiarism detection based on WordNet; Proceedings of the 2nd International Conference on Innovation in Artificial Intelligence - ICIAI ’18; Shanghai, China: ACM Press; 2018. pp. 163-168.
    1. Zimba O, Radchenko O, Strilchuk L. Social media for research, education and practice in rheumatology. Rheumatol Int 2020;40(2):183–190.
    1. Ahmed S, Gupta L. Perception about social media use by rheumatology journals: survey among the attendees of IRACON 2019. Indian J Rheumatol. 2020 [doi: 10.4103/injr.injr_15_20]
      Forthcoming.
    1. WhatsApp. How WhatsApp can help you stay connected during the coronavirus (COVID-19) pandemic. [Updated 2020]. [Accessed June 25, 2020].

Metrics
Share
Figures

1 / 1

Tables

1 / 2

PERMALINK