Abstract
Fraudulent participation is defined in the following as participation in research by individuals who, for one reason or another, intentionally provide false responses. Qualitative studies are at an increased risk of fraudulent participation when online recruitment and participation are used, and monetary incentives offered. Fraudulent participation threatens data quality and subsequent evidence-based practice, yet validated guidance on how to tackle it is lacking. This paper offers a critical reflection thereon by three separate qualitative research groups that experienced fraudulent participation in collaboration with a patient representative, a bioethicist, a legal expert, a journal deputy editor, and a chief executive of a national charity. The Prevent FRaudulent Online STudy participation (P-FROST) recommendations provide advice on (1) Study set-up (including team members and study design), (2) Monetary incentives and recruitment, (3) Data collection (screening and interview considerations), and (4) Analysis, reporting, and support. The reflection which balances the diverse perspectives of patients, researchers, funders, ethics boards, and legal teams puts forward the P-FROST recommendations to identify and prevent fraudulent participation throughout the design, ethical approval, and implementation of online qualitative research.
Introduction
Advantages of Online Versus Face-to-Face Qualitative Data Collection.
Three separate qualitative research groups that experienced fraudulent participation collaborated with a patient representative from a cancer support group, a bioethicist, a legal expert, a journal deputy editor, and a chief executive of a national cancer charity involved in two of the studies, to critically reflect on three cases of fraudulent participation. The aim of this work was to raise awareness of this growing issue and carefully balance the diverse perspectives of patients, researchers, funders, ethics boards, and legal teams to put forward practical recommendations on how to identify, prevent, and tackle fraudulent participation in online qualitative research. These recommendations may serve qualitative researchers, peer reviewers, and ethics boards when designing, implementing, and appraising online qualitative studies.
Examples of Fraudulent Participation
Case Study 1: UK Skin Disease Online Interview Study
To identify patients’ future research priorities, participants with skin cancer were recruited by skin cancer charities using websites and social media. A Patient and Public Involvement and Engagement (PPIE) group of seven participants expressed interest in the study within a few days. Emails received were from “Gmail” accounts with a common name followed by numbers, for example, john.doe112@gmail.com. After expressing interest, all participants were notified of a £50 digital voucher reimbursement. Pre-interview questionnaires were completed but some key information was left blank, and participants all claimed to be from a similar minority demographic background, incongruous but not inconceivable for the condition of interest. Individual interviews were conducted and recorded on Zoom. None of the seven participants turned their cameras on during interviews, audio quality was poor, some answers were vague or contradicted information that had been previously provided in their pre-interview questionnaires, and responses were almost identical among the seven participants. Although the voucher company and other study participants confirmed the digital voucher codes were functioning and had been used, the seven participants claimed the codes did not work in an attempt to be paid twice. This was followed by a high volume of emails to the research team and hospital complaints department, some threatening to make critical statements on social media and take legal action unless urgent requests to provide another code were met immediately. Those participants who claimed the codes did not work were reassured the issue was being investigated and the study was paused. A legal and fraud specialist team provided advice to researchers not to communicate further, and events were reported to the police through the Action Fraud website (https://www.actionfraud.police.uk/). Following discussion with the sponsor, funder, and a patient representative, the research group successfully submitted amendments to the ethics committee to remove the monetary reimbursement and make video recording a mandatory component of interviews. Any further participants about whom the team had concerns were discussed collaboratively among the research team. Retrospectively, the fraudulent cases were easily identified with strong similarities and clues to distinguish them from genuine cases. Fraudulent cases were excluded from the analysis.
Case Study 2: Interviews to Discuss Awareness and Knowledge of HIV Pre-Exposure Prophylaxis (PrEP) Among Women in England
This study was open to women, age 18 and over, who resided in England at the time of participation. Interviews could be conducted via telephone or Microsoft Teams, depending on participant preference. The study was advertised via the project Twitter (now X) account and through paid advertisements on Meta social media platforms. Participants were offered a £20 voucher reimbursement, redeemable at several retailers in the United Kingdom, for participating in an hour-long interview. Interested parties were invited to complete a pre-interview questionnaire, which included questions on the potential participant’s demographics (to facilitate purposive sampling) and other items to confirm the respondent’s eligibility to participate. The research team then reviewed the pre-interview questionnaires and contacted respondents to provide further information on the study and to schedule interviews.
Throughout the recruitment period, the pre-interview questionnaire received numerous suspicious submissions. For example, several submissions were made in quick succession with different contact details, but similar or identical answers to the other questionnaire items. In some cases, the answers did not meet the study eligibility criteria (e.g., the respondent identified as male), whereas in others nonsensical answers were provided (e.g., the respondent listed their city of residence as “crumpets”). In these instances, the provided contact details were used to thank respondents for their interest in the study and inform them that they were not eligible to take part. However, it was not always possible to identify ineligible or fraudulent participants from the pre-interview questionnaire responses, so additional measures were taken to ensure that only genuinely eligible participants were interviewed.
Due to the sensitive nature of the interviews, it was important to balance each participant’s comfort and interview preferences with ensuring only eligible participants took part. During the interviews, sensitive topics such as a participant’s sexual behavior and experiences were discussed; therefore, participants had the option to keep their webcams off when online interviews were recorded. Before starting each interview, participants were asked to confirm their answers from the pre-interview questionnaire. When a participant’s answers were not consistent with the responses collected in the questionnaire, the participant was thanked for their interest in taking part and informed that they were not eligible to participate in the study.
Case Study 3: Online Focus Group Study to Understand the Perspectives of Patients With Cancer on Clinical Trial Designs
This focus group study aimed to understand the perspectives of patients with advanced cancer regarding potential clinical trial designs. The study advertised for participants through cancer charities including support groups, patient forums, and social media platforms. Initially, the study accrued participants at the expected rate. The advertisement was then placed on a charity social media platform, and this was the first occasion where details of the £25 voucher reimbursement were included. Following this advertisement, a rapid flurry of applications was received within hours. All these applicants registered with “Gmail” accounts. During the first focus group, most of the spurious participants kept their cameras and microphones off and did not meaningfully engage in the discussion. Furthermore, information given during the introductions was inconsistent with the information provided in the background questionnaire. Many participants appeared preoccupied with receiving the voucher. Concerns were raised by both facilitators and some authentic participants that not everyone taking part was genuine or eligible for the study. Following the first focus group, all consent forms and background questionnaires were reviewed. There was a suspicious pattern of registration for many participants. This included many applicants from the same demographic background, which was atypical for the disease. In addition, some details in the background questionnaire were implausible. An approved ethical amendment required all participants to have a pre-screening video call with a researcher prior to taking part in a focus group. It was also highlighted in the participant information sheet (PIS) that a camera and microphone would be required to take part. The implementation of the screening video call was successful with all subsequent focus groups including only eligible participants who were fully engaged in the discussion. The participants from the first focus group who did not meaningfully engage were excluded from the analysis.
Identifying Fraudulent Participation
Red Flags to Raise Suspicion of Fraudulent Participation in Qualitative Research.
Recommendations to Prevent FRaudulent Online STudy Participation (P-FROST)
Summary of Prevent FRaudulent Online STudy Participation (P-FROST) Recommendations.

Example of a standardized approach to preventing, identifying, and managing fraudulent participation using P-FROST.
Discussion
Researchers routinely prioritize convenience and anonymity for participants to maximize study accessibility; however, this may predispose online studies to fraud and researchers should balance participant protection against data integrity considering the various perspectives of patients, researchers, funders, ethics boards, and legal teams (Roehl & Harland, 2022). Qualitative researchers should incorporate methods to detect and prevent fraudulent participation into ethics and funding applications.
Qualitative studies often aim to include a diverse range of participants and experiences, and any anti-fraud measures must be carefully considered to ensure they do not impact the recruitment of genuine participants. This is particularly relevant when conducting research with underrepresented, hidden, or other marginalized populations and/or when the research concerns a sensitive or stigmatized subject. For example, IP address tracking or requiring identity checks may discourage participants from signing up, as these may be seen as undermining or compromising the confidentiality and anonymization of the research. This may be a particular issue when the research focuses on sensitive topics such as sexual health and experience, illegal activities such as experience of drug use or sex work, or stigmatized and politicized issues, such as migration status. Additionally, requirements such as participants needing to have their webcams on during online focus groups and interviews may exclude those with poor internet connection or inadequate digital devices from taking part. In such cases, the anti-fraud measures must be weighed carefully against the needs and preferences of potential participants, and strategies that rely on the researcher’s experience and skills (e.g., confirmation of screening questions and pre-interview discussions) may be preferable to strategies that collect additional information or data from participants that are not relevant to the research outputs. Anti-fraud measures may require substantial time and financial commitments to identify and avoid fraud. Researchers should strategically decide on the most efficient and applicable techniques, considering the range of potential threats from fraudulent participation to their study.
Researchers must be mindful of how unconscious biases can influence their decision-making when deciding whether a participant is genuine. In case study 1, presented above, members of the fraudulent cohort were from a minority demographic that is underrepresented in skin cancer research, and initially the research team was keen to have their experiences included in the study. When issues with this cohort arose, the researchers were concerned that their suspicions of fraud could, in part, be due to unconscious bias or a lack of awareness of issues that minority groups have with research participation. Researchers were concerned that these participants were not familiar with how the research was conducted which could have explained why their answers during interviews were generic or vague. Language barriers may have resulted in miscommunication during interviews. These participants may have experienced digital poverty and therefore were not able to have their cameras on. Ultimately, the accumulation of red flags as described in case study 1 led to the decision that participation was fraudulent, and the participants were excluded from the study. It is important to recognize the range and diversity of experiences from minority groups and not exclude these groups because their experiences do not fit with current understanding of a disease in the general population.
High-quality recommendations and frameworks to address the issue of fraudulent participation have been produced elsewhere (Davies et al., 2024; Lawlor et al., 2021; Roehl & Harland, 2022). The strength of the recommendations in this study stems from the unique combination of authors. A patient representative ensured the recommendations were acceptable and would not deter genuine participants. The underlying rationale of the recommendations was balanced by a bioethicist while delivering insight into the ethical review board’s perspective. A legal expert ensured the recommendations abided by applicable legislation while a journal deputy editor provided input on the necessary information that should be reported by authors on the steps taken to prevent and manage fraudulent participation when preparing a manuscript to enable critical appraisal. Finally, a chief executive of a national charity provided a funders’ viewpoint, especially when making difficult decisions regarding monetary reimbursement. Although not formally validated, the above recommendations were tested in the context of the three unique qualitative case studies and found to be robust and effective in preventing, identifying, and managing fraudulent participation. Recommendations are not a panacea; implementing them alone cannot guarantee the eligibility of all participants. Rising artificial intelligence, social media use, and sophisticated technology make the prevention and identification of fraudulent participation increasingly challenging, and thus recommendations will need to be adaptive and responsive. Artificial intelligence may equip fraudulent participants with capability to quickly and accurately respond to research questions during screening, online surveys, interviews, and focus groups (Májovský et al., 2023). Artificial intelligence detectors tools exist; however, their effectiveness to detect the authenticity of content requires further validation (Májovský et al., 2023). Recruitment through social media platforms has become increasingly accepted, yet studies may be liable to opportunistic discovery by fraudulent participants who create false unverified accounts to follow research accounts who advertise recruitment for studies offering monetary reimbursement. These recommendations can only protect against the known approaches that fraudulent respondents take to enter online qualitative research. Research groups should reflect on their confidence in the methods used to identify fraudulent participation. Decisions on exclusion should be considered through an ethical lens, where a genuine participant is removed, their input has been supressed from the study, potentially losing key information. Contrarily, retaining fraudulent responses distort the value of legitimate responses and may alter study findings. Participation of fraudulent participants in focus groups can be distressing to genuine volunteers. Further validation studies are required to explore the effectiveness and acceptability of respective recommendations to hinder fraudulent participation and develop robust guidance. Future research should also assess the frequency of fraudulent participation and the reasons for its occurrence.
In conclusion, the described recommendations offer a consistent approach toward identifying and preventing fraudulent participation in online qualitative research. These recommendations contribute toward an evolving conversation to ensure that convenient online qualitative methodology is not at the expense of data quality. Academic directors and institutions should raise awareness of this issue and take steps to educate on fraudulent research participants within curriculums. Emphasis on transparency among researchers is key to ease pressures around participant recruitment and publications which deflect from the need for honest, accurate data. We encourage researchers to use the red flags and recommendations and actively engage with the ongoing discussion regarding this issue through letters, review articles, and further studies. Future partnerships where patients, researchers, funders, and ethics committees work together to establish consensus groups are imperative to establish validated guidance, alert current researchers, and ameliorate this growing problem.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
