Combating Bots and Fraudulent Data in Research: Insights from a Recent Roundtable Discussion
In a thought-provoking roundtable discussion hosted earlier this spring, leading experts from the research community came together to tackle a growing concern in data collection—bots, fraudulent data, and imposter respondents. The panel included Sara Maria Stretton from Western University, Steven Snell from Rep Data, Kyle McGee from Leger, Andrew Mercer from Pew Research Center, and Lindsey Webster from the Statistical Consulting and Survey Research Unit (SCSRU), each bringing unique perspectives and experiences to the table.
The discussion opened with a personal look into how each panelist has encountered data fraud in their work. From sudden spikes in response rates to too perfect open ends—with no errors and written in ways that don’t reflect how people naturally express themselves—panelists recounted the first red flags that led them to uncover bot activity or suspicious data. These real-world examples helped underscore just how pervasive and subtle fraudulent data can be in today’s digital research environment.
The conversation then moved into the impact that bots and data fraud have on research quality and integrity. All agreed that left unchecked, such contamination can significantly skew results—undermining trust, validity, and decision-making based on flawed insights. Several panelists described having to re-evaluate recruitment methods or discard compromised studies altogether to preserve the reliability of their findings.
When it came to solutions, the panel offered a wide array of strategies and tools used to detect and deter bad data. From advanced algorithms and pattern detection software to honeypot questions and respondent verification techniques, the message was clear: staying ahead of bad actors requires constant vigilance and innovation. The panel also agreed that tackling bots isn’t just a matter of post-collection cleanup—it needs to be addressed proactively in the methodology and survey design stage. Building safeguards into the research process from the beginning is essential for minimizing risk and ensuring data integrity.
Finally, the discussion turned to transparency in reporting. The panel emphasized the importance of clearly documenting any instances of suspected fraud in final data files and reports. Offering guidance on how researchers can acknowledge potential data contamination while detailing steps taken to address it, the panel encouraged a culture of openness to preserve research integrity.
This roundtable not only shed light on the challenges posed by bots and fraudulent data but also highlighted the community’s shared commitment to rigorous, ethical research practices. The insights shared will no doubt continue to shape how we think about and tackle data integrity in the digital age.
Want to continue the conversation or share your own strategies? Reach out and join the dialogue.
Watch the recorded session on YouTube
University of Waterloo Campus Community Survey (UWCom)
The SCSRU is partnering with Institutional Analysis & Planning (IAP) alongside four UWaterloo units to conduct a campus community survey. The survey will be used to inform strategic planning, programs and workshops, services, and supports for these units. The units participating include: the Office of Campus Support and Accessibility, Sexual Violence Prevention and Response Office, Campus Wellness, and the Office of Equity, Diversity, Inclusion and Anti-racism. The topics covered in this survey are wide reaching and include:
- Student perceptions of accessibility of classrooms
- Student perceptions of accessing campus wellness services
- Student perceptions of male allyship
- Sexual violence experiences on campus
- Studentexperiences with racial inclusion during Orientation events
The survey will launch May 12 and is open to all eligible UWaterloo students. We are especially excited to offer W Store prize packs to 16 lucky winners. These prize packs include: a $100 W Store gift card, a UWaterloo branded YETI cup, a UWaterloo baseball cap, a UWaterloo sticker, a goose plushie, and a mystery item.
This survey covers a broad range of topics from different groups across campus, because the UWCom survey is designed as an omnibus survey – a method that allows us to gather data on multiple subjects in a single, streamlined questionnaire. This approach helps these university units get the insights they need without overwhelming students with multiple surveys. Our team at the SCSRU has extensive experience with this format as we also manage the Waterloo Region Matters Survey (WRMS), another successful omnibus initiative.
The Waterloo Region Matters Survey is still accepting interested parties
Share survey research costs and collect high-quality data. The SCSRU conducts an annual survey of the Waterloo Region called the Waterloo Region Matters Survey (WRMS) where interested researchers and organizations can collect data for a fraction of the cost of an independent telephone or web study. This unique opportunity is still accepting interested parties who want to conduct research!
Key Details:
Study population: Adult residents (18 and older) within the Waterloo Region, including Kitchener, Waterloo, Cambridge and the four townships.
Sample size: ~500 completed surveys, representative by region/municipality and age.
Methodology: Random-digit dialed (RDD) telephone (using both landline and cell phone telephone numbers), recruit to web address-based sampling (ABS) and web surveys. RDD sampling of households within the Waterloo Region population and random selection within the household are used in initial recruitment by the SCSRU. This approach, along with ABS which uses postal addresses to reach households based on demographic data in different postal code areas, more accurately represents the Waterloo Region compared to non-probability sampling methods, such as recruiting members from web panel firms or visitors to an organization website. The sample used for the web component of the WRMS was originally recruited using RDD. Having a random selection of respondents and data that are representative of the population are important aspects of data relevance and utility. The addition of ABS recruitment was added in 2024 to better target young respondents, who are difficult to recruit. This combination of sampling methods ensures that households meeting the diverse characteristics of the region can accurately be targeted and recruited to the study.
Next iteration of data collection: Summer 2025
Deadline to express interest: May 30, 2025
Cost: For more information about the Waterloo Region Matters survey, please visit the Waterloo Region Matters web page, contact Reem Tawfik or call 519 888-4567 ext. 35071.
Featured Projects
Understanding Grief and Bereavement Support in Canada
Principal investigator Dr. Susan Cadell from the University of Waterloo’s School of Social Work, along with co-principal investigators Dr. Mary Ellen Macdonald (Dalhousie University) and Dr. David Wright (University of Ottawa), is leading a new study to explore how Canadians experience grief and the types of support they find helpful. The online survey, administered by the Statistical Consulting and Survey Research Unit (SCSRU) at the University of Waterloo, asks participants to reflect on the death of someone they knew, how they are currently feeling about the experience, and what supports they did or did not find useful. This study builds on the Public Health Model of Bereavement Support, originally developed in Australia, and will assess how well it fits the Canadian context. Findings will inform future research and help shape more effective grief support systems in Canada.
2025 International Social Survey Programme Survey
Dr. Sarah Wilkins-Laflamme from the Department of Sociology at the University of Waterloo is leading Canada’s participation in the 2024–2028 International Social Survey Programme (ISSP), a global initiative that gathers data on social attitudes and experiences across up to 43 countries. Each year, participants complete an online survey on a rotating set of themes. This year’s survey, marking the second wave of the five-year study, explores topics such as Internet use, artificial intelligence, digital technologies in the workplace, and work-life balance. The data collected will contribute to international comparisons, helping researchers understand how Canadian views and experiences align with or differ from those in other parts of the world.
Exploring Clinician Perceptions of Non-Invasive Brain Stimulation
Dr. Ben Thompson from the School of Optometry and Vision Science at the University of Waterloo, in partnership with the Centre for Eye and Vision Research (CEVR), is leading innovative research aimed at preventing vision loss and preserving sight among aging populations. CEVR, a collaborative initiative between the University of Waterloo and The Hong Kong Polytechnic University, serves as a global hub for eye and vision research with a focus on improving eye health in Hong Kong, mainland China, and beyond. As part of this effort, the research team is assessing clinicians’ attitudes toward a novel device designed to evaluate eyesight in older adults. To support this study, the Statistical Consulting and Survey Research Unit (SCSRU) conducted data collection through an online survey administered in both Hong Kong and Canada.
Upcoming Events
Be the first to know when workshop registration opens by signing up for our workshop mailing list.
GradNav Workshop
When: May 29th, 10am via Teams
The SCSRU is proud to announce our first workshop in collaboration with GRADnavigate! GRADnavigate is a series of workshops designed to help current graduate students answer questions about their degree and set themselves up for success. The SCSRU workshop will focus on survey research, specifically on question design, bots, and resources available at Waterloo to help students create a good survey for their thesis work. The workshop will take place May 29th at 10am via Teams, so you can participate from anywhere! To register, please visit the GRADnavigate website and select the SCSRU’s workshop.