Herausforderungen bei Online-Untersuchungen


Prof. Dr. Ulf-Dietrich Reips (Universität Konstanz)

Dr. Esther Kaufmann (Universität Konstanz)


Freitag, 22.10.2021, 13:30-18:00



In this workshop we will provide an overview of challenges, guidelines, methods, and tools in online research (e.g. Reips, 2002; Reips et al., 2012). Much will apply to all types of online research, i.e. Internet-based experimentation, web surveying, online testing, big data and social media research, and mobile research, some will be specific. Thus, the workshop will provide solutions to many of the methodological challenges in data collection via the Internet. The challenges discussed will include issues in design, security, selection of and access to social media platforms, sampling, recruitment, multiple submissions, measurement scales (e.g. visual analogue scales), response time measurement, dropout, and data quality. Some widely used tools and practices like Amazon Mechanical Turk, the cognitive reflection test, and forced responding are critically reviewed. Best practices will be discussed (e.g. Garaizar & Reips, 2019). Among other methods that have been developed in online methodology and Internet science, we will explain the one-item-one-screen (OIOS) design, the seriousness check, and the multiple site entry technique. Picked from our iScience Server at we will demonstrate a new version of our Web experiment generator WEXTOR ( as a tool that automatically implements optimal solutions in experimentation. Another example is Social Lab, our "Open Source Facebook" available at that can be played with in learning about privacy at or Finally, we will introduce Samply (; Shevchenko, Kuhlmann & Reips, in press), our new tool for mobile experience sampling studies. The presentation will conclude with a discussion of problematic trends and chances in evolving scenarios of using social media and online data in scientific and applied work.


  • Kenntnisse über typische Herausforderungen bei Online-Untersuchungen
  • Lösungen für verschiedene Formen der Internet-basierten Forschung
  • Praktische Anleitung/Hinweise zur Durchführung von „optimalen“ Online-Untersuchungen


Forschungsinteressierte: Online-Forschung




Garaizar, P., & Reips, U.-D. (2019). Best practices: Two web browser-based methods for stimulus presentation in behavioral experiments with high resolution timing requirements. Behavior Research Methods, 51, 1441–1453.

Reips, U.-D. (2002). Standards for Internet-based experimenting. Experimental Psychology, 49(4), 243–256.

Reips, U.-D., Buchanan, T., Krantz, J. H., & McGraw, K. O. (2016). Methodological challenges in the use of the internet for scientific research: Ten solutions and recommendations. Studia Psychologica, 14(15/2), 139.

Shevchenko, Y., Kuhlmann, T., & Reips, U.-D. (in press). Samply: A user-friendly, smartphone app and web-based means of scheduling and sending mobile notifications for experience-sampling research. Behavior Research Methods.

Weitere Publikationen verfügbar über und