Conducting interactive experiments online
Online labor markets provide new opportunities for behavioral research, but conducting economic experiments online raises important methodological challenges. This particularly holds for interactive designs. In this paper, we provide a methodological discussion of the similarities and differences be...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Published: |
Springer
2018
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/42851/ |
| _version_ | 1848796584346648576 |
|---|---|
| author | Arechar, Antonio A. Gaechter, Simon Molleman, Lucas |
| author_facet | Arechar, Antonio A. Gaechter, Simon Molleman, Lucas |
| author_sort | Arechar, Antonio A. |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Online labor markets provide new opportunities for behavioral research, but conducting economic experiments online raises important methodological challenges. This particularly holds for interactive designs. In this paper, we provide a methodological discussion of the similarities and differences between interactive experiments conducted in the laboratory and online. To this end, we conduct a repeated public goods experiment with and without punishment using samples from the laboratory and the online platform Amazon Mechanical Turk. We chose to replicate this experiment because it is long and logistically complex. It therefore provides a good case study for discussing the methodological and practical challenges of online interactive experimentation. We find that basic behavioral patterns of cooperation and punishment in the laboratory are replicable online. The most important challenge of online interactive experiments is participant dropout. We discuss measures for reducing dropout and show that, for our case study, dropouts are exogenous to the experiment. We conclude that data quality for interactive experiments via the Internet is adequate and reliable, making online interactive experimentation a potentially valuable complement to laboratory studies. |
| first_indexed | 2025-11-14T19:50:18Z |
| format | Article |
| id | nottingham-42851 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| last_indexed | 2025-11-14T19:50:18Z |
| publishDate | 2018 |
| publisher | Springer |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-428512020-05-04T19:52:02Z https://eprints.nottingham.ac.uk/42851/ Conducting interactive experiments online Arechar, Antonio A. Gaechter, Simon Molleman, Lucas Online labor markets provide new opportunities for behavioral research, but conducting economic experiments online raises important methodological challenges. This particularly holds for interactive designs. In this paper, we provide a methodological discussion of the similarities and differences between interactive experiments conducted in the laboratory and online. To this end, we conduct a repeated public goods experiment with and without punishment using samples from the laboratory and the online platform Amazon Mechanical Turk. We chose to replicate this experiment because it is long and logistically complex. It therefore provides a good case study for discussing the methodological and practical challenges of online interactive experimentation. We find that basic behavioral patterns of cooperation and punishment in the laboratory are replicable online. The most important challenge of online interactive experiments is participant dropout. We discuss measures for reducing dropout and show that, for our case study, dropouts are exogenous to the experiment. We conclude that data quality for interactive experiments via the Internet is adequate and reliable, making online interactive experimentation a potentially valuable complement to laboratory studies. Springer 2018-03 Article PeerReviewed Arechar, Antonio A., Gaechter, Simon and Molleman, Lucas (2018) Conducting interactive experiments online. Experimental Economics, 21 (1). pp. 99-131. ISSN 1573-6938 Experimental methodology; Behavioral research; Internet experiments; Amazon Mechanical Turk; Public goods game Punishment http://link.springer.com/article/10.1007%2Fs10683-017-9527-2 doi:10.1007/s10683-017-9527-2 doi:10.1007/s10683-017-9527-2 |
| spellingShingle | Experimental methodology; Behavioral research; Internet experiments; Amazon Mechanical Turk; Public goods game Punishment Arechar, Antonio A. Gaechter, Simon Molleman, Lucas Conducting interactive experiments online |
| title | Conducting interactive experiments online |
| title_full | Conducting interactive experiments online |
| title_fullStr | Conducting interactive experiments online |
| title_full_unstemmed | Conducting interactive experiments online |
| title_short | Conducting interactive experiments online |
| title_sort | conducting interactive experiments online |
| topic | Experimental methodology; Behavioral research; Internet experiments; Amazon Mechanical Turk; Public goods game Punishment |
| url | https://eprints.nottingham.ac.uk/42851/ https://eprints.nottingham.ac.uk/42851/ https://eprints.nottingham.ac.uk/42851/ |