Justify your alpha

In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.

Bibliographic Details
Main Authors:	Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio, Zwaan, Rolf A.
Format:	Article
Language:	English
Published:	Nature Publishing Group 2018
Online Access:	https://eprints.nottingham.ac.uk/49123/

_version_	1848797927057653760
author	Lakens, Daniel Adolfi, Federico G. Albers, Casper J. Anvari, Farid Apps, Matthew A.J. Argamon, Shlomo E. Baguley, Thom Becker, Raymond B. Benning, Stephen D. Bradford, Daniel E. Buchanan, Erin M. Caldwell, Aaron R. Calster, Ben van Carlsson, Rickard Chen, Sau-Chin Chung, Bryan Colling, Lincoln J. Collins, Gary S. Crook, Zander Cross, Emily S. Daniels, Sameera Danielsson, Henrik DeBruine, Lisa Dunleavy, Daniel J. Earp, Brian D. Feist, Michele I. Ferrell, Jason D. Field, James G. Fox, Nicholas W. Friesen, Amanda Gomes, Caio Gonzalez-Marquez, Monica Grange, James A. Grieve, Andrew P. Guggenberger, Robert Grist, James Harmelen, Anne-Laura van Hasselman, Fred Hochard, Kevin D. Hoffarth, Mark R. Holmes, Nicholas P. Ingre, Michael Isager, Peder M. Isotalus, Hanna K. Johansson, Christer Juszczyk, Konrad Kenny, David A. Khalil, Ahmed A. Konat, Barbara Lao, Junpeng Larsen, Erik Gahner Lodder, Gerine M.A. Lukavsky, Jiři Madan, Christopher R. Manheim, David Martin, Stephen R. Martin, Andrea E. Mayo, Deborah G. McCarthy, Randy J. McConway, Kevin McFarland, Colin Nio, Amanda Q.X. Nilsonne, Gustav Oliveira, Cilene Lino de Xivry, Jean-Jacques Orban de Parsons, Sam Pfuhl, Gerit Quinn, Kimberly A. Sakon, John J. Saribay, S. Adil Schneider, Iris K. Selvaraju, Manojkumar Sjoerds, Zsuzsika Smith, Samuel G. Smits, Tim Spies, Jeffrey R. Sreekumar, Vishnu Steltenpohl, Crystal N. Stenhouse, Neil Świątkowski, Wojciech Vadillo, Miguel A. Van Assen, Marcel A.L.M. Williams, Matt N. Williams, Samantha E. Williams, Donald R. Yarkoni, Tal Ziano, Ignazio Zwaan, Rolf A.
author_facet	Lakens, Daniel Adolfi, Federico G. Albers, Casper J. Anvari, Farid Apps, Matthew A.J. Argamon, Shlomo E. Baguley, Thom Becker, Raymond B. Benning, Stephen D. Bradford, Daniel E. Buchanan, Erin M. Caldwell, Aaron R. Calster, Ben van Carlsson, Rickard Chen, Sau-Chin Chung, Bryan Colling, Lincoln J. Collins, Gary S. Crook, Zander Cross, Emily S. Daniels, Sameera Danielsson, Henrik DeBruine, Lisa Dunleavy, Daniel J. Earp, Brian D. Feist, Michele I. Ferrell, Jason D. Field, James G. Fox, Nicholas W. Friesen, Amanda Gomes, Caio Gonzalez-Marquez, Monica Grange, James A. Grieve, Andrew P. Guggenberger, Robert Grist, James Harmelen, Anne-Laura van Hasselman, Fred Hochard, Kevin D. Hoffarth, Mark R. Holmes, Nicholas P. Ingre, Michael Isager, Peder M. Isotalus, Hanna K. Johansson, Christer Juszczyk, Konrad Kenny, David A. Khalil, Ahmed A. Konat, Barbara Lao, Junpeng Larsen, Erik Gahner Lodder, Gerine M.A. Lukavsky, Jiři Madan, Christopher R. Manheim, David Martin, Stephen R. Martin, Andrea E. Mayo, Deborah G. McCarthy, Randy J. McConway, Kevin McFarland, Colin Nio, Amanda Q.X. Nilsonne, Gustav Oliveira, Cilene Lino de Xivry, Jean-Jacques Orban de Parsons, Sam Pfuhl, Gerit Quinn, Kimberly A. Sakon, John J. Saribay, S. Adil Schneider, Iris K. Selvaraju, Manojkumar Sjoerds, Zsuzsika Smith, Samuel G. Smits, Tim Spies, Jeffrey R. Sreekumar, Vishnu Steltenpohl, Crystal N. Stenhouse, Neil Świątkowski, Wojciech Vadillo, Miguel A. Van Assen, Marcel A.L.M. Williams, Matt N. Williams, Samantha E. Williams, Donald R. Yarkoni, Tal Ziano, Ignazio Zwaan, Rolf A.
author_sort	Lakens, Daniel
building	Nottingham Research Data Repository
collection	Online Access
description	In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
first_indexed	2025-11-14T20:11:39Z
format	Article
id	nottingham-49123
institution	University of Nottingham Malaysia Campus
institution_category	Local University
language	English
last_indexed	2025-11-14T20:11:39Z
publishDate	2018
publisher	Nature Publishing Group
recordtype	eprints
repository_type	Digital Repository
spelling	nottingham-491232018-08-26T04:30:18Z https://eprints.nottingham.ac.uk/49123/ Justify your alpha Lakens, Daniel Adolfi, Federico G. Albers, Casper J. Anvari, Farid Apps, Matthew A.J. Argamon, Shlomo E. Baguley, Thom Becker, Raymond B. Benning, Stephen D. Bradford, Daniel E. Buchanan, Erin M. Caldwell, Aaron R. Calster, Ben van Carlsson, Rickard Chen, Sau-Chin Chung, Bryan Colling, Lincoln J. Collins, Gary S. Crook, Zander Cross, Emily S. Daniels, Sameera Danielsson, Henrik DeBruine, Lisa Dunleavy, Daniel J. Earp, Brian D. Feist, Michele I. Ferrell, Jason D. Field, James G. Fox, Nicholas W. Friesen, Amanda Gomes, Caio Gonzalez-Marquez, Monica Grange, James A. Grieve, Andrew P. Guggenberger, Robert Grist, James Harmelen, Anne-Laura van Hasselman, Fred Hochard, Kevin D. Hoffarth, Mark R. Holmes, Nicholas P. Ingre, Michael Isager, Peder M. Isotalus, Hanna K. Johansson, Christer Juszczyk, Konrad Kenny, David A. Khalil, Ahmed A. Konat, Barbara Lao, Junpeng Larsen, Erik Gahner Lodder, Gerine M.A. Lukavsky, Jiři Madan, Christopher R. Manheim, David Martin, Stephen R. Martin, Andrea E. Mayo, Deborah G. McCarthy, Randy J. McConway, Kevin McFarland, Colin Nio, Amanda Q.X. Nilsonne, Gustav Oliveira, Cilene Lino de Xivry, Jean-Jacques Orban de Parsons, Sam Pfuhl, Gerit Quinn, Kimberly A. Sakon, John J. Saribay, S. Adil Schneider, Iris K. Selvaraju, Manojkumar Sjoerds, Zsuzsika Smith, Samuel G. Smits, Tim Spies, Jeffrey R. Sreekumar, Vishnu Steltenpohl, Crystal N. Stenhouse, Neil Świątkowski, Wojciech Vadillo, Miguel A. Van Assen, Marcel A.L.M. Williams, Matt N. Williams, Samantha E. Williams, Donald R. Yarkoni, Tal Ziano, Ignazio Zwaan, Rolf A. In response to recommendations to redefine statistical significance to p ≤ .005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level. Nature Publishing Group 2018-02-26 Article PeerReviewed application/pdf en https://eprints.nottingham.ac.uk/49123/1/Justify%20Your%20Alpha.pdf Lakens, Daniel, Adolfi, Federico G., Albers, Casper J., Anvari, Farid, Apps, Matthew A.J., Argamon, Shlomo E., Baguley, Thom, Becker, Raymond B., Benning, Stephen D., Bradford, Daniel E., Buchanan, Erin M., Caldwell, Aaron R., Calster, Ben van, Carlsson, Rickard, Chen, Sau-Chin, Chung, Bryan, Colling, Lincoln J., Collins, Gary S., Crook, Zander, Cross, Emily S., Daniels, Sameera, Danielsson, Henrik, DeBruine, Lisa, Dunleavy, Daniel J., Earp, Brian D., Feist, Michele I., Ferrell, Jason D., Field, James G., Fox, Nicholas W., Friesen, Amanda, Gomes, Caio, Gonzalez-Marquez, Monica, Grange, James A., Grieve, Andrew P., Guggenberger, Robert, Grist, James, Harmelen, Anne-Laura van, Hasselman, Fred, Hochard, Kevin D., Hoffarth, Mark R., Holmes, Nicholas P., Ingre, Michael, Isager, Peder M., Isotalus, Hanna K., Johansson, Christer, Juszczyk, Konrad, Kenny, David A., Khalil, Ahmed A., Konat, Barbara, Lao, Junpeng, Larsen, Erik Gahner, Lodder, Gerine M.A., Lukavsky, Jiři, Madan, Christopher R., Manheim, David, Martin, Stephen R., Martin, Andrea E., Mayo, Deborah G., McCarthy, Randy J., McConway, Kevin, McFarland, Colin, Nio, Amanda Q.X., Nilsonne, Gustav, Oliveira, Cilene Lino de, Xivry, Jean-Jacques Orban de, Parsons, Sam, Pfuhl, Gerit, Quinn, Kimberly A., Sakon, John J., Saribay, S. Adil, Schneider, Iris K., Selvaraju, Manojkumar, Sjoerds, Zsuzsika, Smith, Samuel G., Smits, Tim, Spies, Jeffrey R., Sreekumar, Vishnu, Steltenpohl, Crystal N., Stenhouse, Neil, Świątkowski, Wojciech, Vadillo, Miguel A., Van Assen, Marcel A.L.M., Williams, Matt N., Williams, Samantha E., Williams, Donald R., Yarkoni, Tal, Ziano, Ignazio and Zwaan, Rolf A. (2018) Justify your alpha. Nature Human Behaviour, 2 . pp. 168-171. ISSN 2397-3374 http://www.nature.com/articles/s41562-018-0311-x doi:10.1038/s41562-018-0311-x doi:10.1038/s41562-018-0311-x
spellingShingle	Lakens, Daniel Adolfi, Federico G. Albers, Casper J. Anvari, Farid Apps, Matthew A.J. Argamon, Shlomo E. Baguley, Thom Becker, Raymond B. Benning, Stephen D. Bradford, Daniel E. Buchanan, Erin M. Caldwell, Aaron R. Calster, Ben van Carlsson, Rickard Chen, Sau-Chin Chung, Bryan Colling, Lincoln J. Collins, Gary S. Crook, Zander Cross, Emily S. Daniels, Sameera Danielsson, Henrik DeBruine, Lisa Dunleavy, Daniel J. Earp, Brian D. Feist, Michele I. Ferrell, Jason D. Field, James G. Fox, Nicholas W. Friesen, Amanda Gomes, Caio Gonzalez-Marquez, Monica Grange, James A. Grieve, Andrew P. Guggenberger, Robert Grist, James Harmelen, Anne-Laura van Hasselman, Fred Hochard, Kevin D. Hoffarth, Mark R. Holmes, Nicholas P. Ingre, Michael Isager, Peder M. Isotalus, Hanna K. Johansson, Christer Juszczyk, Konrad Kenny, David A. Khalil, Ahmed A. Konat, Barbara Lao, Junpeng Larsen, Erik Gahner Lodder, Gerine M.A. Lukavsky, Jiři Madan, Christopher R. Manheim, David Martin, Stephen R. Martin, Andrea E. Mayo, Deborah G. McCarthy, Randy J. McConway, Kevin McFarland, Colin Nio, Amanda Q.X. Nilsonne, Gustav Oliveira, Cilene Lino de Xivry, Jean-Jacques Orban de Parsons, Sam Pfuhl, Gerit Quinn, Kimberly A. Sakon, John J. Saribay, S. Adil Schneider, Iris K. Selvaraju, Manojkumar Sjoerds, Zsuzsika Smith, Samuel G. Smits, Tim Spies, Jeffrey R. Sreekumar, Vishnu Steltenpohl, Crystal N. Stenhouse, Neil Świątkowski, Wojciech Vadillo, Miguel A. Van Assen, Marcel A.L.M. Williams, Matt N. Williams, Samantha E. Williams, Donald R. Yarkoni, Tal Ziano, Ignazio Zwaan, Rolf A. Justify your alpha
title	Justify your alpha
title_full	Justify your alpha
title_fullStr	Justify your alpha
title_full_unstemmed	Justify your alpha
title_short	Justify your alpha
title_sort	justify your alpha
url	https://eprints.nottingham.ac.uk/49123/ https://eprints.nottingham.ac.uk/49123/ https://eprints.nottingham.ac.uk/49123/

Justify your alpha

Similar Items