Redefine statistical significance

We thank D. L. Lormand, R. Royer and A. T. Nguyen Viet for excellent research assistance.

Authors and Affiliations

1. Center for Economic and Social Research and Department of Economics, University of Southern California, Los Angeles, CA, 90089-3332, USA

   Daniel J. Benjamin

2. Department of Statistical Science, Duke University, Durham, NC, 27708-0251, USA

   James O. Berger, Merlise Clyde & Robert L. Wolpert

3. Department of Economics, Stockholm School of Economics, Stockholm, SE-113 83, Sweden

   Magnus Johannesson & Anna Dreber

4. University of Virginia, Charlottesville, VA, 22908, USA

   Brian A. Nosek

5. Center for Open Science, Charlottesville, VA, 22903, USA

   Brian A. Nosek

6. Department of Psychology, University of Amsterdam, Amsterdam, 1018 VZ, The Netherlands

   E.-J. Wagenmakers

7. School of Arts and Sciences and Department of Criminology, University of Pennsylvania, Philadelphia, PA, 19104-6286, USA

   Richard Berk

8. Department of Psychology and Neuroscience, Department of Sociology, University of North Carolina Chapel Hill, Chapel Hill, NC, 27599-3270, USA

   Kenneth A. Bollen

9. Institute of Zoology — Neurogenetics, Universität Regensburg, Universitätsstrasse 31, 93040, Regensburg, Germany

   Björn Brembs

10. Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA, 19104, USA

    Richard Berk, Lawrence Brown & Edward I. George

11. Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA

    Colin Camerer

12. Department of Economics, New York University, New York, NY, 10012, USA

    David Cesarini

13. The Research Institute of Industrial Economics (IFN), Stockholm, SE-102 15, Sweden

    David Cesarini

14. Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff, CF24 4HQ, UK

    Christopher D. Chambers

15. Northwestern University, Evanston, IL, 60208, USA

    Thomas D. Cook

16. Mathematica Policy Research, Washington, DC, 20002-4221, USA

    Thomas D. Cook

17. Department of Psychology, Quantitative Program, Ohio State University, Columbus, OH, 43210, USA

    Paul De Boeck

18. School of Psychology, University of Sussex, Brighton, BN1 9QH, UK

    Zoltan Dienes & Andy P. Field

19. Department of Philosophy, Texas A&M University, College Station, TX, 77843-4237, USA

    Kenny Easwaran

20. Department of Psychology, Royal Holloway University of London, Egham Surrey, TW20 0EX, UK

    Charles Efferson

21. Department of Economics, University of Zurich, 8006, Zurich, Switzerland

    Ernst Fehr

22. School of BioSciences and School of Historical & Philosophical Studies, University of Melbourne, Parkville, VIC, 3010, Australia

    Fiona Fidler

23. Department of Philosophy, University of Wisconsin — Madison, Madison, WI, 53706, USA

    Malcolm Forster

24. Department of Psychology, University of Michigan, Ann Arbor, MI, 48109-1043, USA

    Richard Gonzalez

25. Stanford University, General Medical Disciplines, Stanford, CA, 94305, USA

    Steven Goodman

26. Department of Ecology, Evolution and Natural Resources SEBS, Rutgers University, New Brunswick, NJ, 08901-8551, USA

    Edwin Green

27. Department of Political Science, Columbia University in the City of New York, New York, NY, 10027, USA

    Donald P. Green

28. Department of Psychology, University of Washington, Seattle, WA, 98195-1525, USA

    Anthony G. Greenwald

29. Institute of Evolutionary Biology School of Biological Sciences, The University of Edinburgh, Edinburgh, EH9 3JT, UK

    Jarrod D. Hadfield

30. Weinberg College of Arts & Sciences Department of Statistics, Northwestern University, Evanston, IL, 60208, USA

    Larry V. Hedges

31. Epidemiology, Biostatistics and Prevention Institute (EBPI), University of Zurich, 8001, Zurich, Switzerland

    Leonhard Held

32. National University of Singapore, Singapore, 119077, Singapore

    Teck Hua Ho

33. Department of Methods and Statistics, Universiteit Utrecht, Utrecht, 3584 CH, The Netherlands

    Herbert Hoijtink

34. School of Human Evolution and Social Change, Arizona State University, Tempe, AZ, 85287-2402, USA

    Daniel J. Hruschka

35. Department of Politics and Center for Statistics and Machine Learning, Princeton University, Princeton, NJ, 08544, USA

    Kosuke Imai

36. Stanford University, Stanford, CA, 94305-5015, USA

    Guido Imbens

37. Departments of Medicine, of Health Research and Policy, of Biomedical Data Science, and of Statistics and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, 94305, USA

    John P. A. Ioannidis

38. Advanced Quantitative Methods, Social Research Methodology, Department of Education, Graduate School of Education & Information Studies, University of California, Los Angeles, CA, 90095-1521, USA

    Minjeong Jeon

39. Department of Life Sciences, Imperial College London, Ascot, SL5 7PY, UK

    James Holland Jones

40. Department of Earth System Science, Stanford, CA, 94305-4216, USA

    James Holland Jones

41. Department of Banking and Finance, University of Innsbruck and University of Gothenburg, Innsbruck, A-6020, Austria

    Michael Kirchler

42. Department of Economics, Harvard University, Cambridge, MA, 02138, USA

    David Laibson

43. Department of Economics, University of Chicago, Chicago, IL, 60637, USA

    John List

44. Department of Biostatistics, University of Michigan, Ann Arbor, MI, 48109-2029, USA

    Roderick Little

45. Department of Political Science, University of Michigan, Ann Arbor, MI, 48109-1045, USA

    Arthur Lupia

46. Department of History and Philosophy of Science, University of Pittsburgh, Pittsburgh, PA, 15260, USA

    Edouard Machery

47. Department of Psychology, University of Notre Dame, Notre Dame, IN, 46556, USA

    Scott E. Maxwell

48. School of BioSciences, University of Melbourne, Parkville, VIC, 3010, Australia

    Michael McCarthy

49. Haas School of Business, University of California at Berkeley, Berkeley, CA, 94720-1900A, USA

    Don A. Moore

50. Johns Hopkins University, Baltimore, MD, 21218, USA

    Stephen L. Morgan

51. MRC Integrative Epidemiology Unit, University of Bristol, Bristol, BS8 1TU, UK

    Marcus Munafó

52. UK Centre for Tobacco and Alcohol Studies, School of Experimental Psychology, University of Bristol, Bristol, BS8 1TU, UK

    Marcus Munafó

53. Evolution & Ecology Research Centre and School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052, Australia

    Shinichi Nakagawa

54. Department of Government, Dartmouth College, Hanover, NH, 03755, USA

    Brendan Nyhan

55. Department of Biology, Whitman College, Walla Walla, WA, 99362, USA

    Timothy H. Parker

56. Department of Mathematics, University of Puerto Rico, Rio Piedras Campus, San Juan, PR, 00936-8377, Puerto Rico

    Luis Pericchi

57. Department of Psychology, University of Milan-Bicocca, Milan, 20126, Italy

    Marco Perugini

58. Department of Cognitive Sciences, University of California, Irvine, CA, 92617, USA

    Jeff Rouder

59. Université Paris Dauphine, 75016, Paris, France

    Judith Rousseau

60. Department of Psychology, The University of British Columbia, Vancouver, V6T 1Z4, BC, Canada

    Victoria Savalei

61. Department Psychology, Ludwig-Maximilians-University Munich, Leopoldstraβe 13, 80802, Munich, Germany

    Felix D. Schönbrodt

62. Department of Statistics, Purdue University, West Lafayette, IN, 47907-2067, USA

    Thomas Sellke

63. Department of Political Science, Washington University in St. Louis, St. Louis, MO, 63130-4899, USA

    Betsy Sinclair

64. Government Department, Harvard University, Cambridge, MA, 02138, USA

    Dustin Tingley

65. Department of Psychology, Ohio State University, Columbus, OH, 43210, USA

    Trisha Van Zandt

66. Department of Psychology, University of California, Davis, CA, 95616, USA

    Simine Vazire

67. Microsoft Research, 641 Avenue of the Americas, 7th Floor, New York, NY, 10011, USA

    Duncan J. Watts

68. Department of Sociology, Harvard University, Cambridge, MA, 02138, USA

    Christopher Winship

69. Department of Sociology, Princeton University, Princeton, NJ, 08544, USA

    Yu Xie

70. Department of Sociology, Stanford University, Stanford, CA, 94305-2047, USA

    Cristobal Young

71. Department of Economics, Dartmouth College, Hanover, NH, 03755-3514, USA

    Jonathan Zinman

72. Department of Statistics, Texas A&M University, College Station, TX, 77843, USA

    Valen E. Johnson

Corresponding authors

Correspondence to Daniel J. Benjamin, Magnus Johannesson or Valen E. Johnson.

Competing interests

One of the 72 authors, Christopher Chambers, is a member of the Advisory Board of Nature Human Behaviour. Christopher Chambers was not a corresponding author and did not communicate with the editors regarding the publication of this article. The other authors declare no competing interests.

Reprints and permissions