2011 : L’annus horribilis de la psychologie. [ La crise de la réplica-quoi ? – #TmS – Partie 1 ]

Dans ce premier épisode de Talking (meta) Sciences, Jean présente la notion de crise de la réplication en remontant à l’annus horribilis de la psychologie sociale : 2011.

En 2011, les scientifiques sont confrontés au fait que la littérature scientifique contient d’une part des choses qui ne sont pas crédibles et pourtant démontrée, et d’autre part des choses qui sont crédibles mais qui reposent en réalité sur de la fraude. Mais la crise de la réplication, ce n’est pas seulement de la méfiance et de l’inquiétude : c’est une baisse de confiance en la littérature qui se base sur l’évaluation de la réplicabilité de corpus d’études d’une discipline.

——————————————————————————————————————
Sources :

Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349(6251). https://doi.org/10.1126/science.aac4716

Klein, R. A., Ratliff, K., Vianello, M., Adams Jr, R. B., Bahník, Š., Bernstein, M., … & Nosek, B. A. (2022). Investigating variation in replicability: A “many labs” replication project.

Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams Jr, R. B., Alper, S., … & Sowden, W. (2018). Many Labs 2: Investigating variation in replicability across samples and settings. Advances in Methods and Practices in Psychological Science, 1(4), 443-490.

Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., … & Nosek, B. A. (2016). Many Labs 3: Evaluating participant pool quality across the academic semester via replication. Journal of Experimental Social Psychology, 67, 68-82.

Klein, R. A., Cook, C. L., Ebersole, C. R., Vitiello, C., Nosek, B. A., Hilgard, J., … & Ratliff, K. A. (2022). Many Labs 4: Failure to replicate mortality salience effect with and without original author involvement. Collabra: Psychology, 8(1), 35271.

Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T. H., Huber, J., Johannesson, M., … & Wu, H. (2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour, 2(9), 637-644.

Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P., … & Glasziou, P. (2014). Biomedical research: increasing value, reducing waste. The Lancet, 383(9912), 101-104.

Gundersen, O. E., & Kjensmo, S. (2018, April). State of the art: Reproducibility in artificial intelligence. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 32, No. 1).

Cancer Biology Reproducibility Project : https://www.cos.io/rpcb?_ga=2.159607293.112189113.1667251698-8936449.1632115986

——————————————————————————————————————
Ressources additionnelles :

Wagenmakers, E. J., Wetzels, R., Borsboom, D., & van der Maas, H. L. (2011). Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011). Journal of personality and social psychology, 100(3), 426–432. https://doi.org/10.1037/a0022790

Réponse de Bem :
Bem, D. J., Utts, J., & Johnson, W. O. (2011). Must psychologists change the way they analyze their data?. Journal of personality and social psychology, 101(4), 716–719. https://doi.org/10.1037/a0024777

Réponse à la réponse :
Wagenmakers, E., Wetzels, R., Borsboom, D., Kievit, R.A., & van der Maas, H.L. (2018). Yes, Psychologists Must Change the Way They Analyze Their Data: Clarifications for Bem, Utts, and Johnson (2011).

Echecs de réplication de Bem :
Ritchie SJ, Wiseman R, French CC (2012) Failing the Future: Three Unsuccessful Attempts to Replicate Bem’s ‘Retroactive Facilitation of Recall’ Effect. PLoS ONE 7(3): e33423. https://doi.org/10.1371/journal.pone.0033423

Muhmenthaler, M. C., Dubravac, M., & Meier, B. (2022). The future failed: No evidence for precognition in a large scale replication attempt of Bem (2011). Psychology of Consciousness: Theory, Research, and Practice.

Galak, J., LeBoeuf, R. A., Nelson, L. D., & Simmons, J. P. (2012). Correcting the past: Failures to replicate psi. Journal of personality and social psychology, 103(6), 933.

Robinson, E. (2011). Not feeling the future: A failed replication of retroactive facilitation of memory recall. Journal of the Society for Psychical Research, 75(904).

——————————————————————————————————————

Voix et vidéo de Jean
Montage de Thomas

Pour nous retrouver sur twitter :
https://twitter.com/Thomas_Mangin_
https://twitter.com/JeanMoneger

Le lien vers l’OSF du reproducibiliTea de Poitiers : https://osf.io/82dc9/

Et nos liens ResearchGate :
https://www.researchgate.net/profile/…
https://www.researchgate.net/profile/…