Yes, Psychologists Must Change the Way They Analyze Their Data: Clarifications for Bem, Utts, and Johnson (2011)

Does psi exist? In a widely publicized article featuring nine experiments with over one thousand participants, Bem (2011) claimed that future events retroactively affect people's responses. In a response, we pointed out that Bem's analyses were partly exploratory. Moreover, we reanalyzed Bem's data using a default Bayesian t-test and showed that Bem's evidence for psi is weak to nonexistent. A robustness analysis confirmed our skeptical conclusions. Recently, Bem, Utts, and Johnson (2011) question several aspects of our analysis. In this brief reply we clarify our analysis procedure and demonstrate that our arguments still hold.