Considerations of control groups: Comparing active-control with no treatment for examining the effects of brief intervention

Abstract

Background: A large-scale online study completed by this research team found that brief psychological interventions were associated with high-intensity pleasant emotions and predicted performance. The present study extends this work using data from participants (n = 3376) who completed all self-report data and engaged in a performance task but who did not engage with an intervention or control condition and therefore present as an opportunistic no-treatment group. Methods: 41,720 participants were selected from the process and outcome focus goals intervention groups, which were the successful interventions (n = 30,096), active-control (n = 3039), and no-treatment (n = 8585). Participants completed a competitive task four times: first as practice, second to establish a baseline, third following an opportunity to complete a brief psychological skills intervention, and lastly following an opportunity to repeat the intervention. Repeated measures MANOVA indicated that over four performance rounds, the intensity of positive emotions increased, performance improved, and the amount of effort participants exerted increased; however, these increases were significantly smaller in the no-treatment group. Conclusions: Findings suggest that not engaging in active training conditions had negative effects. We suggest that these findings have implications for the development and deployment of online interventions.