Test-retest stability of the Task and Ego Orientation Questionnaire.
Abstract
Establishing stability, defined as observing minimal measurement error in a test-retest assessment, is vital to validating psychometric tools. Correlational methods, such as Pearson product-moment, intraclass, and kappa are tests of association or consistency, whereas stability or reproducibility (regarded here as synonymous) assesses the agreement between test-retest scores. Indexes of reproducibility using the Task and Ego Orientation in Sport Questionnaire (TEOSQ; Duda & Nicholls, 1992) were investigated using correlational (Pearson product-moment, intraclass, and kappa) methods, repeated measures multivariate analysis of variance, and calculating the proportion of agreement within a referent value of +/-1 as suggested by Nevill, Lane, Kilgour, Bowes, and Whyte (2001). Two hundred thirteen soccer players completed the TEOSQ on two occasions, 1 week apart. Correlation analyses indicated a stronger test-retest correlation for the Ego subscale than the Task subscale. Multivariate analysis of variance indicated stability for ego items but with significant increases in four task items. The proportion of test-retest agreement scores indicated that all ego items reported relatively poor stability statistics with test-retest scores within a range of +/-1, ranging from 82.7-86.9%. By contrast, all task items showed test-retest difference scores ranging from 92.5-99%, although further analysis indicated that four task subscale items increased significantly. Findings illustrated that correlational methods (Pearson product-moment, intraclass, and kappa) are influenced by the range in scores, and calculating the proportion of agreement of test-retest differences with a referent value of +/-1 could provide additional insight into the stability of the questionnaire. It is suggested that the item-by-item proportion of agreement method proposed by Nevill et al. (2001) should be used to supplement existing methods and could be especially helpful in identifying rogue items in the initial stages of psychometric questionnaire validation.Citation
Lane, A.M., Nevill, A.M., Bowes, N., & Fox, K.R. (2005). Test-retest stability of the Task and Ego Orientation Questionnaire. Research quarterly for exercise and sport, 76 (3), pp 339-46.Journal
Research Quarterly for Exercise and SportPubMed ID
16270710Additional Links
https://www.tandfonline.com/doi/abs/10.1080/02701367.2005.10599304Type
Journal articleLanguage
enISSN
0270-1367ae974a485f413a2113503eed53cd6c53
10.1080/02701367.2005.10599304
Scopus Count
Collections
Related articles
- Psychometric Properties of the Polish Version of Task and Ego Orientation in Sport Questionnaire (TEOSQ).
- Authors: Tomczak M, Walczak M, Kleka P, Walczak A, Bojkowski Ł
- Issue date: 2020 May 20
- Multi-sample confirmatory factor analysis of the Task and Ego Orientation in Sport Questionnaire.
- Authors: Chi L, Duda JL
- Issue date: 1995 Jun
- Stability of psychometric questionnaires.
- Authors: Nevill AM, Lane AM, Kilgour LJ, Bowes N, Whyte GP
- Issue date: 2001 Apr
- The Task and Ego Orientation in Sport Questionnaire: construct equivalence and mean differences across gender.
- Authors: Li F, Harmer P, Acock A
- Issue date: 1996 Jun
- Exploratory factor analysis of the Sport Orientation Questionnaire and the Task and Ego Orientation in Sport Questionnaire in a Japanese sport setting.
- Authors: Wakayama H, Watanabe E, Inomata K
- Issue date: 2002 Dec