Loading...
Test-retest stability of the Task and Ego Orientation Questionnaire.
Lane, Andrew M. Nevill, Alan M. Bowes, Neal. Fox, Kenneth R.
Lane, Andrew M.
Nevill, Alan M.
Bowes, Neal.
Fox, Kenneth R.
Editors
Other contributors
Affiliation
Epub Date
Issue Date
2005
Submitted date
Alternative
Abstract
Establishing stability, defined as observing minimal measurement error in a test-retest assessment, is vital to validating psychometric tools. Correlational methods, such as Pearson product-moment, intraclass, and kappa are tests of association or consistency, whereas stability or reproducibility (regarded here as synonymous) assesses the agreement between test-retest scores. Indexes of reproducibility using the Task and Ego Orientation in Sport Questionnaire (TEOSQ; Duda & Nicholls, 1992) were investigated using correlational (Pearson product-moment, intraclass, and kappa) methods, repeated measures multivariate analysis of variance, and calculating the proportion of agreement within a referent value of +/-1 as suggested by Nevill, Lane, Kilgour, Bowes, and Whyte (2001). Two hundred thirteen soccer players completed the TEOSQ on two occasions, 1 week apart. Correlation analyses indicated a stronger test-retest correlation for the Ego subscale than the Task subscale. Multivariate analysis of variance indicated stability for ego items but with significant increases in four task items. The proportion of test-retest agreement scores indicated that all ego items reported relatively poor stability statistics with test-retest scores within a range of +/-1, ranging from 82.7-86.9%. By contrast, all task items showed test-retest difference scores ranging from 92.5-99%, although further analysis indicated that four task subscale items increased significantly. Findings illustrated that correlational methods (Pearson product-moment, intraclass, and kappa) are influenced by the range in scores, and calculating the proportion of agreement of test-retest differences with a referent value of +/-1 could provide additional insight into the stability of the questionnaire. It is suggested that the item-by-item proportion of agreement method proposed by Nevill et al. (2001) should be used to supplement existing methods and could be especially helpful in identifying rogue items in the initial stages of psychometric questionnaire validation.
Citation
Lane, A.M., Nevill, A.M., Bowes, N., & Fox, K.R. (2005). Test-retest stability of the Task and Ego Orientation Questionnaire. Research quarterly for exercise and sport, 76 (3), pp 339-46.
Research Unit
PubMed ID
16270710
PubMed Central ID
Embedded videos
Additional Links
Type
Journal article
Language
en
Description
Series/Report no.
ISSN
0270-1367