Measuring the reliability of a computer-aided systematic observation instrument

Johnson, R.B.; Franks, I.M.

Canadian Journal of Sport Sciences 16(1): 45-57

1991


ISSN/ISBN: 0833-1235
PMID: 1645216
Document Number: 4324
The inter- and intraobserver reliabilities of data collected by observers trained in the use of the coach analysis instrument (CAI) are reported. The CAI is part of the computerized coaching analysis system (CCAS). The CAI collects data related to the learning environment created by the coach in a team/sport practice situation. Both inter- and intraobserver reliabilities are reported for each of the instrument's seven dimensions as well as for the overall instrument. The reliability measures reported are total percent agreement (T) and Cohen's kappa (K). The results indicated that, although the overall coaching analysis instrument reached a T value of 90.8%, it failed to meet the 80% level for the K measure (K = 78.5%). A dimension by dimension examination of the data was undertaken to determine the reasons for these results and it was revealed that the problem was associated with three specific dimensions of the instrument.

Document emailed within 1 workday
Secure & encrypted payments

Measuring the reliability of a computer-aided systematic observation instrument