Measuring the reliability of a computer-aided systematic observation instrument
Johnson, R.B.; Franks, I.M.
Canadian Journal of Sport Sciences 16(1): 45-57
1991
ISSN/ISBN: 0833-1235 PMID: 1645216 Document Number: 4324
The inter- and intraobserver reliabilities of data collected by observers trained in the use of the coach analysis instrument (CAI) are reported. The CAI is part of the computerized coaching analysis system (CCAS). The CAI collects data related to the learning environment created by the coach in a team/sport practice situation. Both inter- and intraobserver reliabilities are reported for each of the instrument's seven dimensions as well as for the overall instrument. The reliability measures reported are total percent agreement (T) and Cohen's kappa (K). The results indicated that, although the overall coaching analysis instrument reached a T value of 90.8%, it failed to meet the 80% level for the K measure (K = 78.5%). A dimension by dimension examination of the data was undertaken to determine the reasons for these results and it was revealed that the problem was associated with three specific dimensions of the instrument.
Document emailed within 1 workday
