Estimating the validity and reliability of an oral assessment instrument

Abstract

This article reports partial findings on a study conducted to estimate the validity and reliability of an oral assessment instrument.The study was conducted during the year 2002 at the Language Center in Eafit University. Validity was determined both through logical and empirical procedures. The results indicated the need to define clearly and precisely the construct to be measured, specify assessment criteria and scoring, and have evaluators who thoroughly understand the aspects included in the assessment instrument. Reliability was estimated using Spearman rank correlations as well as One Way Anova. Results suggest that well trained evaluators and well-designed instruments provide high consistencies in measurement.