Constructing and Validating Computerized Assessment of L2 Reading Comprehension

Abstract

The main purpose of this study was to construct and validate a Computerized version of Dynamic Assessment (C-DA) and examine its effectiveness in enhancing reading comprehension. Feasibility and concern for psychometric properties of testing are issues that have limited the use of DA approaches. In this study, C-DA is offered as a solution for overcoming such limitations. To this end, a software package named Computerized Dynamic Reading Test (CDRT) was developed. The software is capable of providing test takers with strategy-based hints. For each test taker, two scores are assigned by the software; a non-dynamic score which is based on test takers\\' first try of each item and a dynamic score which is based on the average hints they have employed. One hundred and four university students took the test. The findings of the study indicated that while observing the psychometric standards of testing namely, reliability and validity, C-DA was useful both in improving students\\' reading comprehension ability and in obtaining information about their potentiality for learning which goes beyond and over the initial performance level. While some test takers made the best use of the hints and could enhance their comprehension of the text, others could not use them to their advantage. The Information obtained from DA enables teachers to provide students with more individualized and consequently more effective instruction.