In an earlier post, I provided a summary of the many benefits of moving to computer-based assessment; among them was the potential cost savings as compared with administering paper-based assessments. I noted that because computer-based assessments vary greatly in context (e.g., number of administrations, numbers of examinees, number and types of items [questions and tasks], online versus offline, distributed versus centralized scoring, use of proctors) it is difficult to offer a generalizable percentage cost savings. It is possible, however, to estimate cost savings of computer-based assessment associated with specific scenarios. An example is presented below.
Example Assessment Scenario
- Occurs annually on one-day
- Approximately 160,000 examinees (across two languages)
- Examinees assessed in approximately 700 local schools and 50 schools in 12 foreign countries
- Two and one-half-hour test session; four-level achievement outcome
- Approximately 50 objective questions and six constructed-response tasks
- Computer-based assessment assumes remote item authoring, online assessment at school sites and distributed scoring
- Vendor provides applications/software for item development, administration, scoring and reporting assessment components
- Client manages all of the assessment components
- Costs such as security software , programming, etc. are included in the estimates
Estimated Cost Savings by Assessment Component
Summary
In this scenario, after initial set-up costs, the total estimated percentage savings of computer- versus paper-based assessment, for these four assessment components, is approximately 50%. (Staffing levels are assumed to be constant for the paper- and computer-based approaches.) Additional costs may be incurred depending on client needs and the vendor’s level of involvement in activities such as item development, scoring, psychometrics, etc.
Many jurisdictions/organizations are struggling with decisions about whether/how to proceed with computer-based assessment. RMJ Assessment has experience in this field and can offer considerations and advice. Should you wish to learn more about the services we offer, please visit our website at https://www.rmjassessment.com/, contact us by e-mail at richard.jones@rmjassessment.com or call (647) 234-5346.
RMJ ASSESSMENT 