Constraining item exposure in computerized adaptive testing with shadow tests

  • 14 Pages
  • 4.13 MB
  • 3820 Downloads
  • English
by
Law School Admission Council , Newtown, PA
Computer adaptive te
Other titlesConstraining item exposure in computerized adaptive testing with shadow tests (Online)
StatementWim J. van der Linden, Bernard P. Veldkamp.
SeriesLSAC research report series, Law School Admission Council computerized testing report -- 02-03., Computerized testing report (Law School Admission Council) -- 02-03.
ContributionsVeldkamp, Bernard P., Law School Admission Council.
Classifications
LC ClassificationsLB3060.32.C65 L544 2005
The Physical Object
Paginationi, 14 p. :
ID Numbers
Open LibraryOL16356076M
OCLC/WorldCa63667164

Constraining Item Exposure in Computerized Adaptive Testing With Shadow Tests Article (PDF Available) in Journal of Educational and Behavioral Statistics 29(3). Constraining item exposure in computerized adaptive testing with shadow tests.

Newtown, PA: Law School Admission Council, © (OCoLC) Material Type: Internet resource: Document Type: Book, Internet Resource: All Authors / Contributors: Wim J van der Linden; Bernard P Veldkamp; Law School Admission Council.

Description Constraining item exposure in computerized adaptive testing with shadow tests EPUB

T1 - Constraining item exposure in computerized adaptive testing with shadow tests. AU - van der Linden, Willem J. AU - Veldkamp, Bernard P. PY - Y1 - N2 - Item-exposure control in computerized adaptive testing is implemented by imposing item-ineligibility constraints on the assembly process of the shadow by: Item-exposure control in computerized adaptive testing is implemented by imposing item-ineligibility constraints on the assembly process of the shadow tests.

Computerized adaptive testing (CAT) is a form of computer-based test that adapts to the examinee's ability level. For this reason, it has also been called tailored other words, it is a form of computer-administered test in which the next item or set of items selected to be administered depends on the correctness of the test taker's responses to the most recent items administered.

A Review of Item Exposure Control Strategies for Computerized Adaptive Testing Developed from to Article (PDF Available) in Journal of Technology, Learning, and Assessment 5(8) May. van der Linden, W.

& Veldkamp, B. Constraining item exposure in computerized adaptive testing with shadow tests. Journal of Educational and Behavioral Statistics, 29, – CrossRef Google ScholarCited by: 9.

Exposure control research with polytomous item pools has determined that randomization procedures can be very effective for controlling test security in computerized adaptive testing (CAT). The current study investigated the performance of four procedures for controlling item exposure in a CAT under the partial credit model.

Computerized adaptive testing (CAT) presents a tradeoff problem between increasing measurement accuracy and decreasing item exposure in an item pool. To address this difficulty, we propose a new CAT that partitions an item pool to numerous uniform item groups using a maximum clique algorithm and then selects the optimum item with the highest Cited by: 1.

A Review of Item Exposure Control Strategies for Computerized Adaptive Testing Developed from to Elissavet Georgiadou Evangelos Triantafillou Anastasios A. Economides. Introduction.

In linear tests, either paper-and-pencil or computerized, all exam-inees are presented with all the items of a particular form of the test.

item exposure in computerized adaptive testing influence measurement precision and test security based on differing item selection methods and on the characteristics of diverse item pools?” Based on the literature review, it was observed that diverse conditions were brought together for item exposure control methods (Burt, Kim, Davis.

An Introduction to Computerized Adaptive Testing Nathan A. Thompson, Ph.D. Adjunct Faculty, University of Cincinnati A review of item exposure control strategies for computerized adaptive testing developed from to Journal of Technology, Learning, and Assessment, 5(8).File Size: KB.

Constraining item exposure in computerized adaptive testing with shadow tests.

Download Constraining item exposure in computerized adaptive testing with shadow tests PDF

Journal of Educational and Behavioral Statistics, 29, - Google Scholar | SAGE Journals | ISICited by: 7. A Comparison of Constrained Item Selection Methods in Multidimensional Computerized Adaptive Testing Show all authors.

Ya-Hui Su 1. Constraining item exposure in computerized adaptive testing with shadow tests. Journal of Educational and Behavioral Statistics, 29, Cited by: 7.

In computerized adaptive testing, testing continues until-the examinee fails a specific number of items in a row-a predetermined level of measurement accuracy is achieved-the examinee is administered the most difficult item-none of the above.

This video provides a very brief introduction to computerized adaptive testing, including the algorithms behind it, advantages/disadvantages, and some consid.

(1) to introduce two new item selection indices for cognitive diagnosis computerized adaptive testing (CD-CAT); (2) to control item exposure rates in CD-CAT; and (3) to propose an alternative CD-CAT administration procedure. Speci cally, two new item selection indices are introduced for cognitive diagnosis.

In addition, high item. Controlling item-exposure rates in computerized adaptive testing. Paper presented at the annual conference of the Military Testing Association, San Diego. ↑ van der Linden, W. J.; Veldkamp, B. "Constraining item exposure in computerized adaptive testing with shadow tests".

Journal of Educational and Behavioral Statistics. 29 (3. Predicting Item Exposure Parameters in Computerized Adaptive Testing One practical advantage of computerized adaptive tests (CATs) is that they can be administered on a flexible schedule rather than at fixed times.

The convenience and flexibility for examinees, however, may severely compromise test security if item exposure is not well Size: KB. Practical Questions in Introducing Computerized Adaptive Testing for K Assessments Introduction In many states, using the computer to deliver standards-based assessments is becoming increasingly attractive to departments of education, legislators, and other policy makers.

The potentialFile Size: KB. Computerized Adaptive Testing: Theory and Practice [van der Linden, Wim J., Glas, Cees A.W.] on *FREE* shipping on qualifying offers.

Computerized Adaptive Testing: 4/5(1). Computerized tests may replace paper-and-pencil tests in some instances. With computerized tests, each student's ability level can be estimated DURING the testing process and items can be tailored to this estimate of ability.

Consequently, students can take different versions of the same test. These tests are called computerized adaptive tests. Betz, N. New types of information and psychological implications. In D. Weiss (Ed.), Computerized adaptive trait measurement: Problems and ProspectsComputerized adaptive trait measurement: Problems and Prospects.

useful to control item exposure without a serious decrease in test precision.

Details Constraining item exposure in computerized adaptive testing with shadow tests PDF

One of the main goals of computerized adaptive testing (CAT) is to obtain precise ability estimates with a small number of items. To achieve this goal, items are selected specifically for each examinee from a large bank.

Computer-adaptive tests are designed to adjust their level of difficulty—based on the responses provided—to match the knowledge and ability of a test taker. If a student gives a wrong answer, the computer follows up with an easier question; if the student.

A complete list of CAT research has the term "computer-adaptive" used in titles only 43 times - "computerized adaptive" is used approximately times. And it's impossible to argue with a 'sample' of that size.

Computerized adaptive testing became the accepted terminology when Reckase's use of "tailored testing" died out. Computerized adaptive testing (CAT) is a form of computer-based test that adapts to the examinee's ability level.

For this reason, it has also been called tailored testing. This book contains most of what you need to understand how computerized adaptive tests (CAT) do what they do. It is a good complement to the seminal book on Item Response Theory (IRT) by Wainer's colleague, Frederic Lord (Applications of Item Response Theory to Practical Testing Problems).Cited by: With a general aim to address needs in formative assessments, this dissertation aims to achieve three objectives: (1) to introduce two new item selection indices for cognitive diagnosis computerized adaptive testing (CD-CAT); (2) to control item exposure rates in CD-CAT; and (3) to propose an alternative CD-CAT administration : Mehmet Kaplan.

in operational computerized adaptive testing (CAT) systems. These exposure problems might result in item compromise, or point at a waste of investments.

The exposure control problem can be viewed as a test assembly problem with multiple objectives. Information in the test has to be maximized, item compromise has to be minimized, and pool usage. A client of American College Testing, Inc. (ACT) decided to implement a computer-based testing program to replace their paper-pencil format for professional certification.

This paper reports on the results of the developed test after 1 year's use, especially as the results relate to test security issues. ACT research shows that a variable length computerized classification test using the Author: John C. Kalohn, Judith A. Spray.Computerized Adaptive Testing (CAT) •Custom individualized assessment •Suitable for clinical use •Accuracy level chosen by researcher Prostate Cancer —Item40 —Item38 —Item34 —Item32 —Item26 —Item 22 —Item 18 —Item 16 —Item 8 —Item 2 Breast Cancer —Item 36 —Item 34 —Item 32 —Item 28 —Item 26 —Item 22 —Item.

SimulCAT can generate reports on item pool usage and CAT administrations. For more advanced research, SimulCAT provides users with options to input differential item functioning (DIF) or item parameter drift (IPD) information as well as preexisting item exposure data.

The software tool also supports the use of syntax files and a cue file for.