Educational tests and measurements Examinations--Validity Multiple-choice examinations
Current developments in educational testing foster a renewed emphasis on evaluating the design of tests and the quality of test content. Empirical methods are designed to gather data about the items used for automated test assembly and their related tasks that define the content domain for a medical specialty examination and to evaluate the ways in which the test matches its content and cognitive specifications. A fundamental purpose of the analysis is to identify attributes for items that are selected by content experts for an examination and to assess any latent characteristics associated with the item selection or the content areas in an examination. The attributes and characteristics provide descriptive information for each item, for each content area, and for the assessment as a whole. These analyses provide applications for automated test assembly that can be used in classifying items and item attributes for optimal item selection for parallel forms. Every aspect of content for a medical examination may not be amenable to multiple-choice testing, and the question of whether or not multiple-choice assessment tools might be suitable is an empirical question that also will be reviewed. Multiple-choice item development that focuses directly on analytical, logical, or critical thinking skills will be addressed. Analysis of the relationship of test scores to a variable external to the examination will provide a source of validity evidence.
Metrics
41 File views/ downloads
18 Record Views
Details
Title
Practical issues related to content validity when using automated test assembly for optimal item selection for a medical specialty examination
Creators
Aggie M. Butler
Contributors
Donald L. McEachron (Advisor)
Awarding Institution
Drexel University
Degree Awarded
Doctor of Philosophy (Ph.D.)
Publisher
Drexel University; Philadelphia, Pennsylvania
Number of pages
viii, 180 pages
Resource Type
Dissertation
Language
English
Academic Unit
School of Biomedical Engineering, Science, and Health Systems (1997-2026); Drexel University