Book chapter
Studies without Internal Controls
Medical Uses of Statistics, pp 105-123
1992
Abstract
Sometimes questions of clinical interest such as the efficacy and safety of a treatment can be addressed only by investigations without concurrent controls that are under the supervision of the investigator (internal controls). Such studies nearly always make use of other types of comparisons (external controls), such as historical controls.
In this chapter we examine studies of clinical treatments that have weak internal controls or lack internal controls, as illustrated by examples from the New England Journal of Medicine. These studies have a small but important and unique role in clinical investigation. Five interrelated features can add to the strength of such studies: (1) an intent by the investigator, expressed before the study, that the treatment will affect the outcomes reported; (2) planning of the analysis before the data are generated; (3) articulation of a plausible hypothesis before the results are observed; (4) a likelihood that the results would still have been of interest if they had been “opposite” in some sense; and (5) reasonable grounds for generalizing the results from the study subjects to a substantially broader group of patients.
Examples of successful studies of this kind include reports of dramatic or surprising results, encouraging results of innovations in desperate circumstances, studies of unique groups, and early warnings. In each successful use, we find evidence of urgency, with timeliness of the report outweighing its tentative nature.
In spite of potential pitfalls, carefully selected and reported studies without internal controls can play a substantial part in the acquisition of scientific knowledge. They can warn of dangers, point out opportunities, and help determine the focus of more powerful controlled studies, whose strength they complement but do not duplicate.
Consideration of the design and use of studies without internal controls has lagged behind developments regarding “stronger” research approaches. This chapter provides an empirical basis for such consideration by examining the use of this design in a series of reports that appeared in the New England Journal of Medicine. A good way for an investigator to protect the strength of inferences and to convince others of the validity of statistical conclusions is to describe carefully the scientific rationale that led to the particular limited set of hypotheses that the study was designed to confront. Explicit prior hypotheses that could — at least in concept — be refuted by observation add considerable strength to externally controlled studies, as they do to studies with more rigorous designs. T. C. Chalmers offers case histories of the impact of well-designed controlled studies of therapeutic measures that were initially promoted on less solid grounds.
Metrics
2 Record Views
Details
- Title
- Studies without Internal Controls
- Creators
- John C. BailarThomas A. LouisPhilip W. LavoriMarcia Polansky
- Contributors
- John C. Bailar (Editor)Frederick Mosteller (Editor)
- Publication Details
- Medical Uses of Statistics, pp 105-123
- Publisher
- CRC Press
- Edition
- 2
- Resource Type
- Book chapter
- Language
- English
- Academic Unit
- Epidemiology and Biostatistics
- Other Identifier
- 991022040668904721