PROMIS conducted three rounds of testing items before September, 2006. This included 1) item pretesting, 2) a mode of testing study, and 3) most of the full bank testing. All testing was conducted through an online panel company.
PROMIS Participant Accrual
PROMIS Accrual Summary (08.31.06) |
| |
Item Pretesting Study |
Mode of Testing Study |
Full Bank Testing Study |
| Testing Period |
May, 2006 |
July, 2006 |
August, 2006 |
| Number Tested |
110 |
805 |
3,173 |
I. Item Pretesting Study
Emotional distress items were submitted to a general population sample. The goal was to use test data to help select the final item set that would undergo further testing.
II. Mode of Testing Study
In designing the testing platform there was uncertainty about (1) whether or not a participant should automatically be forwarded to the next item after providing an answer and (2) if a participant should be able to go back to the previous item. A study was conducted using one of the social role participation banks. The four test conditions included (1) automatic advance with a back button, (2) automatic advance without a back button, (3) use of a “next item” button after selecting an answer with a back button, and (4) use of a “next item” button after selecting an answer without a back button. Test data were analyzed to help decide on the final test platform, which auto advanced after response and enabled respondents to go back an item.
III. Full Bank Testing Study
The final item banks were submitted to testing in a general population sample. Each participant completed two full banks of items (e.g., the Emotional Distress-Depression bank and the Emotional Distress-Anxiety bank).