It’s not easy to develop a defensible certification exam, but the process of job analysis doesn’t require a Ph.D. in Psychometrics to understand. Here’s an overview of what to expect.
- Convene a panel of subject matter experts (SMEs), who discuss the role of the certification in the profession, and establish high-level topics (domains)
- The SME panel generates a list of job tasks that are assigned to domains; the list is reviewed for duplicates and other potential issues
- The final list is used to generate a survey, which is sent to a representative sample of professionals that actually work in the role
- The respondents take the survey, whereby they rate each task, usually on its importance and time spent (sometimes called criticality and frequency); demographics are also gathered
- A psychometrician analyzes the results to determine critical and frequent tasks
- A draft of the test blueprints is recommended. Tasks/domains with more importance and frequency should have top priority.
- The SME panel reviews and approves the blueprints