What are some important things to look for in evaluating assessment components in computer-delivered career planning systems?
First, is there research evidence showing that the assessments (interests, abilities, job values, etc.) measure what they are purported to measure? Does the career planning system you are using (or considering) provide evidence that its assessments really work? DISCOVER® assessment components are based on research, and their validity for career planning applications is documented.
Second, are multiple results (interests, abilities, etc.) presented in an integrated, coordinated fashion that makes it easy to understand the results as a whole? The DISCOVER World-of-Work Map lets users see how their interests, abilities, and job values relate to each other and to career options. All DISCOVER assessment results are expressed in the same World-of-Work Map terms, and users are encouraged to explore families of related occupations before moving on to specific occupations.
I've heard of the World-of-Work Map. What makes it so special?
The World-of-Work Map is an extension of John Holland's hexagon. Holland developed the hexagon, known by counselors worldwide, in the 1960s when he was Vice President for Research at ACT. But the hexagon has only six types of interests and occupations. The World-of-Work Map has 26 career areas arranged on the research-based work task dimensions underlying Holland's hexagon. The Map provides a simple yet comprehensive overview of the work world—a perspective that is especially important for persons in the early stages of career exploration and planning.
Interest inventories have been around for a long time. How does the DISCOVER interest inventory differ from others?
The Unisex Edition of the ACT Interest Inventory (UNIACT), currently a component of 10 ACT programs, is completed by more than five million persons each year. UNIACT items emphasize work-relevant activities (fix a toy, conduct a meeting) that are familiar to counselees, either by participation or observation. Contrary to most other interest inventories, UNIACT does not use occupational titles or specific job duties that may be unfamiliar to persons in the early stages of career exploration/planning. Items have been carefully chosen to assess basic interests while minimizing the effects of sex-role connotations. UNIACT results are visually linked to career options via the World-of-Work Map. The UNIACT Technical Manual contains several chapters describing more than 20 years of research supporting the reliability and validity of UNIACT.
Ability tests have been around for a long time. Why does DISCOVER use ability self-estimates to aid career exploration?
Occupations differ on a wide range of abilities. Thus, a comprehensive search for occupations requires a comprehensive assessment of abilities. The DISCOVER Inventory of Work-Relevant Abilities (IWRA) assesses 15 abilities. Because ability/aptitude test batteries typically assess only six to nine abilities (despite the time and expense involved), important work-relevant abilities are usually missed—for example, sales, leadership, organization, and manual dexterity.
What about the validity of ability self-estimates?
ACT has conducted five large-scale studies comparing IWRA's validity for career exploration to those of test batteries. Each study found that IWRA's self-estimates of abilities improved upon the validity of test-estimates of abilities (test scores).
Why do IWRA's ability self-estimates do so well?
First, IWRA addresses a wide range of work-relevant abilities. Second, IWRA abilities are broadly defined in everyday terms. In contrast, abilities assessed by other tests are often narrowly focused (for example, consider typical clerical perception and spatial relations tests). Third, test-estimates of ability are often based on only a small sample of behavior collected in just a few minutes. IWRA self-estimates are informed by years of experience, by feedback from family and friends, and by feedback from classroom and achievement tests.
Job values inventories have been around for a long time. How does the DISCOVER inventory differ from others?
In terms of content, the Inventory of Work-Relevant Values (IWRV) is not much different from other job values inventories. However, DISCOVER uses the World-of-Work Map to link work values (e.g., for authority, public contact, physical activity) to career options and to interests and abilities. Thus, interests, abilities, and work preferences can be used in a coordinated fashion for career exploration.
How does ACT ensure that the quality of career assessments in DISCOVER is maintained over time?
Members of ACT's research staff design and conduct research projects to ensure the reliability, validity, and usefulness of DISCOVER career assessments. For example, the psychometric functioning of assessment items and scales is periodically reviewed and, if warranted, research is conducted to support revisions that enhance the functioning of the assessment.
How can I get more information about DISCOVER's research documentation?
Download Research Support for DISCOVER Assessment Components. This 24-page booklet summarizes a small part of the research supporting DISCOVER assessments. (PDF; 44 pages, 191KB)
More detailed research documentation about this and other DISCOVER topics can be ordered by calling the ACT Research Division at 319/337-1110 or through the Research section of this website.