ACTimprove yourself

Related Information

 

Observation and Workplace Observation Comparison

Test Overview

Similarities

Both assessments are useful for testing individuals for jobs that require employees to observe, follow, understand, and evaluate processes, demonstrations and other on-the-job procedures, as well as to provide mentors and trainees with information to help with coaching and personal development.

Differences

Observation measured an employee's ability to focus—notice—remember. Workplace Observation places more emphasis on problem solving and critical thinking. While an employee still has to focus and notice what they are observing, they may also be asked to follow, interpret, synthesize, analyze, or evaluate what they have observed. In summary, Workplace Observation represents a broader definition of the skill.

All the information is presented in realistic workplace situations. No prior knowledge is necessary.

Observation New Workplace Observation
WorkKeys Observation is the skill people use when they pay attention to and remember work-related instructions, demonstrations, and procedures. There may be distractions or other information competing for the employees' attention. The details observed will differ depending on the job, the task, and the situation. WorkKeys Workplace Observation is the skill that individuals use to visually observe a workplace event, notice details, and remembers instruction, procedures, processes, and demonstrations in order to generalize to workplace situations that may be similar or very different from what was observed. Employees must pay careful attention to steps that are followed, to safety procedures, and to quality control standards.
Skill Levels range from 3 to 6. Skill Levels range from 1 to 5.
The observed situations are videotaped scenarios. The observed situations include a variety of videotaped, animated, and still presentations.

Test format

The exam requires test takers to observe scenarios and then answer multiple-choice items relevant to what was observed in the scenario.

The scenarios start at the lowest level of the skill (i.e., Observation Level 3 and Workplace Observation Level 1) and increase in length and amount of information, representing a sample of the variety of observed procedures or demonstrations employees might receive on the job. Workplace Observation begins at skill Level 1, a skill more basic level than Observation.

Observation New Workplace Observation
The test is presented via a VCR or DVD to be projected for the examinees in a group. A paper document is provided for test-takers to record their responses. The test is presented onscreen, via the Web and accessed through a connection with ACT. Answers are recorded onscreen as well.
The observation tasks are recorded on videotape or DVD. Stimulus and items are shown to the group and advanced automatically by the video presentation. The observation tasks are recorded in digital media and delivered via computer; items are answered at the examinee's individualized pace (i.e., advanced at the discretion of the examinee).
12 scenarios are observed by the individuals taking the test. Examinee answers 36 questions, all of which are scored. 14 scenarios are observed by the individuals taking the test. Two scenarios are embedded field test sets containing a total of 5 field test (unscored) items. Examinee answers a total of 35 questions, 30 of which are scored.
60 minutes of test time is allowed. 55 minutes of test time is allowed.

Test delivery

Observation New Workplace Observation
Easy to administer to groups with basic video equipment. Easy to administer to individuals via computer.
The administrator simply starts the videotape and lets it play. The tape is recorded with appropriate pauses, directions, and tasks that guide the test takers through the exam. Each scenario is presented once during the test. Each item is shown and read to the examinees with time given for the examinees to respond before moving to the next item or scenario. Scenarios and questions cannot be replayed. The Workplace Observation test is administered by computer. The appropriate directions, a tutorial, and help screens guide the examinees as they take the exam. When the test is initiated by the examinee, the first scenario is presented once, then the items associated with that scenario are presented one at a time to the examinee, who can respond and proceed at his/her own pace. Scenarios can only be viewed once, and once an item has been answered, the examinee is unable to return to that item.
The response is penciled in on a scannable answer document that is then processed for scoring. The response is entered by clicking a check box next to the desired answer and clicking a button to proceed.

Skills

Each skill level requires more competency than that required at previous levels. As skill level increases, the observation skills examinees are asked to demonstrate are of a higher order of complexity, requiring the ability to focus on relevant elements and to appropriately filter out distractions.

Observation New Workplace Observation
Skills cover a fairly broad range of observation skill across four levels, from a moderately low level of skill to a relatively high level of skill. Level 3 is the least complex, and Level 6 is the most complex. Skills cover a broader range of observation skill, from a lower level of skill requirement to a significantly higher level of observation skill. The assessment covers 5 levels. Level 1 is the least complex and Level 5 is the most complex.
Skills are specifically defined and are organized by level:

Level 3:

  • Remember a few strongly prompted details
  • Pay attention to the basic parts of a straightforward procedure
  • Remain aware of instructions and reminders that give strong cues
  • Concentrate on the important elements of a procedure

Level 4:

  • Select and pay attention to the components of a straightforward procedure with some details that are hard to notice
  • Remember a few important details that are reinforced
  • Remain focused on relevant details when there are some extra details or distractions

Level 5:

  • Focus attention on and remember several important details from a complex set of events that may occur at the same time
  • Maintain attention to significant details with little prompting
  • Remember relevant aspects of the information presented
  • Remember several important details about unique material
  • Ignore irrelevant background information or distractions and pay attention only to important points

Level 6:

  • Recognize a number of steps that are presented at the same time
  • Notice and remember several details that are relevant to the procedure
  • Visualize how a step fits into the procedure even if there are not many hints or reminders
  • Disregard irrelevant information
  • Interpret if-then and cause-and-effect relationships that affect tasks
  • Make predictions, comparisons, and evaluations
 Skills are broadly and specifically defined and are organized by level:

Level 1: Following the Observed. Test takers will observe and imitate all or parts of a simple demonstration, process, or procedure.

  • Maintain focus on a short demonstration, process, pattern, or procedure
  • Repeat a short, straightforward demonstration, process, pattern, or procedure
  • Recognize an incorrect or missing step

Level 2: Interpreting the Observed. Test takers will be required to interpret simple instructions, demonstrations, processes, or procedures.

  • Recognize cause and effect in a straightforward demonstration, process, pattern, or procedure
  • Identify course of action to take given a single condition
  • Filter out obvious distractions

Level 3: Synthesizing the Observed. Test takers will be able to combine more than one step that has been presented in an observed demonstration, procedure, or process while filtering multiple distractions that may make remembering details difficult.

  • Process information from a more complex procedure or process
  • Distinguish steps that seem similar but are different based on varying factors
  • Apply information to a similar situation

Level 4: Analyzing the Observed. Test takers will need to make inferences, anticipate outcomes, and/or extrapolate information from an observed demonstration, procedure, or process.

  • Make inferences from a demonstrated process or procedure
  • Deduce from a partial or nonexplicit pattern, process, or procedure
  • Decide which conditions apply to a new situation
  • Determine general principle(s) underlying a condition, process, or procedure
  • Apply complicated instructions to new situations

Level 5: Evaluating the Observed. Test takers will evaluate which alternative is best based on previous observation and make evaluative judgments about what has been observed.

  • Evaluate whether something is or is not a distraction (relevance)
  • In a context where information is not complete and when presented with a new situation, be able to judge the best course of action
  • Make predictions, test hypotheses
  • Consider the implications of a process or procedure
  • Prioritize and apply principles to reach desired outcome

Scoring

Scoring of the test is based on number of items correct. There is no correction for guessing.

Observation New Workplace Observation
Materials are returned to ACT and the answer sheets are scanned and scored, or a WorkKeys Service Provider or private site with scanning equipment and an Express Score® license from ACT can scan and transmit scanned results to ACT for scoring and local “instant” reporting. At the end of the testing session, the test is scored immediately and results are made available to the administrator online. There are no mailing times, scanning or associated costs to consider.
Scores range from <3 to 6. Scores range from 0 to 5.
No secondary scale scores are available. Secondary scale scores will be provided in the second release of the Workplace Observation assessment.