Rally

Assessment

What is it?

“Rally” is a psychometric game that integrates psychometric testing with gaming technology to measure psychological constructs like individual skills, capacities, or characteristics using scientifically robust methods.

The game is based on the Flanker task (Eriksen & Eriksen, 1974), a neuropsychological test commonly used in scientific and psychodiagnostic settings to assess response inhibition. By incorporating game elements, “Rally” aims to motivate and engage candidates, helping them to reach a state of ‘flow’—a level of immersion that reduces awareness of the assessment aspect. This results in a more accurate reflection of the candidate’s best performance. Using gaming technology not only enhances the candidate experience but also allows for a more precise measurement of response inhibition, enabling the collection of more data in a shorter timeframe.

Information

Provider:

Ixly

What it measures:

•

Speed

•

Accuracy

•

Consistency

•

Concentration

•

Mistake recovery

Categories:

•

Games

Measurement Objectives

“Rally” measures reaction time and response inhibition.

  • Reaction time is the interval between a stimulus and the appropriate response. It depends on how quickly a person observes, processes, and reacts to changes, which is crucial for responding promptly and correctly in daily life situations, like stopping at a red traffic light, starting at the sound of a gun in a race, or responding to an alarm.
  • Response inhibition is the ability to suppress inappropriate or unnecessary actions. This control is essential for goal-directed behavior, allowing individuals to resist impulses, habits, or distractions from the environment. Examples include staying focused on work despite incoming emails, waiting for someone to finish speaking before responding, or ignoring unwanted thoughts or memories.

Use

“Rally” is applicable in contexts where reaction time and/or response inhibition are critical, including both selection and advisory scenarios. Response inhibition is vital for deliberate actions in everyday life and is especially crucial in professions like policing, firefighting, the military, and security, where suppressing impulses is essential. Reaction time is important in roles that require quick responses, such as in the transport sector.

Results

The results section offers insights into performance characteristics based on how the game was played, expressed as sten scores. Sten scores are standardized with an average of 5.5 and a standard deviation of 2, indicating how the candidate's performance compares to the reference group. Detailed explanations of the reported results, measurement methods, and definitions are provided in subsequent fact sheets.

Development

Developed to assess response inhibition and reaction time, “Rally” is based on the Flanker task and includes game elements such as graphics, levels, rewards, and feedback. The game was refined through three qualitative pilot studies, with key adjustments including a faster increase in difficulty levels based on participant feedback. A usability study ensured the game aligned with the general Dutch workforce. User experience and game interpretation were evaluated through think-aloud and probing interviews with 23 individuals from diverse cultural backgrounds, educational levels, ages, and varying game and computer experience. These insights informed further enhancements, making the game and tutorials accessible to a broad audience.

Reference Group

The reference group consists of data from a sample of 172 individuals, representative of the Dutch labor force in terms of employment status, gender, age, and educational level.

Key features

Development

Developed to assess response inhibition and reaction time, “Rally” is based on the Flanker task and includes game elements such as graphics, levels, rewards, and feedback. The game was refined through three qualitative pilot studies, with key adjustments including a faster increase in difficulty levels based on participant feedback. A usability study ensured the game aligned with the general Dutch workforce. User experience and game interpretation were evaluated through think-aloud and probing interviews with 23 individuals from diverse cultural backgrounds, educational levels, ages, and varying game and computer experience. These insights informed further enhancements, making the game and tutorials accessible to a broad audience.

References

Mayer, J., Roberts, R. D., & Barsade, S. G. (2008). Human abilities: Emotional intelligence. Annual Review of Psychology, 59, 507–536.

Van Rooy, D. L., Viswesvaran, C., & Pluta, P. (2005). An evaluation of construct validity: What is this thing called emotional intelligence. Human Performance, 18, 445–462. doi:10.1207/s15327043hup1804_9.

Zeidner, M., Roberts, R. D., & Matthews, G. (2008). The science of emotional intelligence: Current consensus and controversies. European Psychologist, 13, 64–78.