AI Task Framing Assessment
Measure whether employees can judge when, where and how artificial intelligence should contribute to a workplace task — before they begin relying on an AI-generated answer.
Explore the assessment
Good AI judgement begins before the prompt
A person may review an AI answer critically and still make a poor initial decision about whether AI should have been used at all. They may delegate too much, apply AI to a sensitive decision, or avoid AI where it could safely help.
- Is AI appropriate for this task?
- What part of the task should AI support, and what should remain human-led?
- What context and constraints should define the task?
- What level of autonomy and what boundaries are proportionate?
Higher vs lower task-framing capability
AI Task Framing is the behavioural capability to define whether, where, why and under what constraints AI should contribute to a task, while retaining appropriate human responsibility.
Higher capability
Clarifies the problem before involving AI.
- Distinguishes suitable and unsuitable uses of AI
- Allocates bounded tasks rather than surrendering the decision
- Retains human ownership of consequential judgements
- Adjusts AI involvement to the task’s uncertainty and risk
Lower capability
Uses AI automatically because it is available.
- Delegates poorly defined or inappropriate tasks
- Allows the tool to redefine the original problem
- Confuses assistance with authority
- Applies the same AI workflow regardless of consequences
How the AI Task Framing Assessment works
Realistic workplace scenarios reveal how people define the role of AI when objectives, evidence and stakeholder needs are not perfectly aligned.
Workplace task
A realistic task where AI could plausibly play several different roles.
Framing decision
The participant defines what AI should and should not do, and what context it needs.
Boundary setting
Response choices reveal whether sensitive information and decision rights are protected.
Task-framing profile
Reports identify strengths, over-delegation risk and development priorities.
What the assessment can measure
The exact framework can be tailored to the target roles and AI use cases.
Task Suitability Judgement
Recognises whether AI is likely to add genuine value rather than using it by default.
Problem Definition
Clarifies the decision or objective before asking an AI system to contribute.
Human–AI Role Allocation
Decides which parts can be supported by AI and which require human accountability.
Boundary Setting
Establishes limits around the information, decisions and actions AI should influence.
Context & Criteria Specification
Identifies objectives, constraints, evidence and criteria needed to frame useful AI support.
Proportionality of AI Use
Matches AI involvement to the uncertainty, complexity and consequences of the task.
AI Task Framing within the RWA AI Judgement Framework
AI Task Framing is a focused secondary construct that sits upstream of RWA’s six primary AI judgement constructs — it concerns the decision about whether, where and how AI should be involved before these broader judgement processes take place.
AI-Assisted Decision Quality
Measures the quality of workplace decisions made when AI contributes information, recommendations or analysis.
Information Credibility Evaluation
Measures how effectively individuals evaluate the accuracy, reliability and evidential quality of AI-generated information.
Human Oversight Behaviour
Measures whether people retain appropriate review, accountability and human control when AI contributes to decisions.
Escalation Judgement
Measures whether individuals recognise when additional human, specialist or managerial input is required.
AI Risk Evaluation
Measures how effectively individuals identify, evaluate and respond to risks associated with AI-supported decisions.
Confidence Calibration
Measures whether confidence in AI-assisted decisions is appropriately matched to evidence, uncertainty and context.
What an AI task-framing scenario might examine
Example only — not a live scored item.
A manager is preparing a recommendation about a service change. Available information includes customer feedback, operational data and commercially sensitive internal assumptions. The manager could ask AI to produce the whole recommendation, use AI only to organise themes, exclude sensitive material, or complete the analysis without AI.
What the response reveals
- Clarifies the decision that must be made
- Separates analysis support from final recommendation ownership
- Restricts use of sensitive information
- Matches AI involvement to the consequences of error
Sample AI task-framing profile
Reports identify strengths, over-delegation risk and practical development priorities.
Generally sound task framing, with a tendency to over-scope AI involvement under time pressure.
Scores and descriptors are illustrative. Norms, benchmarks and interpretive claims should be based on evidence for the relevant assessment version, population and intended use.
What the assessment is not designed to measure
Not prompt engineering
Not primarily a test of prompt syntax or familiarity with a particular generative AI product.
Not general AI literacy
Does not principally assess knowledge of AI terminology or model architecture.
Not simple AI adoption
Frequent AI use is not automatically stronger capability — appropriate non-use can demonstrate better judgement.
Psychometrically informed and evidence-led
Recognised standards inform the design and use of this assessment. They are not presented as proof that a particular version has already been validated — reliability, validity, fairness and benchmark evidence should be developed through piloting and appropriate use.
ISO 10667-1 & 10667-2
International standards addressing responsibilities, procedures and quality considerations when assessment services are used in work settings.
View →
ISO/IEC 42001:2023
The international AI management-system standard, covering governance, policies, accountability and risk management.
View →
NIST AI Risk Management Framework
A voluntary framework helping organisations govern, map, measure and manage risks associated with AI systems.
OECD AI Principles
International principles promoting innovative and trustworthy AI, including transparency, robustness and accountability.
SIOP Principles
Professional principles addressing job relevance, validation, fairness and responsible use of employment assessment procedures.
View →
Standards for Educational & Psychological Testing
Widely recognised guidance on validity, reliability, fairness, score interpretation and appropriate assessment use.
View →
Psychometric design before assessment technology
RWA develops bespoke psychometric assessments beginning with the construct and the decision the assessment must support.
Construct definition first
Broad labels can conceal mixtures of knowledge, confidence and job-specific behaviour — RWA starts with a precise definition.
Bespoke scenario design
Scenarios reflect the organisation’s actual roles, AI use cases and decision risks.
Evidence-led positioning
Task Framing is presented as a secondary construct until pilot evidence supports independent measurement.
Full development pathway
From construct definition through pilot, validation and reporting.
Explore related RWA AI assessment services
Develop an AI Task Framing Assessment for your organisation
RWA can develop a focused task-framing assessment or incorporate it into a broader AI judgement diagnostic.
Book a consultation
AI Task Framing Assessment FAQs
What is an AI Task Framing Assessment?
A structured assessment of whether an individual can decide when, where, why and under what constraints AI should contribute to a task.
Is AI Task Framing a primary AI judgement construct?
RWA currently positions it as a secondary construct — behaviourally useful, but overlapping conceptually with the six primary constructs.
Is this a prompt-engineering test?
No. It focuses on the prior judgement about the role, purpose and boundaries of AI, not prompt syntax.
Can the assessment be used on its own?
Potentially, where inappropriate task delegation or uncontrolled AI use is a specific organisational concern.
Can it be included in a broader AI judgement assessment?
Yes. Task-framing scenarios can supplement a broader assessment of decision quality, oversight and confidence calibration.
How do we begin?
RWA can discuss target roles and AI use cases and recommend the most appropriate assessment format.