The ROBOT Critical AI Framework is a quick, systematic way to evaluate any AI-generated response. It is an easy-to-remember acronym that helps you verify the quality and safety of the information you receive.
After generating AI content, ask yourself each of the following questions:
R – Reliability
- How reliable is the information available about the AI technology?
- If it’s not produced by the party responsible for the AI, what are the author’s credentials? Bias?
- If it is produced by the party responsible for the AI, how much information are they making available?
- Is information only partially available due to trade secrets?
- How biased is the information that they produce?
O – Objective
- What is the goal or objective of the use of AI?
- What is the goal of sharing information about it?
- To inform?
- To convince?
- To find financial support?
B – Bias
- What could create bias in the AI technology?
- Are there ethical issues associated with this?
- Are bias or ethical issues acknowledged?
- By the source of information?
- By the party responsible for the AI?
- By its users?
O – Owner
- Who is the owner or developer of the AI technology?
- Who is responsible for it?
- Is it a private company?
- The government?
- A think tank or research group?
- Who has access to it?
- Who can use it?
T – Type
- Which subtype of AI is it? (GenAI, SuperAI, Machine Learning)
- Is the technology theoretical or applied?
- What kind of information system does it rely on?
- Does it rely on human intervention?