Skip to Main Content

Evaluating GenAI content

GenAI tools are not designed to produce factually accurate information. They are not capable of logical reasoning and cannot distinguish between accurate and inaccurate information. Content produced by GenAI tools can appear authoritative, but the words generated often don't refer to actual sources. GenAI tools are designed to produce plausible answers, but they can (and do) make things up! It's essential to evaluate carefully any content produced by a GenAI tool before even considering using it in your studies. 

If information needs to be accurate, asking a GenAI tool is too risky. You need to have expertise on the subject to assess whether it is correct. Always take steps to verify what a GenAI tool has produced. Check facts, and run author/title searches on Library Search for any references produced by a GenAI tool.

 

The SIFT Method

The SIFT method is a quick and effective way to evaluate content generated by GenAI.

SIFT step Key question Actions to take GenAI context
Stop

What is my purpose for using this information?

What GenAI model created this content?

Who developed/trained this GenAI model?

Pause before accepting or sharing.

Clarify your information need.

GenAI can generate plausible but incorrect or biased information.

Always assess credibility

Investigate

What data sources does the GenAI tool use?

Are there known biases or limitations?

What is the reputation of the GenAI platform?

What is the content's purpose?

How is the information framed?

Check for transparency about data sources and training.

Look for reviews or critiques of the tool.

GenAI outputs may lack clear authorship or transparency.
Find better coverage

Can I find similar information from reputable, non-AI sources?

Is there consensus among experts?

How does this GenAI output compare to trusted sources?

Is the information current?

Is the depth of information appropriate?

Are there significant omissions?

Search in Library Search, subject databases or reputable websites.

Compare findings.

GenAI may "hallucinate" facts or citations.

Always corroborate with reliable sources.

Trace

What is the original source of the information?

Has the GenAI output taken information out of context?

Are quotes or data accurately represented?

Are there signs of GenAI hallucinations?

Track references or claims back to their origins.

Check for misrepresentations or errors.

GenAI may fabricate sources or misquote.

Always check the original context and authenticity of claims.

 

Fact checking resources

Always check information generated by GenAI. You can use textbooks, journals and credible websites. A good place to start would be Library Search.

Here are some other fact checking resources:-

BBC Verify: examines the facts and claims behind a story to try to determine whether or not it is true.

Full Fact: charity that independently checks facts to find, expose and counter misinformation.

Snopes: the oldest and largest fact-checking site online.