An AI Fact-Checking Workflow for Claims, Numbers, Quotes, and Images
A repeatable fact-checking workflow for verifying AI-generated and human-written claims without fictional case studies.
An AI fact-checking workflow should decompose content into checkable claims, prioritize by consequence, retrieve primary evidence, verify exact support, seek credible contradiction, and record a qualified verdict. AI can help locate and compare evidence, but it should not be the sole judge of a claim it generated.
1. Turn prose into atomic claims
A sentence may contain several facts. Split actor, action, date, place, quantity, cause, and comparison. ‘The agency introduced the rule in 2024 and reduced complaints by half’ contains at least a policy-date claim, an outcome claim, a measurement claim, and an implied causal claim.
2. Prioritize the check
High consequence: health, safety, law, finance, rights, or reputation
High spread: headline, chart, quotation, or shareable statistic
High uncertainty: surprising, absolute, anonymous, or poorly sourced
High volatility: current office, price, policy, product, schedule, or breaking event
3. Match the claim to primary evidence
Quote: recording, transcript, speech, judgment, or original publication.
Number: dataset, table, filing, methodology, and denominator.
Policy: enacted text and issuing authority.
Scientific result: paper, methods, data, correction status, and related evidence.
Image: original upload, reverse-image context, metadata when reliable, and visual landmarks.
The Library of Congress analysis model asks students to observe, reflect, question, and investigate further. It is a strong general sequence because it delays interpretation until the evidence object has been inspected.
4. Verify support, not topic overlap
Locate the exact passage, row, frame, or record.
Check date, version, jurisdiction, population, and definition.
Recalculate percentages from numerator and denominator.
Read footnotes and methodology around a chart or table.
Trace a quotation to context before and after the excerpt.
Search for corrections and a credible opposing source.
5. Use qualified verdicts
Supported: direct evidence establishes the claim as worded.
Supported with context: core fact is right but wording omits material limits.
Misleading: technically related evidence creates a false impression.
Unsupported: available sources do not establish it.
False: reliable evidence directly contradicts it.
Unresolved: evidence is missing, inaccessible, or genuinely conflicting.
NIST’s Generative AI Profile identifies risks specific to generative systems and proposes risk-management actions. For a practical fact-check, the key lesson is to document the context and response rather than treating an error as an isolated oddity.
Keep a verification record
Worked claim types
Checking a percentage
Find the original table and identify numerator, denominator, period, population, and whether the value is weighted or adjusted. Recalculate when possible. A change from 20 to 30 is a 50 percent relative increase but a 10 percentage-point increase. The fact-check should use the measure that matches the claim and explain ambiguity.
Checking a quotation
Locate the earliest reliable recording, transcript, filing, judgment, or publication. Confirm the speaker, date, exact words, and surrounding context. Ellipses, translation, edits, and a questioner’s wording can alter meaning. If only secondary reports exist, attribute the quote through them and lower confidence rather than presenting it as independently confirmed.
Checking a causal statement
Evidence that one event followed another does not establish causation. Look for study design, comparison group, alternative explanations, timing, mechanism, and replication. The verdict may support the underlying sequence while rejecting the causal wording. Rewrite ‘X caused Y’ as ‘Y followed X’ only if that narrower statement is what evidence shows.
Search tactics for contradiction
Search the exact claim and its negation.
Search for the named entity plus correction, methodology, audit, or retraction.
Find the original dataset rather than articles quoting it.
Compare archived and current versions of changing pages where appropriate.
Look for a regulator, standards body, court, or publisher update.
Search in the relevant local language when geography matters.
Ask what evidence a well-informed critic would use.
Avoid false balance
Seeking contradiction does not mean giving every claim equal weight. Compare source authority, directness, method, sample, currency, and independence. One well-supported primary record can outweigh many pages repeating an error. Conversely, an official statement can establish what an institution says without proving that its interpretation is complete.
Verification under time pressure
When time is limited, triage instead of pretending to complete a full check. Verify the claim’s existence, current primary source, exact number or quotation, and the context most likely to reverse interpretation. Label the result preliminary, list unchecked components, and set a follow-up owner. A fast qualified verdict is safer than an unqualified verdict whose evidence was only skimmed.
Check the controlling source before commentary.
Prioritize claims in the headline and opening.
Do not publish a quotation without locating it.
Recalculate one decisive number rather than scanning many minor facts.
State which evidence could not be accessed.
Update the record when the complete check is finished.
Document the correction
Fact-checking images and charts
An image claim can concern identity, place, date, alteration, or context. Begin with what is visibly observable, then locate the earliest reliable publication and related frames. Reverse-image matches can reveal prior use but do not alone establish who created an image. Metadata may be absent or editable. For charts, trace the visual to the underlying dataset and methodology; a genuine chart can still be shared with a false caption.
Inspect axes, cropped labels, units, baselines, and whether categories were omitted. Recalculate the headline comparison. If the image or chart cannot be sourced beyond reposts, report that limitation. Do not use visual confidence, apparent production quality, or an AI detector as a substitute for provenance.
Publishing a verdict
Quote the claim exactly enough that readers know what was checked.
Lead with the verdict and decisive evidence.
Explain context that changes interpretation.
Link primary sources and identify access dates.
Avoid certainty beyond the evidence.
Distinguish a false claim from an unverified one.
Provide a correction route and update the record when new evidence appears.
Record the exact claim, verdict, evidence URLs or file locators, source dates, reasoning, reviewer, and check date. In Rixx, cited web research and supported documents can be kept in a thread and turned into a report or Insight where available. That makes the check reusable without inventing a journalist, newsroom, or outcome story. A fact-check remains open to correction when stronger evidence appears.
