A chatbot's wrong answer is your company's legal position

Air Canada argued its chatbot was a separate entity. The tribunal disagreed. Whatever your agent says, you said.

B

Balagei G Nagarajan

3 MIN READ


A speech bubble from a company chatbot turning into a legal document
that's the output you have to validate against ground truth before it reaches a customer.
— from “A chatbot's wrong answer is your company's legal position”

Key facts.

  • Moffatt v. Air Canada: the tribunal held the airline liable for its chatbot's negligent misrepresentation and rejected the "separate entity" defense, awarding $650.88 (ABA, 2024).
  • The ruling: companies are responsible for all information on their site, whether from a static page or a chatbot. No exception for AI.
  • Output handling matters: a wrong public response becomes a brand and legal event the moment a user acts on it. Customer-facing output needs to be checked against the source of truth before it reaches anyone.

Why is a confident wrong answer worse than a refusal?

Moffatt v. Air Canada held the airline liable for its chatbot, and a stronger model won't remove it: OSWorld's best near 12%, a brand incident regardless. (ABA, 2024)

Because users act on it. A refusal frustrates; a confident fabrication gets quoted, relied upon, and screenshotted. The Air Canada case turned on reliance: the customer believed the chatbot, made a decision, and the company was bound by it. For brand safety, the dangerous output isn't the rude one your filters catch, it's the polite, plausible, wrong one that sails through. that's the output you have to validate against ground truth before it reaches a customer.

Funnel diagram showing agent responses filtered for harm but a plausible wrong answer slipping through to the customer

Unchecked output vs. grounded output

Unchecked outputGrounded output
Plausible wrong answers reach usersClaims verified against policy and data
Company bound by fabricationsOutput matches the source of truth
Brand risk on every responseBrand risk gated at the boundary

VibeModel's Pattern Intelligence Layer recognizes when an agent's customer-facing answer departs from your policies and data, the pattern of a confident fabrication, and flags it before it ships. You own what the agent says; we make sure it says what's actually true. The Air Canada bill was small. The next one may not be.

Frequently asked questions

Does a disclaimer protect me?
Weakly. Air Canada's defenses didn't hold. Courts look at reliance, not fine print. Accuracy is the real protection.

What output should I worry about most?
The plausible wrong answer, not the obviously offensive one. Validate factual claims against your actual policies and data.


Share this post

Join the discussion

Have a take, a war story, or a question? Sign in with GitHub to comment and react. Comments are powered by GitHub Discussions, ad-free and yours to moderate.

Continue Reading

Find where your agent breaks, before you build it

Faultmap maps where your agent will fail from the goal and your data, then hands you the first test suite it has to pass.