Docs menu

Fact Checks

The facts AI engines state about your brand, collected every week and checked against your own site.

Engines state things about you: a price, a founding year, what a plan includes. Some of it is wrong, and a buyer can't tell. Fact Checks collects what the engines state about your brand every week and checks the facts you pick against your own site, so you know what to correct and what your site never says.

💡

Fact Checks is a feature Orvio turns on for your team. If it is not in your sidebar, ask us to turn it on.

What it shows

From top to bottom:

  • A status line: how many of this month's 80 verifications are used, and when the count resets.
  • Five cards: the Wrong Facts count, Wrong Facts by Engine, the Coverage Gaps count, and the Wrong Facts and Coverage Gaps lists.
  • Facts to Verify: facts waiting for a verdict, which you pick and send for checking.
  • The verified facts: Wrong Facts, Not on Your Site, Supported and No Longer Stated.
  • Dismissed: facts you set aside, with the reason.
  • History: every collection and verification, each opening its own page.

A collection or verification that is running shows under the status line with its progress.

How it is counted

The weekly collection

Once a week, Orvio reads every answer from your brand's newest complete run that named you, and collects the facts each answer states. Nobody picks prompts. This is a collection.

A fact is the thing being claimed, such as the price of one plan, whatever the wording. The same fact stated in three answers over two weeks is one fact, not three. Its distinct wordings are kept with it, up to the six newest, with the answers that stated each.

The 30 day window

A fact stays on the page for 30 days after an engine last stated it. A fact the engines keep stating stays; a fact they stopped stating leaves. Each fact waiting for a verdict says when it expires.

The cards read every fact with a verdict, so they cover the last 30 days rather than one run.

Verdicts

A fact gets a verdict when you verify it. Orvio checks its wordings against the pages of your site and gives each one of four verdicts:

VerdictMeaning
WrongYour site directly contradicts what the engine said.
Not on your siteNothing Orvio checked on your site backs or contradicts it: a coverage gap.
SupportedYour site backs it.
Not verifiedNot checked against your site yet.

A fact with several wordings takes the worst verdict among them, so one wrong wording makes the fact wrong.

What your site decides

A fact is wrong only when your own site says otherwise. Orvio does not judge facts against the wider web or its own knowledge. When your site says nothing either way, the fact is a coverage gap, never a wrong fact.

Your site here means your brand's domain. Other websites you list in General count as you in reports, but they are not read, so facts are checked against your domain alone.

A coverage gap is not proof that your site is silent: the check can miss a page that does state the fact. That is why the page says "nothing we checked".

Counted once per fact

The counts and lists count facts, not answers. A wrong price repeated in twenty answers is one wrong fact, because it is one thing to fix. The per-engine rings are the one exception, explained under Wrong Facts by Engine.

Resolved facts

A wrong fact, or one not on your site, is resolved when the engines stop stating it: two collections in a row asked at least one of its prompts, and no answer stated it. It moves to No Longer Stated and leaves every card. If an engine states it again, it comes back.

Supported and unverified facts are never resolved. They expire after 30 days like any other.

The monthly limit

Each brand can send 80 facts a month for verification, one per fact, whatever week the fact was first seen in. The count resets at the start of each calendar month, and the status line shows the date.

Verifying checks up to the three newest wordings of each fact. A fact verified once keeps its verdict while it stays on the page. If engines later state it in new words, the fact says so and offers Verify again.

If no verdict can be reached for a fact, it stays not verified and still counts against the month.

How to read it

About fact collection

The status line reads like "13 of 80 facts used this month, resets 1 Nov". Before anything is collected it starts with "No facts collected yet".

Its info dot says when facts were last collected, from which run, and how many answers and facts that collection read. It also says when the next collection is due.

Wrong Facts

The Wrong Facts count is how many facts the engines stated about you that your site contradicts, across every fact verified in the last 30 days. Each fact counts once, however many answers repeat it. Facts your site does not decide are never counted. A line under the number says how many wrong facts were resolved, or "none resolved".

The Wrong Facts list shows the top ones in two columns: "AI says" is what the engine stated, with the engines that said it, and "Actually" is what your site says. Under each fact, a line names what those answers cited, your site first when it was cited. Open a row for the full fact, or follow "All N facts" to the Wrong Facts section.

That section lists every wrong fact with its verdict date. Open one for its wordings and their verdicts, the answers behind it, and its history, such as "11 Oct: wrong · 1 Nov: no longer stated".

Until any fact has a verdict, the cards say "No fact has been verified yet" instead of showing zeros. A zero appears only once facts were checked and none was wrong.

Wrong Facts by Engine

One ring per engine your brand is measured on. The ring is the share of that engine's verified statements about you that your site contradicts. The number in the middle is the count, such as "3 of 40".

Each wording counts once per engine, however many of that engine's answers repeated it. Because the ring is a rate, an engine that answered more prompts does not look worse for it.

An engine with no verified fact reads "not checked" rather than an empty ring. Resolved facts are left out.

Coverage Gaps

The Coverage Gaps count and list are statements engines made about you that nothing Orvio checked on your site backs or contradicts, across every fact verified in the last 30 days. Each fact counts once. Facts never sent for verification are not gaps: they were never checked.

If a gap is true, your site is not giving engines a source for it. If it is false, your site has nothing that corrects it. Either way, the fix is a page that says it plainly.

Facts to Verify

Facts waiting for a verdict, one card per category: pricing, terms, credentials, company, results, process, services and other. A card is folded shut until you open it, and its box picks every fact in it.

Each fact shows the wording engines used, with other wordings behind "Show N other wordings", the engines that stated it, how many answers and weeks it was seen in, and when it expires. A New pill marks a fact first seen in the newest collection. View answer opens each answer behind it.

The heading says how many verifications are left this month. Pick facts, then press Verify in the bar at the bottom. The bar holds the button, and says why, when:

  • your site has not been read yet;
  • this month's 80 are used, or you picked more facts than are left;
  • a verification is already running, since a brand runs one at a time.

Not on Your Site

Verified facts your site does not confirm or deny: every coverage gap, with its verdict date and the same detail as a wrong fact.

Supported

Verified facts your site backs. Folded shut, since there is nothing to fix.

No Longer Stated

Wrong facts and facts not on your site that engines stopped stating. Each says what it was and since when, such as "wrong on Oct 4 · not stated since Oct 25". They stay until they expire.

Dismissed

A fact's menu dismisses it, with a reason: not about us, not a checkable fact, a duplicate of another fact, not worth checking, or other. A dismissed fact leaves every count, card and pick. Restore brings it back.

History

Finished collections and verifications, newest first. A verification reads what it found, such as "Verified 12 facts: 3 wrong, 2 not on your site". A collection says how many facts it added and whether its answers are still kept.

The fact check page

Each history entry opens its own page.

A verification's page shows what it found, under Wrong Facts, Not on Your Site and Supported. Each finding shows the wording, the engines, what the engine said against what your site says, and the page on your site behind the verdict. Verifications are kept for good, so this page outlives the facts it judged. Facts no verdict came back for are listed under Not Verified.

A collection's page lists answers read, claims found, distinct facts and answers not read, then each answer with its prompt. Answers are kept for 30 days. After that the counts stay, and distinct facts shows a dash, since it can no longer be counted.

Answer highlights

View answer opens the engine's answer exactly as it returned it. The strong highlights are the engine's own words for the fact: the statement your site contradicts, does not state or backs, or one not checked yet, depending on where you opened it.