How do I know you are not cherry-picking?
Don't take anyone's word for it, The Trail's included: it's built so you can check every quote, with other readings of the evidence kept beside the claims. But which questions get asked is still one person's choice.
Part 1 · The worry
The worry is fair. Anyone can build a case from real quotes, just by leaving out the awkward ones.
And a Catholic writing about the Catholic Church will tend to find the friendly ones.
Cherry-picking comes in two kinds.
One is cutting a quote so it says what the writer didn't mean. The other is choosing which questions get asked at all.
The first is much easier to guard against than the second.
Here's how The Trail tries to do both, and where it still falls short.
Part 2 · The whole record, kept together
Every claim sits in its own small file in the project.
It holds one sentence, the source's exact words and a link to the original.
Most also say what the claim can't prove, and how others read the same evidence.
Where others read the evidence differently, their reading is kept right beside it.
You can see those files on the site, under Check it yourself at the foot of every chapter.
It lists each claim the chapter leans on, with its source, its other readings, its limits and how far it's been checked.
To see one in full, open the method page, the page that explains how the site works.
Its chapter IV, One claim, start to finish, follows a single claim all the way from an old letter to the page you read.
Here's an analogy that might help. Think of buying a second-hand car.
Any seller can park it with the shiny side facing you and the dented door against the wall.
They're not lying, exactly. Everything you can see is real.
You just can't see everything, and they know it. You find the rust after you've paid.
A seller you can trust does it differently. They walk you round the whole car, dent included.
They hand you the full service log, with the accident report still in it.
And they give you the number of the garage that did the repairs, so you can call and check for yourself.
That's the idea here: show the whole record, and tell you how to check it.
You shouldn't have to trust the seller's smile.
Part 3 · Scripts that check
Good intentions aren't enough, so scripts check the files. A script is a small program that does one job the same way every time.
Every source page is downloaded and saved as plain text, and every quote must be found in one, word for word.
The saved copies stay in the project's own files, not on the site, because they belong to the sites they came from.
Every source still links to the original, so you can check it there.
And the checks work.
In September 2026 they caught eight quotes that the AI helping to write the site had typed from memory, in one day's writing.
None of them could be traced to any saved page.
Under the site's rule, a quote like that is shown to you as unchecked, and its claim stays a draft.
So what happened to those eight? Each one was looked up in its document.
Seven turned up there word for word. The wording had been right. It just hadn't been checked.
The eighth was in a translation whose web page couldn't be reached to check it.
So it was replaced with another English translation of the same passage, one that could be checked.
All eight were settled by 8 October 2026. Each claim's card, under Check it yourself, tells you how in its Audit note.
And as of October 2026, the method page counts no claim left at draft.
Part 4 · What a script can't see
Now the honest part. A script can't tell if the sentence around a quote says more than the quote does.
Spot checks in September 2026 found about one sentence in five doing that.
Those checks read 120 histories of dioceses, the areas look after, picked at random.
In those, about one sentence in sixteen was simply wrong, too. Each one was corrected.
Those numbers are a lot. So a second AI agent, not the one that wrote the page, now reads each sentence beside its quote.
It cuts whatever says more.
To be fair, an AI reading an AI isn't independent review. The read-through by someone from another tradition hasn't happened yet.
Every saint's life, every diocese history and the Catholic history of every country has now had that reading.
Each one shows a mark saying so: Checked line by line.
The and stories on the country pages haven't had it yet, and say so: Sourced, not yet line-checked.
The chapters and these FAQ answers carry no mark at all yet, so you can't see which have had the second reading.
And no script notices what's missing.
A page can quote every source correctly and still mislead by never raising the awkward question.
So who picks the questions? ACG does, the one person behind the site.
The questions, the direction and the argument are mine, he says.
There's no public list yet of hard questions the site hasn't answered.
If you think one is missing, that's the most useful thing you could tell the project: thetrailofchristianityproject@gmail.com.
Part 5 · An old rule for historians
The Trail holds itself to a rule much older than any website.
In August 1883 Leo XIII, then the leader of the Catholic Church, wrote about how Church history should be written.
He told writers to answer false stories by going back to the original sources.
And he gave them one rule to keep in mind. It comes from Cicero, a Roman writer from before Jesus's time.
In English it runs roughly like this.
The first law of history is not to dare to say anything false, and then not to dare to leave out anything true.
The point was that no one could suspect the writer of favour or hostility.
Leo wrote mainly to defend the popes against histories he thought unjust.
But his rule binds his own side too: you don't get to drop the true things that hurt your case.
Leo backed it up. He had already opened the Vatican's archives, its old records, to serious study, as far as possible.
The Vatican is the pope's base in Rome. In the same letter, he opened the Vatican Library's collections to the writers too.
Still, a rule on paper proves nothing.
The real test is one you can run yourself: open the sources, and look for what's missing.
Which kind of cherry-picking is harder to catch?
Pick an answer below.
Here are some questions people often ask next.
Swipe through the questions people often ask next, and open any of them.The questions people often ask next. Open any of them.
You can stop here.
Sources 7
- The Trail, How we know (the method page), chapters I, III and IV · Claim files and the 'Check it yourself' lists; saved pages and the quote-matching scripts; the eight quotes from memory; one sentence in five, and the second reading; what scripts can't see; no claim at draft; chapter IV follows one claim from source to page.
- The Trail, chapter: The Catholic Reformation and Trent, 'Check it yourself' audit notes (the same notes appear in 'What was wrong in the medieval Church' and 'Mary's Assumption') · How each of the eight quotations flagged on 23 September 2026 was settled: re-fetched and found word for word (23 September and 8 October), or, for the Council of Florence passage, replaced with another translation that was checked.
- The Trail, front page: "How this map was made", note 6, "The histories" · Two labels, checked line by line and sourced, not yet line-checked; in 120 diocese histories read at random, about one sentence in five said more than its source and about one in sixteen was plainly wrong, each corrected; 3,163 histories read line by line in full (October 2026). Each history shows its mark.
- The Trail, a saint's life: Thomas Aquinas · Each saint's page shows its mark under "The evidence": here "checked line by line".
- The Trail, a country page: Singapore · The Catholic history is marked "Checked line by line"; the Orthodox and the Protestant stories are marked "Sourced, not yet line-checked".
- ACG, About The Trail ("What people ask me": "Do you use AI to build this?") · AI helps find sources, draft pages and write code; the questions, the direction and the argument are his.
- Pope Leo XIII, Saepenumero considerantes, letter on historical studies (18 August 1883), Latin original; English renderings here are a paraphrase · "Primam esse historiae legem ne quid falsi dicere audeat: deinde ne quid veri non audeat"; the archive and library put at research's service.