What The Dark Archive found
How machine-readable are creator websites?
Short answer
Barely. In our study of long-form YouTube creators, we scored 528 creator-owned websites on our machine readability score out of 100. The median score was 20, and none scored above 70. The score rewards a written archive: a site that is mostly a homepage gives a machine little text to work with. Articles built from your videos, linked to them, on your own domain, are what raise it.
What did we measure across creator websites?
When a long-form video creator sets up a website, the site usually exists to serve human visitors. It offers a place to sell merchandise, book speaking appearances, link to social profiles, or invite people to join a mailing list. But as search shifts toward answer engines that read and summarize web pages directly, a website plays a second role. It is where the knowledge in a creator’s videos can live as text on a site the creator owns.
In The Dark Archive, our study of long-form YouTube channels, we wanted to see how well creator websites perform that second role. We evaluated the 528 creator-owned websites we could reach on the open web. We scored each site using our machine readability score, a measurement graded out of 100.
The results showed a wide gap between owning a website and having a site that machines can actually read. Across all 528 sites, the median score was 20, and exactly 0 scored above 70. Even channels that maintain an active written archive did not score above 70.
To understand why these scores are so low, it helps to examine what the score measures.
What do the five parts of the score ask of a site?
The machine readability score is built from five distinct components defined in our glossary. Together, they ask whether a machine can tell what a page is, read its text, reach it, see which video it came from, and expect more pages like it.
The five parts reflect what any creator can reasonably ask of their web presence if they want their ideas cited by machines:
- Structured data. This asks for machine-readable markup, such as JSON-LD, that identifies what the page is and connects the written article to the specific video it discusses. As our note on what schema does for AI citations shows, the evidence does not show markup alone lifting citations. It labels the writing; it does not replace it.
- Extractable text. The words and arguments must live directly in the page HTML as readable text. If a creator embeds a video player, puts key takeaways into an image graphic, or relies heavily on client-side scripts that render blank pages to simple crawlers, an automated engine finds very little to read.
- Crawler access. The domain’s robots.txt configuration must permit AI crawlers to inspect its pages. As we showed in our analysis of what blocking AI crawlers costs, access is rarely the gap in practice. Most creator sites already leave their doors wide open to AI bots, even when there is little for those bots to read.
- Attribution. Each written post should explicitly name and link the specific video from which it was adapted. It tells a reader, or a machine, where the text came from, and gives readers a path back to the video.
- Systematic publishing. The written archive must keep pace with the channel’s video releases rather than ending after a brief burst of enthusiasm when the site was first designed.
Why are creator website scores so low?
At least half the sites scored 20 or less, and none scored above 70. Why are the scores so low?
The primary reason is that the score rewards an archive, not a homepage. A domain that works as a landing page or a digital business card has little on it to read. On the Dark to Sovereign ladder, a channel whose own domain has no content index (no blog, no episode pages, no feed) is Beacon. Its site may serve visitors well, but it gives a machine little text to extract.
A site with a blog or episode pages can still sit on the Dormant rung, when its posts have stopped or are not drawn from the videos. The first loses points on systematic publishing and the second on attribution.
Even the rare Sovereign channels, which publish most of their videos as articles, did not score above 70. Which parts held them back is in the report.
An llms.txt file is not one of the five parts. As our note on llms.txt as hygiene shows, such a file is no substitute for written pages either.
What can creators do to make their sites readable?
A low machine readability score does not mean a creator has built a bad website. If a site exists to sell merchandise or take consulting inquiries, it may perform that role well.
For creators who produce research-heavy videos, investigative documentaries, or educational explainers, machine readability matters. When the work exists only in video, an engine that cites only text has nothing of yours to quote.
Creators who want their knowledge to be read and cited by machines can take four straightforward steps:
First, focus on extractable text before any technical optimization. Turn your video scripts, research notes, and explanations into written articles hosted on an owned domain. Make sure the text appears in plain HTML rather than inside complex scripts, image cards, or closed players.
Second, connect every written piece to its source video. State clearly at the top of the post which video the article was drawn from, and provide a direct link to that video. That tells readers, and machines, where the text came from.
Third, maintain an ongoing publishing routine. You do not need to convert your entire back catalogue overnight. Instead, establish a cadence where each new major video upload is paired with a corresponding written article on your site.
Fourth, attend to the basic technical hygiene of your domain. Ensure your robots.txt file does not inadvertently block search crawlers, and add straightforward structured markup that declares the page as an article linked to a video asset. Structured data will not create citations on its own, but it labels what the page is once the written content exists.
Archive Starter does the first two steps for you and adds the markup from the fourth: your most-viewed videos become full articles in plain HTML, each linked to its video and marked up as an article about it, with a hub page that ties them together and an llms.txt map included, ready to publish on your own domain.
A higher score is not a promise of search traffic or income. It means your knowledge exists in a form machines can read and quote.
How does your own site score?
The free Dark Matter Check scores your site on the same machine readability scale and places your channel on the Dark to Sovereign ladder, by email, with no card needed.
Report Pro goes further: your score broken down component by component, a check of whether Google’s Gemini and Anthropic’s Claude cite your channel, and a prioritised fix list, so you know exactly which part to fix first.
The full score distribution, the score by tier and the result for each part are in The Dark Archive report.
Run the free Dark Matter Check and see how machine-readable your own channel’s website is.