According to DEV Community, the author of the Nakodo site measured how much text repeats across its pages. Of 76 public pages, 63 are generated from a content registry and rendered by one component. This is often called programmatic SEO, where many pages are built from data. The usual worry is duplication, and the author had never checked.
The method was to fetch every page in the sitemap, strip out code and the page head, then split the text into overlapping eight-word sequences. Two pages sharing a sequence are saying the same thing in the same order. The corpus came to 126,382 words, with a median of 1,706 words a page.
The results split into two groups. 95.4% of the phrasing appears on exactly one page. The rest is site furniture, meaning repeated elements such as the header, footer and navigation. Exactly 141 words on every page are covered by text found on all 76 pages. A further 44-word call to action appears on 72 pages. That is 185 words of furniture on a page with a 1,706-word median.
The bigger finding was six index pages, each of which lists child pages using the same title and description text the child pages carry. Once the furniture was removed, each of these had more than half of its text found elsewhere. The author puts /youtubers at 583 words, with roughly 440 belonging to other pages. The home and pricing pages also overlap heavily by design, since the author wants prices visible in both places.
The author plans to give index pages their own prose and keep the call to action. They also plan to add a build test that fails when a new page is more than half other pages' words.
Why it matters
Duplicate content worries often focus on templates, headers and footers. This audit suggests those are cheap, and that the real risk lies in pages that mostly repeat their children. Pages like category lists, hubs and tag indexes are common on shops, blogs and directories, and they can end up thin without anyone noticing.
The article also shows that some overlap is a choice. Showing prices on both the home page and a pricing page repeats text, but serves visitors. A measurement helps you tell which repetition is deliberate and which is accidental.
Source: DEV Community. This brief summarises their reporting; read the original for the full detail.