• mriswith@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    24 hours ago

    Exactly. They “crawl” category/tag lists, etc. and follow links. And if there are no links to those pages, they wont be indexed.

    (Depending on some settings. For all I know they’ve set up “hidden redirects” for popular crawlers to pages that show them)