AI Agent Page-Type Statistics: Login, Pricing, Documentation and 17 Other Page Types across 40.8 Million Domains, with URL-Rule Results

For each domain the database records which kinds of page it has, such as login, pricing, documentation, careers, legal, help-centre and status pages, together with their verified URLs. These are the pages AI agents act on when they browse the web: they read documentation and pricing pages but can also reach login, signup, upload and checkout pages, so page types are the basis for page-level egress control that allows reads and denies writes for autonomous agents. 16,448,576 domains (40.3%) have at least one verified page type, with 3.61 page types per domain on average; the most common type is contact (70.4% of domains with page types) and 3.26 million domains have a verified login page.

The release gives the prevalence of 20 page types, the distribution of page types per domain, page-type prevalence for all 40 site languages and the 60 largest top-level domains, co-occurrence of every pair of page types with conditional shares and lift, and the URL structure of each page type (HTTPS, subdomains, query strings, path depth). It also reports a 40-rule URL layer for agent egress control run on all 58.8 million verified URLs: rules match 0.24% of read-page URLs (false positives) and 45.1% of login URLs, with the first matching rule per page type.