Home
Recaps
Month
Crawling & Indexing

Crawling & Indexing recap: November 2026

The stories about Crawling & Indexing from this period, ranked by likely impact on a single site.

1 Stories archived

0 High impact

0 Update-flagged

0 Technical areas

Biggest stories

Ranked by estimated impact on a single site, not by publication time.

Medium Search Engine Journal 1 Nov

Google, Microsoft & OpenAI Plan To Honor Shared AI Training Opt-Out

A shared robots.txt line could let sites opt out of AI training with several providers at once, but companies involved are handling it differently.

Crawling & Indexing

All recaps

By month

November 2026 12 October 2026 686 September 2026 135 August 2026 321 July 2026 111 June 2026 56 May 2026 48 April 2026 22 March 2026 16 February 2026 12

This period, by technical area

All areas Ranking & Algorithms SERP Features Paid Search Crawling & Indexing Content & Quality Site Architecture Structured Data Speed & Core Web Vitals Links Local SEO E-commerce Measurement Policy & Penalties AI Search & Visibility International

By week

Week of 26 Oct 2026 412 Week of 19 Oct 2026 141 Week of 12 Oct 2026 91 Week of 5 Oct 2026 38 Week of 28 Sep 2026 43 Week of 21 Sep 2026 38 Week of 14 Sep 2026 32 Week of 7 Sep 2026 22 Week of 31 Aug 2026 22 Week of 24 Aug 2026 148 Week of 17 Aug 2026 66 Week of 10 Aug 2026 43

About these recaps

Assembled from our own archive of 1,488 stories, which currently runs from 19 October 2022. Ranking is by the impact score described on the front page — an estimate of how much a story is likely to affect one website, not a measure of how much attention it got.

The archive only holds what it has seen. Periods before it started are empty rather than quiet, and it gets more complete every week it runs.