The quick version:
OpenAI updated OAI-SearchBot, the crawler it uses to power ChatGPT search.
The change makes it easier to identify and control how ChatGPT accesses your content.
It is part of a wider move toward declared, identifiable AI crawlers.
The update
OpenAI refreshed OAI-SearchBot, the spider behind ChatGPT’s search features. The practical effect is that site owners get a clearer, named crawler to recognize, allow, or block, rather than guessing which automated traffic belongs to which AI company.
Why it matters
As AI search grows, knowing who is crawling you and why becomes a real decision. Do you want your content feeding ChatGPT’s answers, or not? A declared, identifiable crawler lets you make that call deliberately through your robots rules instead of fighting anonymous traffic.
For anyone doing data collection, it also sets the standard: declare yourself honestly, or look like you are hiding.
The takeaway
Review your robots file and decide, on purpose, which AI crawlers you welcome. The era of one undifferentiated wave of bots is ending, replaced by named agents you can manage.
Practitioners on Reddit are sharing their robots setups for the major AI crawlers right now, which is a good place to benchmark your own.
Quick Links: