AI Crawlers That Skip JavaScript, Gemini 4 Carbon, and Open Model Weights
AI crawlers do not run JavaScript, Gemini 4 Carbon and open model weights, get found before you optimize, and one task: check that your page text loads without JavaScript.
This week in one line
The OpenAI and Anthropic crawlers do not run JavaScript. Text that loads with JavaScript can be invisible to them.
Short notes from the week of October 27. Each note ends with what it means for your leads.
Research: AI crawlers do not run JavaScript
Vercel measured crawler traffic across its network. The OpenAI and Anthropic crawlers fetch fewer pages than Googlebot, and they do not run JavaScript. They read only the HTML that the server sends.
- Googlebot
- 4.5 billion
- GPTBot (OpenAI)
- 569 million
- Claude (Anthropic)
- 370 million
Why it matters: If your prices, services or hours load with JavaScript, AI tools may never see them. Put your key facts in the HTML.
New models: Gemini 4 Carbon and open weights
- Google: Gemini 4 Carbon (October 28). Only a small group can use it now.
- Mistral: the weights of Mistral Large 4 are open (October 29). Any company can now download and run it.
- OpenAI: GPT-6 Rosalind (October 30), for approved life sciences organizations.
- Qwen: Alibaba showed Qwen 4 on October 29, but it is not out yet.
Why it matters: Open weights put strong models inside more products. More software now reads websites and writes answers.
Subscribe to A/GEO Research
Get one short email each week: new AI models, new studies on AI search, and one task for your website. Each note says what it means for your leads.
Research: get found first, then improve the content
A review of 45 studies on generative engine optimization (GEO) found clear gains after AI tools found a page. The evidence for gains in getting found at all is weaker.
Why it matters: First make sure that AI tools can find and read your pages. Then improve the words.
Field notes: two playbooks, a site chat and a new tool
- October 29: the AI Visibility Engineering Playbook, 89 pages with 16 workstreams.
- October 30: the Local AI Presence Playbook, a 30-minute guide for business owners.
- November 1: our site chat, Ask A/GEO. It answers from our public pages only, runs on Claude Haiku 5.5 and has a spend cap of $5 a day.
- November 2: AI Query Fan-out, a free tool that shows the searches that your page does not answer, and How We Built This Site Without a CMS.
This week's task: check that your text loads without JavaScript
- Open your home page in a browser.
- View the page source (right-click, then View Page Source).
- Search the source for your services, prices, service area and hours. If they are not there, AI crawlers may not see them.
Want a faster check? The free AI Visibility Score reads your page the way AI crawlers do. It runs 37 checks in about 20 seconds.
Sources
- Vercel, The rise of the AI crawler, December 17, 2024
- Olivier Martinez, Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026), July 15, 2026
- A/GEO Research, LLM Watch, refreshed November 2, 2026