A/GEOResearch
← All issues

AI Crawlers That Skip JavaScript, Gemini 4 Carbon, and Open Model Weights

AI crawlers do not run JavaScript, Gemini 4 Carbon and open model weights, get found before you optimize, and one task: check that your page text loads without JavaScript.

This week in one line

The OpenAI and Anthropic crawlers do not run JavaScript. Text that loads with JavaScript can be invisible to them.

Short notes from the week of October 27. Each note ends with what it means for your leads.

Research: AI crawlers do not run JavaScript

Vercel measured crawler traffic across its network. The OpenAI and Anthropic crawlers fetch fewer pages than Googlebot, and they do not run JavaScript. They read only the HTML that the server sends.

AI crawlers fetch far fewer pages than Googlebot, and they skip JavaScriptMonthly fetches across the Vercel network. Source: Vercel, The rise of the AI crawler, December 17, 2024.
Googlebot
4.5 billion
GPTBot (OpenAI)
569 million
Claude (Anthropic)
370 million

Why it matters: If your prices, services or hours load with JavaScript, AI tools may never see them. Put your key facts in the HTML.

New models: Gemini 4 Carbon and open weights

  • Google: Gemini 4 Carbon (October 28). Only a small group can use it now.
  • Mistral: the weights of Mistral Large 4 are open (October 29). Any company can now download and run it.
  • OpenAI: GPT-6 Rosalind (October 30), for approved life sciences organizations.
  • Qwen: Alibaba showed Qwen 4 on October 29, but it is not out yet.

Why it matters: Open weights put strong models inside more products. More software now reads websites and writes answers.

Subscribe to A/GEO Research

Get one short email each week: new AI models, new studies on AI search, and one task for your website. Each note says what it means for your leads.

One email a week. Unsubscribe with one click. See our privacy policy.

Research: get found first, then improve the content

A review of 45 studies on generative engine optimization (GEO) found clear gains after AI tools found a page. The evidence for gains in getting found at all is weaker.

Why it matters: First make sure that AI tools can find and read your pages. Then improve the words.

Field notes: two playbooks, a site chat and a new tool

This week's task: check that your text loads without JavaScript

  1. Open your home page in a browser.
  2. View the page source (right-click, then View Page Source).
  3. Search the source for your services, prices, service area and hours. If they are not there, AI crawlers may not see them.

Want a faster check? The free AI Visibility Score reads your page the way AI crawlers do. It runs 37 checks in about 20 seconds.

Check my home page

Sources

  • Vercel, The rise of the AI crawler, December 17, 2024
  • Olivier Martinez, Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026), July 15, 2026
  • A/GEO Research, LLM Watch, refreshed November 2, 2026

Get a free AI visibility check

We ask leading AI answer engines the questions your customers ask. Then we send you a short report.

We use your details only to send your report and reply to you. See our privacy policy.