Google's AI crawler, Google-Extended, the crawler it uses for Gemini and other related AI services, does render itself and can render JavaScript, just like Googlebot, Google's main web search crawler.

There’s an accelerating cat-and-mouse game between web publishers and AI crawlers, and we all stand to lose. We often take the internet for granted. It’s an ocean of information at our fingertips—and ...