Google AI Overview Scraper

Features

• AI Overview Extraction: Scrapes the AI-generated answer boxes that appear at the top of Google Search results
• Source Citations: Captures all source links and page titles cited within the AI overview
• Related Questions: Extracts follow-up and related questions associated with each AI overview
• Batch Query Processing: Accepts a list of queries to process multiple searches in one run
• Localization Support: Configurable country (gl) and language (hl) parameters for region-specific results
• Proxy Support: Built-in Apify Proxy support with residential proxies for reliable access

Input Parameters

Parameter	Type	Required	Default	Description
queries	Array	Yes	["What is quantum computing"]	List of search queries to scrape AI Overviews for
maxItems	Integer	No	10	Maximum number of results to return (1–1000)
gl	String	No	"us"	Google country parameter (e.g., us, uk, in)
hl	String	No	"en"	Google language parameter (e.g., en, es, fr)
proxyConfiguration	Object	No	Apify Residential	Proxy settings for the scraper

Input Schema Example

{
  "queries": [
    "What is machine learning?",
    "How does blockchain work?",
    "What is climate change?"
  ],
  "maxItems": 10,
  "gl": "us",
  "hl": "en",
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Output Schema

The scraper outputs structured JSON data for each query that triggered an AI Overview on Google Search.

Main Fields

Field	Type	Description
query	String	The search query submitted
aiOverviewText	String	Full text of the AI Overview answer
sources	Array	Cited source pages with title and URL
relatedQuestions	Array	Related questions shown alongside the AI Overview

AI Overview Result Example

{
  "query": "What is machine learning?",
  "aiOverviewText": "Machine learning is a subset of artificial intelligence that enables systems to learn and improve from experience without being explicitly programmed. It focuses on developing computer programs that can access data and use it to learn for themselves...",
  "sources": [
    { "title": "Machine Learning - Google Developers", "url": "https://developers.google.com/machine-learning/crash-course/ml-intro" },
    { "title": "What is Machine Learning? - IBM", "url": "https://www.ibm.com/topics/machine-learning" }
  ],
  "relatedQuestions": [
    "What are the types of machine learning?",
    "How is machine learning used in everyday life?",
    "What is the difference between AI and machine learning?"
  ]
}