Google Scraper Overview

Structured JSON APIs for 16 Google product APIs — Search, Maps, News, Hotels, Trends, Jobs, Shopping, Patents, Scholar, Images, Videos, Finance, AI Mode, Lens, and Products.

Google Scraper API

Programmatic access to 16 Google product APIs with structured JSON responses. The ScrapeBadger Google Scraper handles SearchGuard, proxy rotation, cookie warmup, and IP rotation on 429 automatically — you just call the endpoint.

Products

Search (SERP)

Organic results, ads, knowledge graph, People Also Ask, related searches, AI overview, and pagination.

Maps

Place search, business details, reviews, photos, and posts from Google Maps.

News

Article search, topic feeds, and trending stories from Google News.

Hotels

Property search and detailed listings with prices, ratings, and amenities.

Trends

Interest over time, regional breakdowns, related queries, and real-time trending.

Jobs

Job listings aggregated across the web with filters for type, date, and location.

Shopping

Product listings with prices, ratings, filters — plus per-product merchant URL enrichment.

Patents

Patent document search and full-detail retrieval by patent number.

Scholar

Academic paper search with year-range and citation filters.

Autocomplete

Google search suggestion lookup for query prefixes.

Images

Image search with size, color, and type filters.

Videos

Video search across Google’s video index.

Finance

Stock, index, crypto, and currency quotes with change data.

AI Mode

Google’s generative AI answers (udm=50) as structured text blocks (prose, headings, comparison tables, lists), source references, a compact Markdown rendering, and the raw answer HTML.

Lens

Visual image search — find similar products and images from a URL.

Anti-Bot Handling

Google deployed SearchGuard in January 2025 — a JS challenge that blocks raw HTTP. The ScrapeBadger Google Scraper bypasses it with a cookie-warmup pattern:

1. First request attempts curl_cffi with cached cookies (~0.2s fast path)
2. If a SearchGuard challenge is detected, a patchright browser warmup solves it
3. Subsequent requests reuse the warm cookies via curl_cffi for speed
4. On 429 or CAPTCHA, the cached residential proxy session is invalidated to rotate the exit IP, then the retry loop continues (up to 3 IP rotations per request)

185 Google Domains

The SERP endpoint accepts any of Google’s 185 country domains via the domain parameter:

curl "https://scrapebadger.com/v1/google/search?q=laptop&domain=google.co.uk&gl=gb&hl=en" \
  -H "x-api-key: YOUR_API_KEY"

Quick Start

Node.js

import { ScrapeBadger } from "scrapebadger";

const client = new ScrapeBadger({ apiKey: "YOUR_API_KEY" });

// Web search
const serp = await client.google.search.search({ q: "python 3.13" });
for (const r of serp.organic_results) {
  console.log(r.title, r.link);
}

// Shopping search + per-product merchant URL enrichment
const products = await client.google.shopping.search({ q: "laptop" });
const first = products.results[0];
const enriched = await client.google.shopping.click({
  title: first.title,
  source: first.source,
});
console.log("Merchant URL:", enriched.merchant_url);

from scrapebadger import ScrapeBadger

async with ScrapeBadger(api_key="YOUR_API_KEY") as client:
    # Web search
    serp = await client.google.search.search("python 3.13")
    for r in serp["organic_results"]:
        print(r["title"], r["link"])

    # Maps search
    places = await client.google.maps.search("coffee shops in san francisco")

    # Shopping search + click enrichment
    products = await client.google.shopping.search("laptop")
    first = products["results"][0]
    enriched = await client.google.shopping.click(
        title=first["title"],
        source=first["source"],
    )
    print("Merchant URL:", enriched["merchant_url"])

# Web search
curl "https://scrapebadger.com/v1/google/search?q=python+3.13&gl=us&hl=en" \
  -H "x-api-key: YOUR_API_KEY"

# Shopping search
curl "https://scrapebadger.com/v1/google/shopping/search?q=laptop" \
  -H "x-api-key: YOUR_API_KEY"

# Per-product merchant URL enrichment
curl "https://scrapebadger.com/v1/google/shopping/product/click?title=Lenovo+IdeaPad+5&source=Walmart" \
  -H "x-api-key: YOUR_API_KEY"

Endpoint Index

Search

Endpoint	Description
GET /v1/google/search	Web search with 21 parameters
GET /v1/google/images/search	Image search with size/color filters
GET /v1/google/videos/search	Video search
GET /v1/google/autocomplete	Query suggestions
GET /v1/google/ai-mode/search	AI-generated answers
GET /v1/google/lens/search	Visual image search

Maps

Endpoint	Description
GET /v1/google/maps/search	Search places by query
GET /v1/google/maps/place	Place details by place_id / data_id
GET /v1/google/maps/reviews	Paginated reviews for a place
GET /v1/google/maps/photos	Place photos
GET /v1/google/maps/posts	Business posts

Shopping

Endpoint	Description
GET /v1/google/shopping/search	Product search with filters + ads
GET /v1/google/shopping/product	Product detail with seller list
GET /v1/google/shopping/product/click	Resolve merchant URL per product (lightweight curl_cffi lookup)

News & Content

Endpoint	Description
GET /v1/google/news/search	News article search
GET /v1/google/news/topics	News by predefined topic
GET /v1/google/news/trending	Trending stories
GET /v1/google/scholar/search	Academic paper search
GET /v1/google/patents/search	Patent document search
GET /v1/google/patents/detail	Full patent detail

Other

Endpoint	Description
GET /v1/google/hotels/search	Hotel search w/ dates (modes: ds0 default richest, rpc, fast, render fallback)
GET /v1/google/hotels/details	Detailed property info
GET /v1/google/trends/search	Unified Trends — data_type picks TIMESERIES, GEO_MAP, GEO_MAP_0, RELATED_TOPICS, or RELATED_QUERIES
GET /v1/google/trends/trending-now	Current trending searches (search_volume + deltas)
GET /v1/google/trends/autocomplete	Knowledge Graph topic autocomplete
GET /v1/google/jobs/search	Job listings search
GET /v1/google/finance/quote	Stock / index / crypto quote
GET /v1/google/products/detail	Immersive product detail

Credit Costs

Per-endpoint credit pricing is configured by ScrapeBadger admins and returned live from GET https://api.scrapebadger.com/public/pricing (uncached, updates immediately). The public pricing page and each product landing page at scrapebadger.com show the authoritative current rate. See Credits & Pricing for plan-level rates.

Query GET /public/pricing in your integration to cache the current per-endpoint cost — don’t hardcode credit numbers, they can be adjusted.

Legal & Compliance

SearchGuard litigation is active. Google sued SerpAPI in December 2025 under the DMCA for circumventing the SearchGuard JavaScript challenge it deployed in January 2025. Reddit also sued SerpAPI, Perplexity, and several other scraping providers in October 2025 over crawling its content. Both cases are still being litigated as of 2026 and the legal landscape around SERP scraping is evolving quickly.

Before deploying ScrapeBadger Google endpoints in production, you are responsible for:

• Reviewing Google’s Terms of Service and any applicable local laws (DMCA, CFAA in the US; copyright directives in the EU)
• Ensuring your use case has a legitimate business purpose (research, SEO monitoring, price comparison, accessibility tooling, etc.) and isn’t redistributing Google content in a way that competes with Google itself
• Following robots.txt spirit where applicable and rate-limiting your requests to avoid disrupting Google’s services
• Consulting your own legal counsel — ScrapeBadger does not provide legal advice and cannot warrant the lawfulness of your specific use case

ScrapeBadger reserves the right to suspend access to the Google Scraper endpoints at any time in response to changes in the legal landscape or platform terms.

Reference cases

• Google LLC v. SerpAPI (Dec 2025) — DMCA §1201 claim alleging circumvention of SearchGuard
• Reddit v. Perplexity, SerpAPI et al. (Oct 2025) — breach of access terms and unauthorized data ingestion

ScrapeBadger continues to operate under the position that scraping publicly accessible search results for legitimate business research is permitted, but this position may need to evolve as litigation progresses.