Minifetch is a pay-per-URL SEO toolkit of composable extraction primitives for AI agents and automation pipelines. Run them as a full audit or call one at a time for a fraction of the price — and a fraction of the tokens. No subscription. This documentation covers the the main endpoints available for developers. It also covers details about accessing the Minifetch API as well as example data. All API endpoints return responses in JSON format.
The Minifetch API Client has a Quick Start for Javascript or TypeScript if you're looking to add it to your project quickly.
Full API docs are also available for AI agents at llms.txt →
Minifetch is pay-per-fetch. No setup fee, no monthly fee, no charges for blocked or errored pages. Price per fetch are listed on each API endpoint below. First, pick your payment method:
Sign up on the dashboard to get free starter credits worth 25 audits, then top up with your credit card later for as little as $2.
Pay directly from your crypto wallet. Just load your wallet with USDC on Base or Solana and you're ready. No "gas token" (ETH or SOL) required. No Minifetch account setup required.
Then click whichever access method fits your setup:
Visit the Minifetch homepage or hit any API endpoint URL directly using your browser's address bar. The default on the homepage is the full technical SEO audit. Great for trying out the service. If you want full API access, try the other options below.
Sign up, create an API key from the dashboard, and query endpoints from your CLI:
curl "https://minifetch.com/api/v1/run/seo-page-audit?url=https://anthropic.com" \
-H "Authorization: Bearer [your_api_key]"The minifetch-api client is an NPM package purpose-built for Javascript or TypeScript. The simplest way to integrate Minifetch into a Node.js app. Works with both API keys and USDC stablecoin. Recommended for agents and agent builders.
For agents that need to pay at runtime without human sign-up. If you're building an agent yourself, the Minifetch API client above is usually the better starting point.
Coinbase Payments MCP gives AI assistants like Claude Desktop a built-in wallet to discover and pay for x402 services with no code. One command, email sign-in, no private key.
npx @coinbase/payments-mcpThe installer configures your MCP client (Claude Desktop, Claude Code, Gemini CLI, etc). Then ask your assistant to use the Coinbase Payments MCP to discover Minifetch endpoints on the x402 Bazaar.
Agentic Wallets
(awal) is Coinbase's wallet infrastructure for autonomous agents: non-custodial, keys isolated,
with programmable spending limits and gasless USDC trades on Base.
Recommended for programmatic and agent-to-agent usage.
npx awal
Once funded, your agent can call Minifetch with any x402-compatible client
(e.g. @x402/fetch) or skip the client entirely by adding awal's
pay-for-service skill.
npx skills add coinbase/agentic-wallet-skillsThe Minifetch API client will handle this for you. All API requests will be made to:
https://minifetch.com
Free
Call this endpoint before the paid endpoints.
Free endpoint that checks if a URL is allowed to be fetched by Minifetch according to the website's robots.txt file. Returns whether the URL is fetchable and the crawl delay Minifetch will observe (defaults to 1 second so Minifetch never hammers your server or slows it down for your real users). Call this before making requests to the paid endpoints. If the target URL is blocked and the site is yours or to set a custom crawl delay, read the tutorial: How To Allow Minifetch to Fetch Your Pages.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL to check against robots.txt |
GET https://minifetch.com/api/v1/free/preflight/url-check?url=https://example.com{
"success": true,
"results": [
{
"data": {
"url": "https://example.com",
"allowed": true,
"message": "robots.txt not found, defaulting to allowed",
"crawlDelay": 1
}
}
]
}$0.01
Technical SEO Audits, SEO Research, Pre-publish Page Checks, Competitive Analysis, Agent-Orchestrated Site Monitoring
Runs a full technical SEO audit on your URL. It combines data from the other API endpoints and runs checks that each return a PASS/ WARN/ FAIL result with no black-box scoring — just deterministic, composable signal you can act on or pipe into an agent. Audit rules are documented in the audit results UI and in the audit skill file.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL to run the audit on |
GET https://minifetch.com/api/v1/run/seo-page-audit?url=https://example.com$0.002
SEO Research & Competitive Analysis, Content Indexing & Link Analysis, AI Agents & Automation Pipelines
Fetches and extracts rich structured metadata from your URL: title, description, meta tags, open graph tags, twitter tags, hreflang, json-ld, citations, images, headings, response headers, and more. Every field maps directly to a ranking signal or competitive intelligence data point.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract metadata |
| verbosity | string | No | Defaults to "standard". Set to "full" for larger response. |
| includeResponseBody | boolean | No | If set to true, includes the full HTML response body as string in result. |
GET https://minifetch.com/api/v1/extract/url-metadata?url=https://example.com&includeResponseBody=true$0.002
SEO Research & Competitive Analysis, Content Indexing & Link Analysis, Sitemap Building & Crawl Planning
Fetches and extracts all links from your URL categorized by type (internal/external/anchor).
Each link includes anchor text, rel attributes (nofollow, sponsored, ugc, etc.),
title, and target, plus image detection.
Summary stats include the most-linked-to internal pages (with anchor text variants used for each)
and top external domains by link count.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract links |
GET https://minifetch.com/api/v1/extract/url-links?url=https://anthropic.com$0.001
AI Agents & Automation Pipelines, Content Indexing & Link Analysis
For checking how your page unfurls when shared: Extracts the title, meta description, and preview image (only) - the lightweight card social platforms and chat apps render for a link.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract the preview |
GET https://minifetch.com/api/v1/extract/url-preview?url=https://github.com$0.002
AI Agents & Automation Pipelines, Content Indexing & Link Analysis
For site owners auditing AI readability: returns the clean markdown an LLM extracts from your page after nav, ads, and scripts are stripped. See what survives for AEO and AI answer engines.
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | Yes | The target URL from which to extract content |
| includeMediaUrls | boolean | No | If set to "true", includes image and video URLs in the result |
GET https://minifetch.com/api/v1/extract/url-content?url=https://apnews.com/article/time-person-of-year-2025-77ec65c6792bc99ec2ce1919c5f421ea&includeMediaUrls=trueMinifetch.com is the hosted version of a free and open-source npm package called url-metadata that has been serving the NPM community for 10+ years. During that time some users expressed a preference for a hosted service for various reasons, mostly technical hurdles with coding or accidentally triggering blocks from websites when using the open-source package.
For direct integration with your codebase, consider:
minifetch-apiNEW — the official Minifetch API client for Javascript/ Typescript
npm install minifetch-api --save
url-metadata — the open-source npm package (10+ years, 4M+ downloads) that powers Minifetch
npm install url-metadata --save
Both from the same creator with 4 Million+ downloads over 10 years.
Add them to your project with confidence.
Task-specific step-by-step guides for AI agents using the Minifetch API:
Minifetch implements several measures to ensure responsible and efficient operation:
These measures help us maintain an ethical scraping approach while providing reliable service.
Minifetch only extracts publicly available metadata and content from pages accessible without authentication and Javascript execution.
What Minifetch does NOT do:
What Minifetch does NOT do currently but may offer in the future as an add-on:
If you have questions or need assistance:
join our Discord server.
To leave feedback or join the bulk credits waitlist:
use our feedback form.
While you're at it, give us a follow on X.com (Twitter):
@minifetch