For SEO research and AI projects

Minifetch.com

Fetch & extract data from web pages

We ❤️ robots.txt

About
🔍
For SEO Research

Extract rich data & metadata from web pages. Perfect for competitive analysis and content audits.

Explore the API →
🤖
For AI Agents & RAG

Makes web pages simple to access. Ship Agents faster with competitive pay-as-you-go micropayments. Your Agents pay autonomously— no juggling API keys or accounts.

Join API client waitlist →
📊
For LLM Datasets

Build training datasets at scale with our API client. Ethical scraping that respects robots.txt and site policies so you can sleep better at night.

Join API client waitlist →

Why x402 for Micropayments?

This service uses the x402 protocol for micropayments with USDC on Coinbase's Base network or Solana. It's free to check if a URL is fetch-able or blocked using the "Check URL" button (or API endpoint). In the browser, you'll be prompted to pay for each "Go Fetch!" with your browser plugin wallet on Coinbase's Base network or Solana. You can pay as you go, there is no Minifetch account setup or monthly fee.

We'll add more form-factors beyond the browser soon, including an API client and MCP for AI. Stay tuned!

Example Data:

Extract URL Metadata ($0.002 each)

Extract URL Links ($0.002 each)

Open-Source

3.6 Million+ downloads over 10 years.
Docs are here. Add to your project:

npm install url-metadata --save