URL in. Clean data out.
Markdown, screenshots, metadata, Lighthouse audits and more from any URL — over HTTP or straight from your AI agent. Real Chrome renders every page, so JavaScript-heavy sites work.
- 1,000 free credits every month
- Cached results cost nothing
- Processed in the EU
- Works from your AI agent over MCP
200 OK
Request
curl -X POST https://urlpipe.dev/markdown \
-H "Authorization: Bearer $URLPIPE_KEY" \
-H "Content-Type: application/json" \
-d '{"url": "https://anthropic.com", "sync": true}'Response
# Anthropic
We're an AI safety company. We build
reliable, interpretable, and steerable
AI systems.
## Claude
Claude is our flagship AI assistant…Your MCP client
{
"mcpServers": {
"urlpipe": {
"type": "http",
"url": "https://urlpipe.dev/mcp",
"headers": {
"Authorization": "Bearer $URLPIPE_TOKEN"
}
}
}
}Then ask
> Read https://anthropic.com and tell me
what they announced most recently.
⏺ urlpipe · fetch_markdown
https://anthropic.com
The page is rendered in real Chrome, so the
agent reads what a visitor sees.Endpoints
Eleven kinds of data from any URL. One bearer token.
URLpipe is a web data API for the URL you already have: its Markdown, a screenshot, a PDF, its metadata, an AI summary, keywords, data in your own fields, a Lighthouse audit, the rendered HTML, its JavaScript console or the technologies it is built with — each from one POST, or several at once from a single page visit.
Some sites show a data center visitor less than they show a person. Add residential: true to any request and we fetch the page from a home broadband connection instead. How that works.
- /markdownNo model
The page's main content as clean Markdown, converted straight from the rendered page — no model, so the same page gives the same Markdown every time.
- /screenshotNo model
The whole page as PNG, JPEG or WebP. Any viewport, retina, one element, dark mode — and a link you can drop into an <img>.
- /pdfNo model
The whole page as a PDF with selectable text and working links, on the paper you choose or as one long page — and a link you can send.
- /metaNo model
Title, description, share image, icons, authors, dates and feeds — the same keys for every page, reconciled from Open Graph, Twitter cards, JSON-LD and the page itself.
- /htmlNo model
The rendered HTML, after JavaScript has run and redirects have been followed — not the empty shell curl returns.
- /lighthouseNo model
A real Google Lighthouse audit, mobile or desktop: the four category scores and the Core Web Vitals lab metrics.
- /consoleNo model
The JavaScript errors, warnings and uncaught exceptions a page throws while it loads — on sites you don't control.
- /technologiesNo model
What the site is built with — its CMS or shop platform, frameworks, analytics, CDN and web server — with versions where the page shows them.
- /summarizeAI
A short, faithful summary of the page's main content, in Markdown.
- /keywordsAI
The 5–15 keywords and phrases that describe the page best, ranked, in the page's own language.
- /extractAI
Any data on the page in the fields you define — a price, an author, a list of products — as JSON, and null where the page has none.
/scrape
Several answers from one page visit — a screenshot, the metadata and the Markdown for a link preview, say. Each operation costs what it always does; the page, the slow part, loads once.
For AI agents
Give your agent a browser.
Most agents fetch a page with a plain HTTP request, so on a site built with JavaScript they read an empty shell and guess the rest. Connect URLpipe as an MCP server and the agent reads what a visitor sees — as Markdown, a screenshot or metadata — on its own.
- A remote server: nothing to install, one URL and a bearer token.
- The same tools, arguments and credits as the HTTP API.
- Tokens that can be read-only, limited to one project, or set to expire.
Tools your agent gets
- list_projects
- get_usage
- fetch_markdown
- fetch_html
- capture_screenshot
- capture_pdf
- capture_console_errors
- run_lighthouse_audit
- extract_metadata
- detect_technologies
- extract_keywords
- summarize_page
- extract_data
- scrape_url
- get_result
- list_requests
- get_request
Built for production
The details you'd otherwise build yourself.
Async by default
Every request returns a token at once. The result arrives at your webhook — retried, re-sendable, and signed once you switch signing on — or waits at GET /result/:token. Add sync: true for a one-off.
You never pay twice
Repeat requests inside your freshness window are free. A duplicate that arrives mid-flight shares the first one's work, and an Idempotency-Key turns a retry into the original answer.
The page a reader sees
Block ads, remove cookie banners and any element you name, or wait for content that loads late. What you remove is gone from every result, not just hidden.
Labels for every request
Tag requests with your own client or job ids. They come back with every result and webhook, and the dashboard breaks usage down by label.
robots.txt, followed
Every project follows the robots.txt of the sites it fetches, from the start. A project can turn that off — a choice, and a responsibility, that stays with you.
Processed in the EU
Pages are fetched, rendered and stored on our own servers in Europe. Switch on EU-only AI processing and nothing leaves it — on every plan, at no charge.
Your first request in five minutes.
- 01
Sign up
Free, no card. Confirm your email address and your key is live.
- 02
Create a project
Each project has its own API key and request history — one per app or environment. The key is shown once; copy it.
- 03
POST a URL
Any endpoint, one bearer token. You'll have your first result in about five minutes.
Pricing
Start free. Upgrade when it's working.
1,000 free credits a month, no card. Paid plans never stop at the limit — past it, usage is $1.50 per 1,000 credits.
Free
For trying it out and for side projects.
No credit card
- 1,000 credits / month
- 1,000 page fetches, or 58 /summarize — any mix
- 1 request at a time
- One user
- Requests pause when the credits run out
- Cache hits are free and never spend credits
Starter
For the first real workload you put in front of users.
- 20,000 credits / month
- 20,000 page fetches, or 1,176 /summarize — any mix
- 3 requests in parallel
- Your whole team, as many members as you need
- Never cut off: extra credits at $1.50 per 1,000, no cap
- Cache hits are free and never spend credits
Pro
RecommendedFor production apps pulling web data on a schedule.
- 55,000 credits / month
- 55,000 page fetches, or 3,235 /summarize — any mix
- 8 requests in parallel
- Your whole team, as many members as you need
- Never cut off: extra credits at $1.50 per 1,000, no cap
- Cache hits are free and never spend credits
Scale
For high-volume pipelines and agencies.
- 175,000 credits / month
- 175,000 page fetches, or 10,294 /summarize — any mix
- 20 requests in parallel
- Your whole team, as many members as you need
- Never cut off: extra credits at $1.50 per 1,000, no cap
- Cache hits are free and never spend credits
Picking a paid plan takes you through sign-up first, then straight to Stripe's checkout. Cancel any time.
Prices in US dollars, before VAT. EU customers see it added at checkout; a business with a VAT number in an EU country other than Spain pays none.
Need more than Scale?
Larger volumes run on a contract we size with you, invoiced rather than charged to a card. Tell us what you're planning and we'll work it out.
FAQ
Common questions
No. URLpipe calls your public URLs from our servers. No scripts, no DNS records, no server access required.
Yes. There are free, no-signup tools at /tools for every kind of data the API returns — paste a URL and see the result in your browser. It's the same API underneath: the example pages are free and don't count against your own runs, which are limited to a couple every ten minutes. When you're ready to build, the free plan's API key takes a minute.
Yes — URLpipe is also a remote MCP server. Point Claude, Cursor or any MCP client at https://urlpipe.dev/mcp with a bearer token and the agent can read pages as Markdown, take screenshots, pull metadata and run audits on its own, rendering JavaScript as it goes. There is nothing to install, and the tools cost the same credits as the HTTP endpoints.
Yes — official clients for Python (pip install urlpipe), JavaScript and TypeScript (npm install @urlpipe/sdk), Ruby (gem install urlpipe) and Go, with retries that never bill twice, typed errors and webhook verification. There are also packages for LangChain and LlamaIndex, an n8n node and a command-line tool (brew install urlpipe/tap/urlpipe). None of them is required: every endpoint is one POST with a bearer token, so curl or any HTTP library works just as well. The client libraries page in the docs has each one.
/summarize, /keywords, and /extract. The rest don't — /markdown converts the rendered page itself and /meta reads what the page declares, which is why each costs the same as a page fetch and gives the same answer every time. One credit allowance covers all of them, so you spend it on whatever mix your workload needs.
Yes. /markdown returns the page's main content as clean Markdown, with the navigation and boilerplate left behind — the format LLMs and RAG pipelines work best with. Pages are rendered in real Chrome first, so JavaScript-heavy sites produce complete content too, and page_options can remove cookie banners and ads before the conversion.
Yes — /scrape runs any mix of the operations off a single page visit: a screenshot, the metadata and the Markdown for a link preview, say. You pay for each operation as usual, and the page is only loaded once, which is the slow part.
In credits. Every successful, uncached call spends credits according to what it costs to run: /console, /html, /markdown, /meta, /pdf, /screenshot and /technologies cost 1 credit each; /lighthouse 2; /keywords 15; /summarize 17; /extract 24. Plans are a monthly credit allowance you spend on whatever mix you like, and there's a calculator on the pricing page. The one extra is a residential exit (25 credits per page visit), which is off unless you ask for it.
Usually, yes. Every request is a real Chrome, which is enough for most of what stops a plain HTTP fetch, and we work through bot checks and retry before you hear about them — a check we can't clear costs you nothing. When a site goes further and reads the address the request came from, add residential: true and we fetch the page from a home broadband line instead of a data center. It works on every endpoint, costs 25 credits per page visit on top of the operation, and is off by default.
Yes. Sign in once in a browser, save its state (Playwright's storageState — cookies and localStorage), and upload it as an auth profile. Name the profile on any request and the page is loaded signed in: no login to script, no password to hand over, and nothing extra to pay. What the site renews during each visit is kept, so the session lives as long as you use it. The state is encrypted, never returned by the API, and used only on the domains you choose.
You hear about it first: we email your organization admins when the month's usage reaches 80% of the allowance. On a paid plan, nothing stops: calls keep being served, uncapped, and every credit past the allowance costs $1.50 per 1,000 credits, billed on an invoice of its own once the month closes. On the Free plan, which has no card to bill the extra to, the endpoint returns HTTP 429 with a JSON body giving your limit, what you've used, how many credits the refused request needed, and when the allowance resets (the 1st of next month, UTC). Every response carries X-Quota-Cost, X-Quota-Remaining and X-Quota-Overage, and the dashboard itemises the month by operation.
No. When you request the same URL and operation again within your freshness window, we serve the cached result — instantly, and without spending a credit. A repeat that arrives while the first request is still running waits for it, free as well. You control the window with the max_age parameter (default 7 days); set max_age=0 to always fetch fresh.
Yes. Send labels — up to 16 of your own ids, like a client or a job — with any request. They come back with the result and the webhook, and the dashboard shows usage broken down by label, which is what an agency or a multi-tenant app needs to bill its own customers.
Yes — every paid plan takes as many team members as you need. Invite them by email; everyone shares the projects, the API keys and the monthly credits, and admins manage billing. One login can belong to several organizations too, one per client or company, each billed on its own.
Async is the default. URLpipe accepts the request immediately, hands you a token, and processes it in the background. Collect the result whichever way suits you: give us a webhook URL and we POST it to you — signed, if you turn signing on, and retried if your endpoint is down — or fetch it with GET /result/:token when you're ready. Send sync: true when you'd rather wait for the result in the response.
Yes — each plan sets how many run at once, alongside its monthly credits. The free plan runs one at a time, and the paid plans raise it to 3, 8 and 20. Past that we size it with you. A crawl of 5,000 pages costs the same credits however fast you run it, so running several at once is the difference between minutes and hours. Every response carries X-Concurrency-Limit, so a worker pool can size itself from the plan. Go over and you get HTTP 429 with error "concurrency_limit" — nothing is spent, and the request goes through as soon as one of yours finishes.
Yes. Pages are fetched, rendered and stored on our own servers in Europe on every plan — that already covers /html, /screenshot, /markdown, /meta, /lighthouse, /console, /technologies and /pdf, which never call an AI model. The one step that can sit outside Europe is the model behind /summarize, /keywords and /extract, and an organization admin can switch that to an EU-only endpoint from the dashboard. No surcharge, no change to your integration. The data residency docs have the specifics.
Account data, request history and stored results live on our own infrastructure in Europe. Stored results are private to your organization and kept for 30 days. We don't sell or share any of it. See the privacy policy for the full picture.
Get an API key in under a minute.
Free plan, no card. Confirm your email and your key is live — you'll be making real requests in minutes.