Skip to content
Any website, any data.

Tell us what you need and we'll send a free sample before you commit.

Request a sample

URL to HTML Content API

Get the fully rendered HTML of any URL, including content loaded by JavaScript, for one page or hundreds at once.

Bulk HTML content
Paste one URL per line. Requests run one by one in your browser. 5 of 5 free requests left. Sign in for more.

Paste up to 50 URLs above and get the complete HTML of each page after it has been rendered in a real browser. Unlike a plain HTTP request, the HTML includes everything React, Vue, or Angular added to the page, so you can parse it with your own tools. You get 5 free requests without an account; see plans for more.

Need structured data instead of raw HTML? Use the web scraper with CSS selectors, or convert pages to LLM-ready Markdown. Every option is documented in the Content API reference.

Features

  • Rendered HTML
    The DOM after JavaScript runs, not the raw response.
  • Wait rules
    Wait for DOM load, network idle, or a CSS selector.
  • Custom headers & cookies
    Send auth cookies and headers for logged-in pages.
  • Custom user agent
    Fetch the mobile or desktop version of a page.
  • Bulk fetch
    Paste a list of URLs and download every page.
  • Status & title
    Response status and page title with every result.

Use cases

  • Archive the HTML of landing pages and competitors
  • Feed rendered pages into your own parser or scraper
  • Debug what search engines see on JavaScript sites
  • Collect HTML datasets for testing and machine learning
  • Compare server-rendered and client-rendered output
Get the rendered HTML of a URL with cURLbash
curl -X POST https://api.agenty.ai/v1/content \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com",
    "goToOptions": { "waitUntil": "networkidle2" }
  }'
Download the HTML of many URLs in Node.jsjavascript
const urls = ['https://example.com', 'https://agenty.com'];

for (const url of urls) {
  const res = await fetch('https://api.agenty.ai/v1/content', {
    method: 'POST',
    headers: {
      'Authorization': 'Bearer YOUR_API_KEY',
      'Content-Type': 'application/json',
    },
    body: JSON.stringify({ url }),
  });
  const { result: html, meta } = await res.json();
  console.log(url, meta.status, html.length);
}
Get the rendered HTML of a URL in Pythonpython
import requests

res = requests.post(
    "https://api.agenty.ai/v1/content",
    headers={"Authorization": "Bearer YOUR_API_KEY"},
    json={"url": "https://example.com"},
)
html = res.json()["result"]
print(html[:500])

Frequently asked questions

What does the URL to HTML API return?

It returns the full HTML of the page in result after the page has loaded in a headless browser, along with the response status and title in meta. See the API reference for every option.

How is this different from viewing the page source?

View source shows the HTML the server sent before any JavaScript ran. This API returns the rendered DOM, so content added by JavaScript frameworks is included. Choose Network idle in the tool, or pass goToOptions.waitUntil: "networkidle2", for pages that load data after the first render.

How do I get the HTML of multiple URLs at once?

Paste your URLs into the tool at the top of this page, one per line, and click Get HTML. Each page is fetched in turn and you can download every result as an .html file. To find every URL on a site first, run the sitemap crawler.

Can I fetch pages behind a login?

Yes. Pass session cookies or setExtraHTTPHeaders with your request, or use authenticate for HTTP basic auth.

Is there a free tier?

You can fetch 5 pages without an account, and all accounts include free credits. Visit our pricing page for details.

API pricing

Pay only for successful requests

Buy credits when you need them. They never expire and the same key works for every endpoint.

Compare all plans

Pay as you go

$5 /1,000 credits

  • Credits never expire
  • Only successful requests billed
  • No monthly commitment

Credits per request

/v1/scrape
1
/v1/content
1
/v1/markdown
1
/v1/links
1
/v1/redirects
1
/v1/screenshot
2
/v1/pdf
2
/v1/extract
5
Web scraping agent

Web scraping with AI

Start scraping data from any website using the Agenty's web scraping agents with AI.

  • Custom web scraping at scale
  • Real-time price monitoring
  • LLM training data curation
  • Structured JSON & CSV exports
  • Anti-bot bypass built-in
  • 99.9% uptime SLA

Get a free sample dataset from any website before you commit.