Page metadata
Everything a machine needs to describe a page it has not read: title, meta description, canonical URL, language, favicon, the full OpenGraph and Twitter card sets, any RSS/Atom feeds it advertises, and its robots directive. One request instead of fetching and parsing HTML yourself.
POST https://api.bottrunk.com/s/page-metadata
Call it
# once, on the machine your agent runs on npx bottrunk-mcp wallet # prints the address; send it 0.3 ALGO, then USDC claude mcp add bottrunk -- npx -y bottrunk-mcp # then ask your agent for it — the tool is `bottrunk_page_metadata`
# Ask. You get a 402 with the payment requirements.
curl https://api.bottrunk.com/s/page-metadata \
-H "Content-Type: application/json" \
-d '{"url":"https://stripe.com"}'
# Pay and retry. Any x402 client does this for you.
curl https://api.bottrunk.com/s/page-metadata \
-H "PAYMENT-SIGNATURE: <signed USDC transfer>" \
-H "Content-Type: application/json" \
-d '{"url":"https://stripe.com"}'
from x402.clients import requests as x402_requests
session = x402_requests.x402_http_adapter(account) # your agent's Algorand account
r = session.post("https://api.bottrunk.com/s/page-metadata", json={"url":"https://stripe.com"})
print(r.json())
print(r.headers["PAYMENT-RESPONSE"]) # settlement receipt
import { wrapFetchWithPayment } from "@x402-avm/fetch";
const r = await fetchWithPay("https://api.bottrunk.com/s/page-metadata", {
method: "POST",
headers: { "Content-Type": "application/json" },
body: JSON.stringify({"url":"https://stripe.com"}),
});
console.log(await r.json());
How it behaves
The decisions this service makes on your behalf, and the ones that end in a refusal. A 4xx is never settled, so a refusal costs you nothing.
| Size and time | Pages over 2 MB are refused with page too large. Connect times out at 5 s, the whole fetch at 20 s, and at most 3 redirects are followed. |
| Who we look like | Requests go out as BotTrunk/0.1 (+https://bottrunk.com/docs). Sites that block unknown agents will block this one. |
| Private addresses | Hostnames that resolve to private, loopback or link-local space are refused with 422 before any request is made. Do not point this at localhost or an intranet. |
| Method | POST only. A GET on the same path returns this page. |
Input
| url | string | Public http(s) URL. |
Output
| title | string | Document title. |
| description | string | Meta or OpenGraph description. |
| canonical | string | Canonical URL, absolute. |
| open_graph | object | Every og:* tag, keyed without the prefix. |
| object | Every twitter:* tag. | |
| feeds | array | RSS/Atom feeds declared in the head. |
| favicon | string | Absolute favicon URL. |