# andrii.net is the JSON API for Andrii Co. There is no indexable content here;
# the public website is https://andrii.co (and https://andrii.ca for Canada).
#
# Content Signals Policy (https://contentsignals.org). As a condition of accessing
# this website, you agree to abide by the following content signals:
# (a) If a content-signal = yes, you may collect content for the corresponding use.
# (b) If a content-signal = no, you may not collect content for the corresponding use.
# (c) If the website operator does not include a content signal for a corresponding use, the website operator neither grants nor restricts permission via content signal with respect to the corresponding use.
# The content signals and their meanings are:
# search: building a search index and providing search results (e.g., returning hyperlinks and short excerpts from your website's contents). Search does not include providing AI-generated search summaries.
# ai-input: inputting content into one or more AI models (e.g., retrieval augmented generation, grounding, or other real-time taking of content for generative AI search answers).
# ai-train: training or fine-tuning AI models.
User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Disallow: /
# Public metadata files are intentionally fetchable.
Allow: /robots.txt
Allow: /sitemap.xml
Allow: /llms.txt
Allow: /llms-full.txt
Allow: /.well-known/security.txt
# AbuseIPDB domain-ownership verification. Its fetcher is a verifier rather than a
# crawler (so it likely ignores robots at all), but the blanket Disallow above
# would fail verification silently if it does honor it — and the file is a public,
# secret-free ownership proof, so carving it out costs nothing.
Allow: /abuseipdb-verification.html
# AS402801 network/peering information — the policy_url target of PeeringDB
# net/43052. A public commitment page peers and researchers must be able to
# reach, index, and follow the outbound andrii.co / andrii.ca links from;
# carved out of the blanket API disallow. Both spellings listed even though
# `/peering` alone already prefix-matches `/peering/` under the standard
# robots.txt longest-match rule — explicit beats implicit here.
Allow: /peering
Allow: /peering/
# The MCP discovery documents describe the public AI-assistant booking server
# (https://andrii.net/mcp) — a robots-respecting discovery crawler must be able
# to reach them, so they are carved out of the blanket API disallow above.
Allow: /.well-known/mcp
Allow: /.well-known/mcp.json
Allow: /.well-known/mcp/server-card.json
# RFC 9727 API Catalog — the machine-discoverable list of the public API this
# domain offers (connector-only: it points at the /mcp booking server). A
# discovery crawler must be able to reach it, so it too is carved out.
Allow: /.well-known/api-catalog
# Agent Skills Discovery (agentskills.io) + the OpenAPI description of the public
# API — machine-discovery documents a discovery crawler must be able to reach.
Allow: /.well-known/agent-skills/index.json
Allow: /.well-known/agent-skills/book-notary-apostille/SKILL.md
Allow: /openapi.json

# The AI-agent/MCP discovery manifest — /peering plus every Allow-listed
# metadata doc above (llms.txt, security.txt, MCP discovery, agent skills,
# openapi.json). Keep the two files in lockstep: every <loc> here must have
# its own Allow line above.
Sitemap: https://andrii.net/sitemap.xml