About Axia’s crawler

Axia is a discovery engine for specialty coffee. We help coffee drinkers find roasters and coffees they would never have encountered on their own — especially small, independent roasters across the long tail. We index publicly available product information, generate transformative summaries in our own voice, and (in the future) act as a buying agent on behalf of customers who want to purchase.

We are not affiliated with, endorsed by, or sponsored by any roaster unless explicitly stated. Roaster names and trademarks belong to their owners.

Our crawler identifies itself on every request:

• User-Agent: AxiaCoffee-Bot/1.0 (+https://axia.coffee/bot)
• Operational contact: bot@axia.coffee

It also behaves predictably:

• Respects robots.txt (cache refreshed hourly per host)
• Rate-limited to at most one request per second per host, with jitter
• Honors HTTP 429 and Retry-After headers
• Accesses only publicly available pages — no logged-in content, no paywalled pages, no bypassing CAPTCHAs or other technical protections
• Cadence: price and stock checks daily; full descriptive content weekly; full re-classification monthly

If you would prefer our crawler not access your site, the simplest path is to add a disallow rule to your robots.txt:

User-agent: AxiaCoffee-Bot
Disallow: /

We honor it within hours of your next refresh. If you also want existing data removed, please request a takedown below — the robots rule alone stops new crawling but does not retroactively remove what we have already indexed.

We extract structured product information (origin, roast level, processing method, flavor notes, sizes, prices, in-stock state) and generate transformative summaries that describe each coffee in our own voice.

What we do

• Extract objective product attributes (facts) from public pages
• Generate original 1–3 paragraph summaries using AI, in Axia’s voice
• Display this data alongside attribution and a direct link to your site

What we don’t do

• Reproduce your product descriptions verbatim
• Download, store, or display your product photography
• Use your trademarked logos without explicit permission
• Claim affiliation, endorsement, or partnership
• Misrepresent our identity to bypass technical restrictions

We respect intellectual property and want the discovery experience to feel additive, not parasitic. Customers who find your coffee on Axia and click through to your site count as a win for both of us.

Send an email to takedowns@axia.coffee with the following information so we can action it quickly:

1. Subject line: Takedown — [Your roaster name]
2. Scope — one of:
   • Remove our entire listing for your roaster
   • Remove a specific coffee or product page
   • Keep the listing but never enable “Buy on Axia” / concierge checkout
   • Trademark, name display, or logo concern
3. Your roaster’s website URL so we can identify the correct record
4. Confirmation that you are authorized to make this request on behalf of the roaster

Our SLA: 48 hours. We will action your request and send you a confirmation email within two business days of receipt. Suspending a roaster takes effect on Axia in under a minute once we hit the button.

For anything that isn’t a takedown — catalog corrections, partnership inquiries, press, technical concerns, or general feedback — email hello@axia.coffee.