ILRS-Bot

We run a crawler that reads publicly available news, press releases and research listings about lunar exploration, and turns them into a structured, sourced database. Every page we publish links back to the sources it was built from.

User agent

ILRS-Bot/1.0 (+https://internationallunarresearchstation.com/bot)

How it behaves

• Obeys robots.txt, including Crawl-delay.
• One connection per host at a time, at least two seconds apart.
• Sends If-None-Match / If-Modified-Since; a 304 costs you one small response.
• Prefers your RSS, Atom, sitemap or API over scraping pages.
• Never fetches paywalled content, comment sections, login-protected pages, or user profiles.
• Does not attempt to bypass rate limits, bot checks or CAPTCHAs. A 403 means we stop.

What we publish

We do not republish or paraphrase your articles. We extract verifiable facts, verify them against other sources, and write our own summaries that cite and link back to you. Original snapshots are kept privately for traceability and are never shown to readers.

Make it stop

Disallow the user agent in your robots.txt, or email [email protected]. We remove the source and delete its stored snapshots within one business day, and we do not require a reason.