PhaunaZoa-RestaurantMap

If you found this address in your server logs: this page says who sent those requests, what we read, how fast, and how to tell us to stop.

Who

A small research crawler run by PhaunaZoa. It keeps a dated record of what restaurants and food shops in the United States list on their own public menus. It does not sell, republish or index your pages, and it is not a search engine.

What it reads

• Your robots.txt, your sitemap, your home page and the pages it links to as a menu, including menu PDFs and menu images.
• Public pages only. It never logs in, fills in forms, orders, books a table, or reads pages that need an account.
• It does not collect personal information.

How fast

• At most one request every 5 seconds to any one site from each reading job, and each site is read from one of our machines only. If your robots.txt sets a longer Crawl-delay or Request-rate, we wait that long instead.
• A few pages per visit (usually fewer than ten), in the early morning of your local time where we can.
• Sites on one hosting platform (Squarespace, Wix, Toast and the like) share a small limit on requests in flight.
• A page we read before is read again at most once a week, usually once a month.

robots.txt is honoured

We read robots.txt before anything else and follow both our own group and the * group. To stop us reading your site, add:

User-agent: PhaunaZoa-RestaurantMap
Disallow: /

We pick the change up on our next visit, and every machine of ours follows it.

When you say no

A 429 or 503 with a short Retry-After is waited out (up to two minutes). A longer wait, a 401 or 403 answer, or a challenge page stops our visits to that site. We do not solve CAPTCHAs, use proxies, rotate addresses, or disguise who we are, and we never try a refused site again from another of our addresses.

How to recognise us

Requests that claim this name from any other address are not ours.