PactMeshBot
PactMeshBot is the web crawler of PactMesh. It reads a small number of public pages on organizations' websites to build company profiles, including the business contact points those organizations publish, so that businesses can find relevant companies.
How to recognize it
User-Agent: PactMeshBot/1.0 (+https://bot.pactmesh.net; crawler@pactmesh.net)
It connects only from the addresses listed in ips.json. Each address has reverse DNS under bot.pactmesh.net that resolves back to the same address, so you can verify a request is really ours.
What it fetches
- Public pages of organizations' websites, plus
robots.txt, sitemaps and/.well-known/pactmesh.json. - A limited set of pages per site in each crawl round, chosen for business information such as contact, legal and about pages.
- At most one request per second to a host. It follows
Crawl-delayand backs off when a site slows down or returns errors.
What it does not do
- It does not fetch anything
robots.txtdisallows. - It does not log in, submit forms, solve challenges or disguise itself as another browser.
- It does not guess email addresses or probe mail servers.
How to block it
User-agent: PactMeshBot Disallow: /
Or write to crawler@pactmesh.net and we will stop crawling your domain.
How to state your preferences
Publish /.well-known/pactmesh.json on your site to say how you may be contacted. The crawler reads it each round and applies it straight away, without any account. Text and data mining reservations are respected: reserved pages never feed a model.
Removing your data
To object to the processing of your data or have it removed, write to privacy@pactmesh.net. No account is needed and it costs nothing.
Purpose and legal basis
We process public business information under legitimate interests (GDPR Art. 6(1)(f)) to help businesses find relevant companies. We do not profile consumers.
Contact
- Crawler questions and complaints: crawler@pactmesh.net
- Abuse: abuse@pactmesh.net
- Privacy: privacy@pactmesh.net
- Legal: legal@pactmesh.net