Skip to content
dwellmark

Crawler

About our crawler

For webmasters who found this address in their logs.

How to identify it

Every request carries this User-Agent:

Dwellmark/1.0 (+https://dwellmark.house/bot)

We never disguise it as a browser, rotate identities, or use proxy pools.

How to block or slow it

To stop us entirely, put this in your robots.txt:

User-agent: Dwellmark
Disallow: /

To block particular paths, or to slow us down:

User-agent: Dwellmark
Disallow: /private-path/
Crawl-delay: 10

Blocking us at your edge works too: a 401, 403 or 404 ends the request, and we do not retry it or route around it.

What it does

  • Reads only pages any visitor can see. Nothing behind a login, paywall, CAPTCHA or firewall.
  • Runs about once a day, with requests spaced out and capped in size.
  • Keeps price, status, specifications, incentive terms and the source page. Not copies of your pages.
  • Does not host your images. Browsers load them from your servers.

Reaching a person

Write to support@serenialabs.space to correct something, have content taken down, or stop us collecting from your site. No explanation needed. We acknowledge within two business days and act within ten.

Email is quicker than robots.txt, which we re-read when a collector is written or revised rather than on every run. How we collect is set out in our Terms of Use.

dwellmark.house is operated by Serenia Labs LLC, Arizona.