Price comparison crawler for Magazinite.bg, a free price comparison website for Bulgarian online shops operated by Online Bulgaria Ltd. It reads sitemaps and public product pages and collects facts only (product name, price, availability, barcode/model and URL), so visitors can compare prices and go directly to the shop's own product page. Honors robots.txt including Crawl-delay, at most 1 request per second per site, stops on 403/429 or any challenge, never accesses logins, carts or checkout. Opt-out: User-agent: MagaziniteBGBot / Disallow: / in robots.txt (rules for its earlier name MagaziniteBot are honored too), or email office@onlinebulgaria.bg.
- Category
- Operator
- Online Bulgaria Ltd
- AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
- Direct
- Documentation
- https://magazinite.bg/bot