Crawler to extract the newest articles in the publisher's website (via RSS feed URL)
- Category
- Feed Fetcher
- Operator
- Midas Network d.o.o.
- Documentation
- https://midas-network.com
- HTTP requests
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; MidasNetworkBot/1.0; +https://midas-network.com/) Chrome/144.0.0.0 Safari/537.36
- robots.txtLearn more...
User-Agent: MidasNetworkBot Disallow: /