Crawler to extract the newest articles in the publisher's website (via RSS feed URL)
- Catégorie
- Extracteur de flux
- Opérateur
- Midas Network d.o.o.
- Documentation
- https://midas-network.com
- Requêtes HTTP
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; MidasNetworkBot/1.0; +https://midas-network.com/) Chrome/144.0.0.0 Safari/537.36
- robots.txtEn savoir plus...
User-Agent: MidasNetworkBot Disallow: /