Baiduspider is the search engine crawler for the search engine Baidu.
- HTTP 요청
Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)
- robots.txt자세히 알아보기
User-Agent: Baiduspider Disallow: /