$ cat yq-aliyun-com.2018-03-13.log |grep baidu |head -n 10
"10.xxx.xxx.xxx" "-" "[13/Mar/2018:00:00:02 +0800]" "GET /zt/255468 HTTP/1.1" "200" "72010" "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)" "GET http://yq.aliyun.com/xxxx" "yq.aliyun.com" "aliyun.com" "123.125.71.89" "0.421" "49423" "0.419" "-" "/index.php"查看蜘蛛是不是真正来与百度
$nslookup 123.125.71.89
Server: 10.143.22.33
Address: 10.143.22.33#53
Non-authoritative answer:
89.71.125.123.in-addr.arpa name = baiduspider-123-125-71-89.crawl.baidu.com.
Authoritative answers can be found from:
125.123.in-addr.arpa nameserver = ns.bta.net.cn.
125.123.in-addr.arpa nameserver = ns2.bta.net.cn.
ns.bta.net.cn internet address = 202.96.0.133
ns2.bta.net.cn internet address = 202.106.196.28