反爬虫之 nslookup

梦康 2018-03-13 00:00:00 51

$ cat yq-aliyun-com.2018-03-13.log |grep baidu |head -n 10
"10.xxx.xxx.xxx" "-" "[13/Mar/2018:00:00:02 +0800]" "GET /zt/255468 HTTP/1.1" "200" "72010" "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)" "GET http://yq.aliyun.com/xxxx" "yq.aliyun.com" "aliyun.com" "123.125.71.89" "0.421" "49423" "0.419" "-" "/index.php"

查看蜘蛛是不是真正来与百度

$nslookup 123.125.71.89
Server:   10.143.22.33
Address:  10.143.22.33#53

Non-authoritative answer:
89.71.125.123.in-addr.arpa  name = baiduspider-123-125-71-89.crawl.baidu.com.

Authoritative answers can be found from:
125.123.in-addr.arpa  nameserver = ns.bta.net.cn.
125.123.in-addr.arpa  nameserver = ns2.bta.net.cn.
ns.bta.net.cn internet address = 202.96.0.133
ns2.bta.net.cn  internet address = 202.106.196.28