民审-M

DNS搜索引擎回源 baidu百度 google谷歌 bing必应 搜狗 白名单 蜘蛛IP段 更新bot 站长

作者:民审-M   发布时间:2017-03-22 10:23   回复数:0   浏览数:664
民审-M
6640民审-M金牌草根
2017-03-22 10:23:22
6640 2017-03-22 10:23:22
百度(均通过nslookup反查确保官方IP)
123.125.71.1-123.125.71.254
180.76.15.1-180.76.15.254
220.181.108.1-220.181.108.254

谷歌(均通过nslookup反查确保官方IP)
66.249.67.1-66.249.67.254
66.249.79.1-66.249.79.254

必应(均通过nslookup反查确保官方IP)
103.25.156.1-103.25.156.254
157.55.39.1-157.55.39.254
207.46.13.1-207.46.13.254


雅虎(均通过nslookup反查确保官方IP)
68.180.228.1-68.180.228.254
68.180.229.1-68.180.229.254

神马(日志分析抓取)
42.120.160.1-42.120.160.254
42.120.161.1-42.120.161.254
42.156.136.1-42.156.136.254
42.156.137.1-42.156.137.254
42.156.138.1-42.156.138.254
42.156.139.1-42.156.139.254

好搜(日志分析抓取)
182.118.20.1-182.118.20.254
182.118.21.1-182.118.21.254
182.118.22.1-182.118.22.254
182.118.25.1-182.118.25.254

搜狗(日志分析抓取)
123.126.113.188

更新时间20150613,如果发现新的会陆续补充

kangle懒人白名单格式:123.125.71.1-123.125.71.254|180.76.15.1-180.76.15.254|220.181.108.1-220.181.108.254|66.249.67.1-66.249.67.254|66.249.79.1-66.249.79.254|103.25.156.1-103.25.156.254|157.55.39.1-157.55.39.254|207.46.13.1-207.46.13.254|68.180.228.1-68.180.228.254|68.180.229.1-68.180.229.254|42.120.160.1-42.120.160.254|42.120.161.1-42.120.161.254|42.156.136.1-42.156.136.254|42.156.137.1-42.156.137.254|42.156.138.1-42.156.138.254|42.156.139.1-42.156.139.254|182.118.20.1-182.118.20.254|182.118.21.1-182.118.21.254|182.118.22.1-182.118.22.254|182.118.25.1-182.118.25.254|123.126.113.188

百度站长测试:http://zhanzhang.baidu.com/crawltools/index

DNS设置好后,全部抓取正常了,不会被360CDN拦截抓取了


游客
登录后才可以回帖,登录 或者 注册