使用Nginx对百度蜘蛛的301重定向跳转处理

如何使⽤Nginx对百度蜘蛛的301重定向跳转处理呢？
先简单说下我碰到的情况。我⼀个域名的http页⾯被墙，国内⽤户可以通过https⽅式打开。为了seo，也遵循尽量不换⽹站域名的前提下，现在我想实现的⽬标是对国外蜘蛛（google...）和不在墙内的⽤户访问http页⾯时301重定向跳转到https，⽽百度蜘蛛访问原页⾯时301到⼀个新域名，新域名反向代理原来的⽹页，⽤户通过百度搜索点击打开的是原域名https页⾯。
1、修改原域名nginx配置
server {
listen 80 default;
server_name www.78moban.com;
index index.html index.htm index. default.html default.htm default.php;
root /home/wwwroot/nbhao;
#通过$http_user_agent判断是否是百度蜘蛛
if ($http_user_agent ~* Baiduspider){
return 301 http://www.78moban.com$request_uri;
}
#排除对⼀个⽹址的301重定向
if ($request_uri !~ ^/.*/.*notify_url\.php.*){
return 301 https://$server_name$request_uri;
}
location ~ .*\.(php|php5)?$
{
try_files $uri =404;
fastcgi_pass unix:/tmp/php-cgi.sock;
fastcgi_index index.php;
include fcgi.conf;
}
access_log /home/wwwlogs/www.78moban.com.log www.78moban.com;
}
server {
listen 443 ;
......
#https配置详见http://www.sijitao.net/1835.html
}
2、修改新域名配置
server
{
listen 80;
#listen [::]:80;
server_name www.78moban.com;
index index.html index.htm index.php default.html default.htm default.php;
root /home/wwwroot/78moban.com/www;
#如果⽤户不是百度蜘蛛且访问的⽹址不是baidu.*\.html格式
set $flag 0;
if ($http_user_agent !~* Baiduspider){
set $flag "${flag}1";
}
#⽤做百度站长平台的验证
if ($request_uri !~ ^.*/baidu.*\.html.*){
set $flag "${flag}2";
}
if ($flag = "012") {
return 301 https://www.78moban.com$request_uri;
}
#接上不，如果是百度蜘蛛，执⾏_pass反代。
location ^~ / {
proxy_redirect off;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
if ($request_uri !~ ^.*/baidu.*\.html.*){
proxy_pass https://www.78moban.com;
}
}
......
access_log /home/wwwlogs/www.78moban.com.log access;
}
3、通过curl模拟百度蜘蛛、google、普通⽤户验证
[stocky@s1 ~]$ curl -I -A Baiduspider www.78moban.com
HTTP/1.1 301 Moved Peanently
Server: nginx/1.0.15
Date: Wed, 04 Mar 2015 08:59:27 GMT
Content-Type: text/html
Content-Length: 185
Connection: keep-alive
Loion: http://www.78moban.com/
[stocky@s1 ~]$ curl -I -A Baispider www.78moban.com HTTP/1.1 200 OK
Server: nginx
Date: Wed, 04 Mar 2015 09:01:29 GMT
Content-Type: text/html; charset=utf-8 Connection: keep-alive
Vary: Accept-Encoding
Vary: Accept-Encoding
X-Powered-By: PHP/5.2.17p1
[stocky@s1 ~]$ curl -I -A google www.78moban.com HTTP/1.1 301 Moved Permanently
Server: nginx/1.0.15
Date: Wed, 04 Mar 2015 09:00:08 GMT
Content-Type: text/html
Content-Length: 185
Connection: keep-alive
Location: htt://www.78moban.com/
[stocky@s1 ~]$ -I -A google www.78moban.com HTTP/1.1 301 Moved Permanently
Server: nginx
Date: Wed, 04 Mar 2015 09:02:07 GMT
Content-Type: text/html
Content-Length: 178
Connection: keep-alive
Location: https://www.78moban.com/
[stocky@s1 ~]$ curl -I -A Mozilla www.78moban.com HTTP/1.1 301 Moved Permanently
Server: nginx/1.0.15
Date: Wed, 04 Mar 2015 09:01:59 GMT
Content-Type: text/html
Content-Length: 185
Connection: keep-alive
Location: https://www.78moban.com/
[stocky@s1 ~]$ curl -I -A Mozilla www.78moban.com HTTP/1.1 301 Moved Permanently
Server: nginx
Date: Wed, 04 Mar 2015 09:04:00 GMT
Content-Type: text/html
Content-Length: 178
Connection: keep-alive
Location: https://www.78moban.com/
测试后发现满足要求。