PHP displays different content to visitors and crawlers

PHP displays different content to visitors and crawlers_PHP Tutorial

WBOY

Release： 2016-07-21 15:42:47

Original

913 people have browsed it

I heard that this method will violate some operating principles of search engines, and may be punished by various search engines, or even delete the website. So I have just removed this treatment until I am sure that it is not cheating. Friends who are enterprising can continue to use it. , but do so at your own risk.

The homepage and archive pages of this blog display articles in the form of a list, and the content of the article is only loaded when the visitor clicks to expand the article. Because the content of the article contains a large amount of text and pictures, It requires a lot of loading time and traffic. Displaying web pages to visitors as quickly as possible can retain a large number of visitors. For mobile users, loading time and traffic are more important.

Generally speaking, the homepage of the website It is the page most visited by search engines, and meaningful content should be displayed to them as much as possible. However, if the articles are displayed in the form of a list, visitors and search engines can only obtain the article title information. Article content or summary (especially the article The first sentence) is extremely important for SEO, so we have to try to send this content to the crawler.

Okay, we can use the User Agent to determine whether the visitor is a crawler, and if so, use Display articles in general form, otherwise display the article list in list form. You can use the following PHP method to determine whether it is a crawler:

Copy code The code is as follows:

 
function is_crawler() { 
$userAgent = strtolower($_SERVER['HTTP_USER_AGENT']); 
$spiders = array( 
'Googlebot', // Google crawler
 'Baiduspider', // Baidu crawler
'Yahoo! Slurp', // Yahoo crawler
'YodaoBot', // Youdao crawler
'msnbot' // Bing crawler
// more Crawler keyword
); 
foreach ($spiders as $spider) { 
$spider = strtolower($spider); 
if (strpos($userAgent, $spider) !== false) { 
return true; 
} 
} 
return false; 
} 

This is the method I use, each crawler accesses comments from high to low Sort. Then display different content to crawlers and natural people through the following method