When talking about web search engines, most people think of Yahoo. Indeed, Yahoo created an era of Internet search. However, the technology Yahoo currently uses to search the web was not originally developed by the company. In August 2000, Yahoo adopted technology from Google (www.google.com), a venture company founded by Stanford University students. The reason is very simple. Google's search engine can search for the required information faster and more accurately than the technology previously used by Yahoo.
It is probably impossible for us to design and develop a powerful and efficient search engine and database ourselves in terms of technology and funds in a short period of time. However, since Yahoo is using other people’s technology, then we are Can't we also use other people's ready-made search engine websites?
Analysis of programming ideas
We can imagine this: simulate a query, issue a search command in a corresponding format to a search engine website, then return the search results, and analyze the HTML code of the results , strip off redundant characters and codes, and finally display it in our own website page in the required format.
In this way, the key to the problem is that we need to select a search information that is accurate (so that our search will be more meaningful) and fast (because we need extra time to analyze the search results and display them) , a search website with concise search results (convenient for HTML source code analysis and stripping). Due to various excellent features of the new generation search engine Google, here we choose it as an example to see how to use PHP to implement background processing of Google (www. google.com) search and front-end personalized display process.
Let’s first take a look at the composition of Google’s query commands. Enter the www.google.com website, enter "abcd" in the query bar, click the query button, we can find that the browser's address bar changes to: "http://www.google.com/search?q=abcd&btnG=Google %CB%D1%CB%F7&hl=zh-CN&lr=", it can be seen that Google passes the query parameters and submits the query command through the get method of the form. We can use the file() function in PHP to simulate this query process.
Understand the File() function
Syntax: array file(string filename);
The return value is an array, and all files are read into the array variable. The files here can be local or remote.Remote filesmust specify the protocol used. For example: result=file("http://www.google.com/search?q=a ... mp;hl=zh-CN&lr="), this statement will simulate our query for the word "abcd" on Google process, and transfer the search results back to the array variable result in the form of elements per row. Because the file read here is remote, the protocol name "http://" cannot be missing.
If we want users to enter search characters for any search, we can make an input text box and submit button, and replace the searched character "abcd" above with a variable:
echo '
tag and the second-to-last
tag in the source code, and the penultimate
tag is immediately followed by and table characters, and this combination "
All the following procedures are continued in the "further processing" of the above procedure.
Result_string = strstr( result_string, "
"); //Get the string after result_string starting from the first
to remove the Google header
position= strpos( result_string,"The position of the
table symbol
result_string= substr(result_string,0, position);//Intercept the string before the first
table symbol to remove the footnote
Application and Implementation
OK, now that we have obtained the useful HTML source code backbone, the remaining problem is how to display the content independently. Let's analyze these search result entries and find out the differences between each entry. It is also separated by
very regularly, that is, each is a paragraph. According to this feature, we use the explode() function to cut each entry:
Syntax: explode(string separator, string string) ;
Returns an array, and each small string divided by separator is saved in the array.
result_array=explode("
", result_string) ; //Use the string "
" to split the results
We will get an array result_array, each element of which is a search result entry. All we have to do is study each entry. and its HTML display format code, and then replace it as required. Use a loop to process each entry in result_array
for( i=0; i {
... //Process each entry#. ##}
For each entry, we can easily find some characteristics: each entry is composed of title, abstract, introduction, category, URL, etc., and each part is line-wrapped, that is, it contains
; mark, so split again: (The following handler is placed in the loop above)
>every_item=explode("
", result_array[ i]);
In this way we get an array every_item, where every_item[0] is the title, every_item[1] and every_item[2] are two lines of summary, if the headers of every_item[3], every_item[4], etc. contain "Introduction:", "< font size=-1 color=#6f6f6f>Category:< /font>" characters are introduction or category (because some result entries do not have this item) , if the header contains "< font color=green>", it must be the URL. We often use
regular expression
(omitted) for this comparison. It is also very convenient if you want to replace it, such as including a title $every_item[0] itself has a link. We want to modify this link attribute so that it opens the link in a new window:
echo eregi_replace(' {... //Process each item Every item except the first item (the first item is the title, already displayed)... //More format modifications
}
In this way, the link attributes are modified, and many others are displayed Format modification, stripping, and replacement can all be accomplished using regular replacement eregi_replace().
At this point we have obtained each item of each search item, and can modify the format of each item arbitrarily, and even put a beautiful table on it. However, a good program should be able to adapt to various operating environments, and here is no exception. In fact, we have only discussed a framework method for HTML stripping of search results. To really do it perfectly, there are many things to consider, such as It shows how many search results there are in total, how many pages it is divided into, etc. It can even remove the "category", "introduction" and other codes related to Google, so that customers cannot see the original website at all. However, we can all extract these contents and requirements by analyzing HTML. Now everyone can do it themselves and build a highly personalized search engine.
The above is the detailed content of Search engine core technology_php basics. For more information, please follow other related articles on the PHP Chinese website!
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
