What is the usage of php snoopy

php snoopy usage: 1. [fetch($URI)] to capture the content of the web page; 2. [fetchtext($URI)] to remove HTML tags and other irrelevant data; 3. [fetchform($ URI)] Returns the form content in the web page.

The operating environment of this tutorial: Windows 7 system, PHP version 5.6, DELL G3 computer.

php snoopy usage:

Snoopy class methods and examples:

1, fetch($URI)

This is the method used to crawl the content of the web page.

The $URI parameter is the URL address of the crawled web page.

The fetched results are stored in $this->results.

If you are scraping a frame, Snoopy will track each frame and store it in an array, and then store it in $this->results.

2, fetchtext($URI)

This method is similar to fetch(). The only difference is that this method will remove HTML tags and other irrelevant data, only Returns the text content in the web page.

3, fetchform($URI)

This method is similar to fetch(). The only difference is that this method will remove HTML tags and other irrelevant data, only Returns the form content (form) in the web page.

4, fetchlinks($URI)

This method is similar to fetch(), the only difference is that this method will remove HTML tags and other irrelevant data, only Returns the link in the web page.

By default, relative links will be automatically completed and converted into complete URLs.

5, submit($URI,$formvars)

This method sends a confirmation form to the link address specified by $URL. $formvars is an array that stores form parameters.

6, submittext($URI,$formvars)

This method is similar to submit(). The only difference is that this method will remove HTML tags and other irrelevant information. Data, only the text content in the web page after login is returned.

7, submitlinks($URI)

This method is similar to submit(). The only difference is that this method will remove HTML tags and other irrelevant data, only Returns the link in the web page.

By default, relative links will be automatically completed and converted into complete URLs.

Snoopy collection class attributes: (default value is in brackets)

$host The connected host

$port The connected port

$proxy_host The proxy host to use, if any

$proxy_port The proxy host port to use, if any

$agent User agent masquerading (Snoopy v0.1 )

$referer source information, if any

$cookies cookies if any

$rawheaders Other header information, if any

$maxredirs Maximum number of redirects, 0=not allowed (5)

$offsiteok whether or not to allow redirects off-site. (true)

$expandlinks Whether to link all links Complete the complete address (true)

$user authentication user name, if any

$pass authentication user name, if any

$accept http accept Type (image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, */*)

$error Where to report the error, if any

$response_code returned from the server Response code

$headers Header information returned from the server

$maxlength Maximum returned data length

$read_timeout Read operation timeout (requires PHP 4 Beta 4) settings 0 means there is no timeout

$timed_out If a read operation times out, this attribute returns true (requires PHP 4 Beta 4)

$maxframes The maximum number of frames allowed to be tracked

$status The status of the captured http

$temp_dir The temporary file directory (/tmp) that the web server can write to

$curl_path The directory of cURL binary, if there is no cURL binary, set it For false

The following is an example:

The code is as follows:

include "Snoopy.class.php";
 $snoopy = new Snoopy;
 
 $snoopy->proxy_host = "https://www.jb51.net";
 $snoopy->proxy_port = "80";
 
 $snoopy->agent = "(compatible; MSIE 4.01; MSN 2.5; AOL 4.0; Windows 98)";
 $snoopy->referer = "https://www.jb51.net";
 
 $snoopy->cookies["SessionID"] = 238472834723489l;
 $snoopy->cookies["favoriteColor"] = "RED";
 
 $snoopy->rawheaders["Pragma"] = "no-cache";
 
 $snoopy->maxredirs = 2;
 $snoopy->offsiteok = false;
 $snoopy->expandlinks = false;
 
 $snoopy->user = "joe";
 $snoopy->pass = "bloe";
 
 if($snoopy->fetchtext("https://www.jb51.net"))
 {
 echo "
".htmlspecialchars($snoopy->results)."
\n";
 }
 else
 echo "error fetching document: ".$snoopy->error."\n";

Get the content of the specified url

The code is as follows:

fetch($url); //获取所有内容
 echo $snoopy->results; //显示结果
 //可选以下
 $snoopy->fetchtext //获取文本内容（去掉html代码）
 $snoopy->fetchlinks //获取链接
 $snoopy->fetchform  //获取表单
 ?>

Form submission

The code is as follows:

表单提交地址
$snoopy->submit($action,$formvars);//$formvars为提交的数组
echo $snoopy->results; //获取表单提交后的 返回的结果
//可选以下
$snoopy->submittext; //提交后只返回 去除html的 文本
$snoopy->submitlinks;//提交后只返回 链接
?>

Now that the form has been submitted, you can do a lot of things. Next, let’s disguise the IP and browser.

Disguise browser

The code is as follows:

cookies["PHPSESSID"] = 'fc106b1918bd522cc863f36890e6fff7'; //伪装sessionid
$snoopy->agent = "(compatible; MSIE 4.01; MSN 2.5; AOL 4.0; Windows 98)"; //伪装浏览器
$snoopy->referer = "https://www.jb51.net"; //伪装来源页地址 http_referer
$snoopy->rawheaders["Pragma"] = "no-cache"; //cache 的http头信息
$snoopy->rawheaders["X_FORWARDED_FOR"] = "127.0.0.101"; //伪装ip
$snoopy->submit($action,$formvars);
echo $snoopy->results;
?>

It turns out that we can disguise session, disguise browser, disguise IP, haha, we can do a lot Something happened.

For example: With verification code, verify IP to vote, you can vote continuously.

ps: Disguising IP here is actually disguising the http header, so the IP obtained through REMOTE_ADDR cannot be disguised, but those obtained through the HTTP header (the kind that can prevent proxies), you can create your own IP.

Regarding how to verify the code, let me briefly explain:

First use an ordinary browser to view the page, find the sessionid corresponding to the verification code, and write down the sessionid and verification code values ​​at the same time. Next Just use snoopy to fake it.

Principle: Since it is the same sessionid, the verification code obtained is the same as the one entered for the first time.

Sometimes we may need to forge more things, snoopy completely thought of it for us

proxy_host = "https://www.jb51.net";
$snoopy->proxy_port = "8080"; //使用代理
$snoopy->maxredirs = 2; //重定向次数
$snoopy->expandlinks = true; //是否补全链接 在采集的时候经常用到
// 例如链接为 /images/taoav.gif 可改为它的全链接 https://www.jb51.net/images/taoav.gif
$snoopy->maxframes = 5 //允许的最大框架数
//注意抓取框架的时候 $snoopy->results 返回的是一个数组
$snoopy->error //返回报错信息
?>

Related video recommendations: PHP programming from entry to proficiency

The above is the detailed content of What is the usage of php snoopy. For more information, please follow other related articles on the PHP Chinese website!