Home > Backend Development > PHP Tutorial > Dedicated to all friends who want to learn regular expressions and collection_PHP tutorial

Dedicated to all friends who want to learn regular expressions and collection_PHP tutorial

WBOY
Release: 2016-07-13 17:37:03
Original
843 people have browsed it

function get_url_content($Url,$Method = c) {
//Introduce the required language encoding. If not, it will default to utf-8, don't worry.
global $Charset;
$Urlarr = parse_url($Url);
//If the domain name cannot be detected, return.
if (!isset($Urlarr[host])) {
        return false;
     }
     //We define the header multiple information in a smart way. =Host && $val = $Urlarr[host];
            $key===Referer && $val =http://.$Urlarr[host];
                                                                            $Urlarr[host];                            ";
}
//Virtual source.
!eregi(Referer,$str) && $str .="Referer:http://{$Urlarr[host]}, ";
//After correction, basically, the source is the same site, and the host is also the Url site.
$Header = array(trim($str));
//The following is just to choose which one to use Program to collect.
if($Method === f&&function_exists(file_get_contents)) {
$opts = array(
http=>array(
method=>"GET",
header=>$Header,
)
);
$cxContext = stream_context_create($opts);
$file_contents = @file_get_contents($Url, false, $cxContext);
} elseif ($Method === c&&function_exists(curl_init)) {
$Ch = curl_init();
$Timeout = 5;
curl_setopt($Ch,CURLOPT_HTTPHEADER,$Header);
curl_setopt ($Ch, CURLOPT_URL, $Url);
curl_setopt ($Ch, CURLOPT_RETURNTRANSFER,1);
curl_setopt ($Ch, CURLOPT_CONNECTTIMEOUT, $Timeout);
$file_contents = curl_exec($Ch);
curl_close($Ch);
}
//In order to make the style display beautifully, we add a target guide to it.
$file_contents = str_replace(,"< /title> ",$file_contents);
//Process the most common encodings. If the target website does not have encoding, it will default to GBK
!preg_match(/charset=([^<>"]*)"/isU,$file_contents,$lang) && $lang[1]=GBK;
function_exists(mb_convert_encoding) && $file_contents = mb_convert_encoding($file_contents,empty($Charset)?UTF-8:$Charset,$lang[1]);
//Unset some codes;
unset($Url,$lang,$Timeout,$ Urlarr,$Charset);
return $file_contents;
}

//Start the test using the file_get_contents method
HEADER("CONTENT-TYPE:TEXT/HTML; CHARSET=UTF-8 ");
//http://www.xtzj.com/read-htm-tid-347550.html This cannot be collected.
$file = get_url_content("http://www.hao123. com",f);
$file = strip_tags($file,);
preg_match_all(/(http:[^"<>]*)>/isU,$file, $link);unset($link[0]);
$link = $link[1];

//Let’s simulate getting data. Change the numbers yourself. 0-151 The following is using curl

$x = 10;

$file = get_url_content($link[$x]);
echo $file;
?>

Write all descriptions and comments..

If you don’t understand the reply... Let me spread the knowledge about the collection.

Original address: http://bbs.phpchina.com/viewthread.php?tid=99263

http://www.bkjia.com/PHPjc/486604.html

truehttp: //www.bkjia.com/PHPjc/486604.htmlTechArticle?php function get_url_content($Url,$Method = c) { //Introduce the required language encoding. If not , it will default to utf-8, don’t worry. global $Charset; $Urlarr = parse_url($Url); //If you check...
source:php.cn
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Popular Tutorials
More>
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template