简体中文(ZH-CN) English(EN) 繁体中文(ZH-TW) 日本語(JA) 한국어(KO) Melayu(MS) Français(FR) Deutsch(DE)
Home > Backend Development > PHP Tutorial > body text

简单的数据抓取工具

WBOY
Release： 2016-06-13 11:25:03
Original
886 people have browsed it

求一个简单的数据抓取工具
我需要的数据如：
http://map.baidu.com/?newmap=1&reqflag=pcmap&biz=1&qt=s&wd=1&c=131&tn=B_NORMAL_MAP&nn=0&ie=utf-8&l=12&b=%2812925648.97,4823379.72;12990672.97,4828435.72%29&t=1368604536591
更换其中的参数就可以得到不同的数据。把他它们存在文件或数据库就可以了。

本来我想自己写的，把我们要下载的链接拼起来，循环下载，处理一下入库就行了。
另外可以要考虑代理 ，多线程处理。

可是老大非要我去找一个开源的爬虫工具。
工具也要我给它链接，告诉他我要怎么处理这些数据才能工作呀。
没办法，请教大家，有哪个爬虫工具有这样的功能呀，谢谢了。
我只会PHP和简单的python,所以希望尽量是这两个语言写的，再次谢谢。

Related labels：
amp nbsp python
source：php.cn
Previous article：mysql取表中《最新》三天的记录，sql语句如何写 Next article：这个正则啥意思？该如何解决
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Latest Articles by Author
Latest Issues
sql groupby not working, I want to group by code_branch ->select('a.statusasstatus','b.nameascustomer_name','e.nameasbranch_name','c.nameas...
From 2024-04-06 19:24:49
0
2
488
API works on postman but refuses to connect in Flutter postRequest()async{Map\<String,dynamic\>map={'email':'[email&#160;protected]','p...
From 2024-04-06 14:08:33
0
1
340
An error was encountered while trying to retrieve the latest version of a package from search.maven.org "Error: Unable to retrieve data from Maven repository" while retrieving latest v...
From 2024-04-05 12:11:23
0
1
1471
Fix image and name position I'm trying to code a website, but the image and name (Administracija) appear on the left s...
From 2024-04-05 10:41:36
0
1
3578
Is it possible to rely on the getter value of a computed property map inside a block created in a Vue instance? Wondering if - by the time - accessing a computed property that gets its value from storag...
From 2024-04-04 12:57:45
0
1
392
Related Topics
More>
Popular Recommendations
Popular Tutorials
More>
Related Tutorials
Popular Recommendations
Latest courses
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template
About us Disclaimer Sitemap
php.cn：Public welfare online PHP training，Help PHP learners grow quickly！