I refresh the PHP page directly and can delete the numeric fields in the MYSQL database, but cannot delete the letter or URL fields?

I directly refresh the PHP page and can delete the numeric fields in the MYSQL database, but I cannot delete the letter or URL fields.

我就是我 2018-05-14 11:49:58 0  1  2199

Scrapy INSERT into 'new_table' only if no record exists in 'current table'

I tried some website scraping. I successfully scraped the data from the current database table. But I want to insert "new_table" only if record does not exist in "current table" My code is (pipeline) table='products' table2='new_products'`defsave(self,row):cursor=self.cnx. cursor...

P粉122932466 2024-03-29 19:36:16 0  1  396

Web crawler - How to use java to crawl information and make a ranking system?

I happened to have an interesting project to do while learning java web. Our school requires a credit card for morning runs. The Physical Education Department provides an inquiry website, but does not provide an interface. I want to make a website/WeChat backend to capture information from the schoo...

迷茫 2017-06-12 09:19:16 0  4  675

LARAVEL: all elements in foreach have id 1, which makes deleting them impossible

My situation is very difficult. I'm building a birth list clone using scraper, but I'm having a hard time coding it because I'm inexperienced. I successfully created an admin page with multiple forms for inserting sites, categories and link forms where you can specify on which link should be crawled...

P粉064448449 2024-01-28 23:17:43 0  1  551

Upload a CSV file containing the URLs from the HTML page and use Flask to read the URLs you want to crawl

I currently need to make a web-based system that can upload a CSV file containing a list of URLs. After uploading, the system will read the URL line by line and will be used for the next step of crawling. Here, crawling requires logging into the website before crawling. I already have the source cod...

P粉799885311 2023-09-07 11:22:35 0  1  574

Heroku limits Puppeteer to running only three times

I'm developing a website that uses puppeteer to scrape data from another website. When I run the npm server on my local machine it scrapes the data just fine, but when I deploy it to Heroku it only runs the first three files I'm looking for and then stops. I essentially want to scrape data about cla...

P粉986860950 2024-04-02 19:49:08 0  1  699

javascript - Problem with nodejs crawling web pages

I plan to use nodejs to capture all the news on the website below. According to the general idea, first get the URL of each page of news, and then get the URL of each news and use request to fetch the content of each URL. That's it. But all the paging information of the following website, as well as...

阿神 2017-05-16 13:43:09 0  2  667

How to prevent malicious ddos ​​crawling on nginx

First of all, I have no objection to others crawling the content of my website. I don’t necessarily strictly limit other people’s crawling. However, some people’s crawling has no bottom line at all. They use one script or even multiple scripts to crawl a certain website concurrently. The content of ...

黄舟 2017-05-16 17:30:17 0  4  1078

How to protect click to chat Whatsapp button from bot web scraping?

I'm running a classified website where people can post their items and others can contact them via Whatsapp for more details. Today my website came under attack and I saw a huge amount of link clicks on the Whatsapp button in Google Analytics, it can't be artificial. I think it's some bot grabbing t...

P粉786800174 2023-09-03 12:52:21 0  1  612

Classes for Chargebee library not found in Laravel.

I have installed the Chargebee library to my Laravel 5.7 website. But when I want to use the library, all the classes from the library are not found. Below is my controller code:

P粉041758700 2023-07-20 09:17:02 0  1  727

Novice is asking for help with the problem of garbled text display.

Newbies need help, the details are as follows: 1. PHP website needs to retrieve MSSQL database data. 2. The website is from Russia and all web text has been Chineseized, but the Chinese name read from MSSQL is displayed as garbled characters. How can I modify it? Seek the guidance of the great God! ...

小白大哥 2020-02-22 15:35:20 0  0  915

How does a web page connect to a database to capture information?

There is a button and an input box on a web page. Click the button to connect to the database to capture information, and then return the information to the input box on the web page. I'm a newbie. Is there any source that I can refer to?

神秘人 2020-12-21 19:45:07 0  1  1165

Using URL and refer, the content can be parsed on other GET interfaces, but using the following PHP code returns 404

You can use URL and refer to parse the content on the online PHP GET interface provided by other websites. You can also capture the packets directly on the web page. However, using the following PHP code returns 404. Is there something wrong with this header? <?php$ url='http://interface.yy.com/h...

小马 2018-07-09 17:58:41 0  2  1489

Dear python crawler experts, take a look and see how to deal with anti-crawling on this website.

https://www.everysaving.co.uk crawls the data of this website through python, but the data cannot be returned! I added the header and proxy IP to crawl, but it didn't work. I hope you guys can give it a try. . .

曾经蜡笔没有小新 2017-05-18 11:01:00 0  4  776

javascript - How to parse the video address starting with blob in the video tag

I want to grab a video from a video website, but the video address is encrypted. For example: blob: http://www.imooc.com/fdf730ad-6378-499c-8d32-b8b4d01b4afc The src of the video is this address. Does anyone know how? Cracked?

大家讲道理 2017-07-06 10:36:38 0  1  6689

Have you ever encountered problems such as downloading class library 500?

Recently, I downloaded some class libraries from the PHP Chinese website. Either there is no such file or the error code is 500. Is it a problem with my website or something else I can’t figure out! ! ! ! ! !

phpcn_u31624 2017-09-22 18:12:27 0  1  1033

How to display php rows with the same value as in HTML?

Get multiple data with the same value from the database. How can I structure it so it will work as a subcategory. How to merge all rows with the same name into one? The website should only show one Pampanga. This should be a subcategory. Here is the code for this particular page. <sectionclass=&q...

P粉460377540 2024-03-20 08:47:28 0  1  466

My website aldkc.com often cannot be opened. Why does it fail to connect to the database?

Hello everyone, my php website aldkc.com often cannot be opened. Why does it fail to connect to the database? aldkc.com

phpcn_u57654 2017-11-10 23:38:52 0  2  940

PHP automatically performs the login operation after discovering that the login has expired, and then continues the previous step.

Conditions: There is a third-party website, and every step of the operation needs to be logged in. Now I have built a simple front-end page and used PHP to make a springboard in the middle. Process: Every request on the page I built is transmitted to the PHP springboard through ajax, and then the PH...

暖暖橙 2022-06-13 15:06:16 0  1  1282

Store HTML DOM results into MySQL database

I'm trying to store scraped data into my database. It just outputs the results, so the crawling is normal. But there is definitely an error in defining the variable and passing it to mysql-insert. I get the message "New record created successfully". The result of the variable is empty and ...

P粉549986089 2023-09-15 23:41:06 0  1  583