It is not recommended to use a SQL statement to solve this kind of problem, because the database cannot afford it. It can be implemented using a program (such as writing a Python script). The steps are as follows:
Copy the table structure of table A (80 million rows) to generate an empty table B;
Make a unique index on the ciphertext column of B;
Traverse each row of table A and insert it into table B. You can use REPLACE或INSERT INTO ... ON DUPLICATE KEY UPDATE ...
Verify the data in table B. If the result is correct, delete table A and rename table B to table A.
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
It is not recommended to use a SQL statement to solve this kind of problem, because the database cannot afford it. It can be implemented using a program (such as writing a Python script). The steps are as follows:
Copy the table structure of table A (80 million rows) to generate an empty table B;
Make a unique index on the ciphertext column of B;
Traverse each row of table A and insert it into table B. You can use
REPLACE或INSERT INTO ... ON DUPLICATE KEY UPDATE ...Verify the data in table B. If the result is correct, delete table A and rename table B to table A.