How to automate data entry from Excel to a web form with Python?

The method of filling Excel data into web forms using Python is: first use pandas to read Excel data, and then use Selenium to control the browser to automatically fill in and submit the form; the specific steps include installing pandas, openpyxl and Selenium libraries, downloading the corresponding browser driver, using pandas to read the Name, Email, Phone and other fields in the data.xlsx file, launching the browser through Selenium to open the target web page, locate the form elements and fill in the data line by line, using WebDriverWait to process dynamic loading content, add exception processing and delay to ensure stability, and finally submit the form and process all data rows in a loop. The entire process requires attention to selecting the correct element positioning method and avoid being recognized by the website as an automated operation, so as to complete the batch data entry task efficiently and accurately.

Automating data entry from Excel to a web form using Python is a practical way to save time and reduce errors. You can achieve this by combining Python libraries like pandas for reading Excel files and Selenium for controlling a web browser to fill out forms. Here's how to do it step by step.

1. Prepare Your Environment

Before writing code, install the required packages:

 pip install pandas openpyxl selenium

• pandas : Reads Excel files easily.
• openpyxl : Supports .xlsx file format.
• selenium : Automates browser actions.

You'll also need a web driver for your browser (eg, ChromeDriver for Google Chrome). Download it from the ChromeDriver website and place it in your PATH or project folder.

2. Read Data from Excel Using Pandas

Assume your Excel file ( data.xlsx ) has columns like Name , Email , Phone , etc., matching the web form fields.

 import pandas as pd

# Read the Excel file
df = pd.read_excel("data.xlsx")

# Iterate over each row
for index, row in df.iterrows():
    name = row["Name"]
    email = row["Email"]
    phone = row["Phone"]
    # Add more fields as needed

This gives you structured access to each record.

3. Automate the Web Form with Selenium

Use Selenium to open the browser, navigate to the form, and fill in the data.

 from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.common.keys import Keys
import time

# Set up the driver (make sure chromedriver is in PATH)
driver = webdriver.Chrome()

# Open the target web form
driver.get("https://example.com/form")

# Wait for the page to load
time.sleep(3)

# Fill out the form for each row
for index, row in df.iterrows():
    # Find input fields and fill them
    driver.find_element(By.NAME, "name").clear()
    driver.find_element(By.NAME, "name").send_keys(row["Name"])

    driver.find_element(By.NAME, "email").clear()
    driver.find_element(By.NAME, "email").send_keys(row["Email"])

    driver.find_element(By.NAME, "phone").clear()
    driver.find_element(By.NAME, "phone").send_keys(row["Phone"])

    # Submit the form
    driver.find_element(By.XPATH, "//button[@type='submit']").click()

    # Wait for submission to complete
    time.sleep(3)

    # Optionally go back to the form page for the next entry
    driver.get("https://example.com/form")
    time.sleep(2)

# Close the browser when done
driver.quit()

Replace By.NAME with By.ID , By.CSS_SELECTOR , etc., depending on how you locate the form fields. Inspect the webpage using browser dev tools to find accurate selectors.

4. Handle Dynamic Pages and Errors

Real-world forms may have dynamic content or validation. Here are a few tips:

• Use WebDriverWait for dynamic elements:

   from selenium.webdriver.support.ui import WebDriverWait
  from selenium.webdriver.support import expected_conditions as EC
  
  wait = WebDriverWait(driver, 10)
  name_field = wait.until(EC.presence_of_element_located((By.NAME, "name")))

• Add error handling :

   Try:
      driver.find_element(By.NAME, "email").send_keys(row["Email"])
  except Exception as e:
      print(f"Error filling email for {row['Name']}: {e}")

• Avoid detection : Some sites block automation. Use options like:

   options = webdriver.ChromeOptions()
  options.add_argument("--disable-blink-features=AutomationControlled")
  driver = webdriver.Chrome(options=options)

  ---

  5. Tips for Reliable Automation

  • Test with one row first before processing the full file.
  • Add delays ( time.sleep() or WebDriverWait ) to avoid overwhelming the server.
  • Log progress to track which rows were submitted.
  • Save progress (eg, mark submitted rows in Excel) in case the script fails midway.

  ---

  Basically, it's about reading Excel data and simulating user input in the browser. With pandas and selenium , the process becomes straightforward—just match your data to the right form fields and handle page behavior carefully.

  The above is the detailed content of How to automate data entry from Excel to a web form with Python?. For more information, please follow other related articles on the PHP Chinese website!