Selenium usage details

*Selenium is mainly used for automated testing and supports multiple browsers. It is mainly used in crawlers to solve JavaScript rendering problems.
Simulate the browser to load the web page. When requests and urllib cannot obtain the web page content normally*

1. Declare the browser object
Attention point 1, Python file name Or do not name the package name selenium, which will result in the inability to import

from selenium import webdriver

Copy after login

webdriver can be considered as the driver of the browser. To drive the browser, webdriver must be used and supports multiple browsers. Here is Chrome as an example

browser = webdriver.Chrome()

Copy after login

2. Visit the page and get the webpage html

from selenium import webdriver
browser = webdriver.Chrome()
browser.get(&#39;https://www.taobao.com&#39;)
print(browser.page_source) # browser.page_source是获取网页的全部htmlbrowser.close()

Copy after login

3. Find the element
Single element

from selenium import webdriver
browser = webdriver.Chrome()
browser.get(&#39;https://www.taobao.com&#39;)
input_first = browser.find_element_by_id(&#39;q&#39;)
input_second = browser.find_element_by_css_selector(&#39;#q&#39;)
input_third = browser.find_element_by_xpath(&#39;//*[@id="q"]&#39;)
print(input_first,input_second,input_third)
browser.close()

Copy after login

Commonly used Search method

find_element_by_name
find_element_by_xpath
find_element_by_link_text
find_element_by_partial_link_text
find_element_by_tag_name
find_element_by_class_name
find_element_by_css_selector

Copy after login

You can also use the general method

from selenium import webdriverfrom selenium.webdriver.common.by import By
browser = webdriver.Chrome()
browser.get(&#39;https://www.taobao.com&#39;)
input_first = browser.find_element(BY.ID,&#39;q&#39;)#第一个参数传入名称，第二个传入具体的参数print(input_first)
browser.close()

Copy after login

Multiple elements, multiple elements

input_first = browser.find_elements_by_id(&#39;q&#39;)

Copy after login

4. Element interaction - search box input Keywords for automatic search

from selenium import webdriver
import timebrowser = webdriver.Chrome()
browser.get(&#39;https://www.taobao.com&#39;)
input = browser.find_element_by_id(&#39;q&#39;)#找到搜索框input.send_keys(&#39;iPhone&#39;)#传送入关键词time.sleep(5)
input.clear()#清空搜索框input.send_keys(&#39;男士内裤&#39;)
button = browser.find_element_by_class_name(&#39;btn-search&#39;)#找到搜索按钮button.click()

Copy after login

More operations: http://selenium-python.readthedocs.io/api.html#module-selenium.webdriver.remote.webelement#Can have attributes and screenshots Wait

5. Interactive actions, drive the browser to perform actions, simulate drag and drop actions, attach the actions to the action chain to execute serially

from selenium import webdriverfrom selenium.webdriver import ActionChains#引入动作链browser = webdriver.Chrome()
url = &#39;http://www.runoob.com/try/try.php?filename=jqueryui-api-droppable&#39;browser.get(url)
browser.switch_to.frame(&#39;iframeResult&#39;)#切换到iframeResult框架source = browser.find_element_by_css_selector(&#39;#draggable&#39;)#找到被拖拽对象target = browser.find_element_by_css_selector(&#39;#droppable&#39;)#找到目标actions = ActionChains(browser)#声明actions对象actions.drag_and_drop(source, target)
actions.perform()#执行动作

Copy after login

More operations : http://selenium-python.readthedocs.io/api.html#module-selenium.webdriver.common.action_chains

6. Execute JavaScript
Some actions may not be provided API, such as progress bar drop-down, at this time, we can execute JavaScript through code

from selenium import webdriver
browser = webdriver.Chrome()
browser.get(&#39;https://www.zhihu.com/explore&#39;)
browser.execute_script(&#39;window.scrollTo(0, document.body.scrollHeight)&#39;)
browser.execute_script(&#39;alert("To Bottom")&#39;)

Copy after login

7. Get element information
Get attributes

from selenium import webdriverfrom selenium.webdriver import ActionChains
browser = webdriver.Chrome()
url = &#39;https://www.zhihu.com/explore&#39;browser.get(url)
logo = browser.find_element_by_id(&#39;zh-top-link-logo&#39;)#获取网站logoprint(logo)
print(logo.get_attribute(&#39;class&#39;))
browser.close()

Copy after login

Get text value

from selenium import webdriver
browser = webdriver.Chrome()
url = &#39;https://www.zhihu.com/explore&#39;browser.get(url)
input = browser.find_element_by_class_name(&#39;zu-top-add-question&#39;)
print(input.text)#input.text文本值browser.close()

Copy after login

Get the Id, location, tag name, size

from selenium import webdriver
browser = webdriver.Chrome()
url = &#39;https://www.zhihu.com/explore&#39;browser.get(url)
input = browser.find_element_by_class_name(&#39;zu-top-add-question&#39;)
print(input.id)#获取idprint(input.location)#获取位置print(input.tag_name)#获取标签名print(input.size)#获取大小browser.close()

Copy after login

8. Frame operation
frame is equivalent to an independent web page. If you search for a subcategory in the parent category network frame, you must switch To the frame of the subclass, if the subclass is looking for the parent class, it also needs to switch first

from selenium import webdriverfrom selenium.common.exceptions import NoSuchElementException
browser = webdriver.Chrome()
url = &#39;http://www.runoob.com/try/try.php?filename=jqueryui-api-droppable&#39;browser.get(url)
browser.switch_to.frame(&#39;iframeResult&#39;)
source = browser.find_element_by_css_selector(&#39;#draggable&#39;)
print(source)try:
    logo = browser.find_element_by_class_name(&#39;logo&#39;)except NoSuchElementException:
    print(&#39;NO LOGO&#39;)
browser.switch_to.parent_frame()
logo = browser.find_element_by_class_name(&#39;logo&#39;)
print(logo)
print(logo.text)

Copy after login

9. Waiting

Implicit waiting
When implicit waiting is used When executing the test, if WebDriver does not find the element in the DOM, it will continue to wait. After the set time is exceeded, an exception of the element not found will be thrown.
In other words, when the element is found or the element does not appear immediately At this time, implicit waiting will wait for a period of time before searching the DOM. The default time is 0

from selenium import webdriver
browser = webdriver.Chrome()
browser.implicitly_wait(10)#等待十秒加载不出来就会抛出异常，10秒内加载出来正常返回browser.get(&#39;https://www.zhihu.com/explore&#39;)
input = browser.find_element_by_class_name(&#39;zu-top-add-question&#39;)
print(input)

Copy after login

Explicit waiting
Specify a waiting condition and a maximum waiting time. The program will determine whether it is within the waiting time. Whether the condition is met. If it is met, it will be returned. If it is not met, it will continue to wait. If the time exceeds, an exception will be thrown.

from selenium import webdriverfrom selenium.webdriver.common.by import Byfrom selenium.webdriver.support.ui import WebDriverWaitfrom selenium.webdriver.support import expected_conditions as EC
browser = webdriver.Chrome()
browser.get(&#39;https://www.taobao.com/&#39;)wait = WebDriverWait(browser, 10)
input = wait.until(EC.presence_of_element_located((By.ID, &#39;q&#39;)))
button = wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, &#39;.btn-search&#39;)))
print(input, button)

Copy after login

title_is 标题是某内容
title_contains 标题包含某内容
presence_of_element_located 元素加载出，传入定位元组，如(By.ID, &#39;p&#39;)
visibility_of_element_located 元素可见，传入定位元组
visibility_of 可见，传入元素对象
presence_of_all_elements_located 所有元素加载出
text_to_be_present_in_element 某个元素文本包含某文字
text_to_be_present_in_element_value 某个元素值包含某文字
frame_to_be_available_and_switch_to_it frame加载并切换
invisibility_of_element_located 元素不可见
element_to_be_clickable 元素可点击
staleness_of 判断一个元素是否仍在DOM，可判断页面是否已经刷新
element_to_be_selected 元素可选择，传元素对象
element_located_to_be_selected 元素可选择，传入定位元组
element_selection_state_to_be 传入元素对象以及状态，相等返回True，否则返回False
element_located_selection_state_to_be 传入定位元组以及状态，相等返回True，否则返回False
alert_is_present 是否出现Alert

Copy after login

Details: http://selenium-python.readthedocs.io/api.html#module -selenium.webdriver.support.expected_conditions

11. Forward and Back - Realize the browser’s forward and backward movement to browse different web pages

import timefrom selenium import webdriver
browser = webdriver.Chrome()
browser.get(&#39;https://www.baidu.com/&#39;)
browser.get(&#39;https://www.taobao.com/&#39;)
browser.get(&#39;https://www.python.org/&#39;)
browser.back()time.sleep(1)
browser.forward()
browser.close()

Copy after login

12. Cookies

from selenium import webdriver
browser = webdriver.Chrome()
browser.get(&#39;https://www.zhihu.com/explore&#39;)
print(browser.get_cookies())
browser.add_cookie({&#39;name&#39;: &#39;name&#39;, &#39;domain&#39;: &#39;www.zhihu.com&#39;, &#39;value&#39;: &#39;germey&#39;})
print(browser.get_cookies())
browser.delete_all_cookies()
print(browser.get_cookies())

Copy after login

Tab Management Adding Browser Window

import timefrom selenium import webdriver
browser = webdriver.Chrome()
browser.get(&#39;https://www.baidu.com&#39;)
browser.execute_script(&#39;window.open()&#39;)
print(browser.window_handles)
browser.switch_to_window(browser.window_handles[1])
browser.get(&#39;https://www.taobao.com&#39;)time.sleep(1)
browser.switch_to_window(browser.window_handles[0])
browser.get(&#39;http://www.fishc.com&#39;)

Copy after login

13. Exception Handling

from selenium import webdriver
browser = webdriver.Chrome()
browser.get(&#39;https://www.baidu.com&#39;)
browser.find_element_by_id(&#39;hello&#39;)from selenium import webdriverfrom selenium.common.exceptions import TimeoutException, NoSuchElementException
browser = webdriver.Chrome()try:
    browser.get(&#39;https://www.baidu.com&#39;)except TimeoutException:
    print(&#39;Time Out&#39;)try:
    browser.find_element_by_id(&#39;hello&#39;)except NoSuchElementException:
    print(&#39;No Element&#39;)finally:
    browser.close()

Copy after login

This article explains selenium Usage, please pay attention to php Chinese website for more related content.

Related recommendations:

How to perform 2D conversion through CSS3

Detailed explanation of JavaScript variables and scope

Detailed explanation of $.ajax() method parameters

The above is the detailed content of Detailed explanation of selenium usage. For more information, please follow other related articles on the PHP Chinese website!