AT-SPI dogtail https://fedorahosted.org/dogtail/ dogtail is generally good, but there are many pitfalls. For example, the window will not be brought to the front during operation, resulting in Unable to operate the control. Traversing the control is too slow... ldtp https://wiki.freedesktop.org/ldtp/ ldtp has no obvious pitfalls, but the returned control does not have a tree structure. So If the position of the control changes, it will be very troublesome to operate.
OpenCV (screen image/color search) Sikuli http://www.sikuli.org/ General, slow.
Note:
Most operations can be completed using AT-SPI, but many custom controls in other desktop environments except Gnome cannot be controlled (for example: the transparent buttons that pop up when Ubuntu is shut down cannot be obtained). Moreover, traversing controls is relatively slow. . AT-SPI API is an API to help people with visual impairments, and is mostly used to implement screen reading software.
OpenCV is more versatile, but slower. And it is not robust and easy to find. (Since no one has answered, I will give it a try)
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
AT-SPI
dogtail
https://fedorahosted.org/dogtail/
dogtail is generally good, but there are many pitfalls. For example, the window will not be brought to the front during operation, resulting in Unable to operate the control. Traversing the control is too slow...
ldtp
https://wiki.freedesktop.org/ldtp/
ldtp has no obvious pitfalls, but the returned control does not have a tree structure. So If the position of the control changes, it will be very troublesome to operate.
OpenCV (screen image/color search)
Sikuli
http://www.sikuli.org/
General, slow.
Note:
Most operations can be completed using AT-SPI, but many custom controls in other desktop environments except Gnome cannot be controlled (for example: the transparent buttons that pop up when Ubuntu is shut down cannot be obtained). Moreover, traversing controls is relatively slow. .
AT-SPI API is an API to help people with visual impairments, and is mostly used to implement screen reading software.
OpenCV is more versatile, but slower. And it is not robust and easy to find.
(Since no one has answered, I will give it a try)