Search by picture

Owned by Stanislav N. (Unlicensed)
Last updated: Aug 06, 2021 by ZL Support
3 min read

Table of contents

Description

Allows you to click on an element using visual search. It is recommended to use it when it is impossible to search for an element in other ways or the element is drawn in Flash, or using canvas.

The operation uses a lot of computer resources

How to add to the project?

Move the mouse cursor over the element and call the context menu with the right button

What is it used for?

  • Click on an item that cannot be approached using the Rise Event action

How to work with a window?

  1. Adjustable search area - you need to highlight the unique part of the element. If you select a button, then you do not need to select it all, as it contains a lot of monotone color.

  2. Click sight - the place of the click inside the search area is set, you can move it.

  3. The precision of the match .

  4. Search - search for an item in the browser window.

After clicking the Search button, the found element in the browser window will be highlighted with a red frame

5. Yes - if the item was found according to your criteria.

6. No - the search was executed incorrectly, we change the search parameters.

When the element is correctly defined, go to the click settings.

  1. Selecting the click type .

  2. Check execution in a browser window.

  3. Add the customized action to the project.

You need to click on the button by searching by image

Call the search box in the browser window and set a unique area

Unique area

Non-unique area

The button contains a lot of monotone color

We set the type of click, in our case with the left mouse button and test the execution in the browser window

The click was successfully completed in the browser window - add the action to the project canvas

Everything is ready, we can continue working with the project

Usage example

This can be useful in Flash games or applications as there is no way to access specific items. For example, if you need to click on a button in a Flash application, the algorithm will be as follows:

  1. Go to the page and wait for the full download.

  2. Hover the mouse cursor over the element, call the context menu and select “Search by picture”.

  3. We set a unique search area for the picture and set the parameters for clicking.

  4. Testing in a browser window.

  5. Adding an action to the project

  1. Mouse emulation

  2. Browser window