Skip to main content
You can show a bot exactly what you mean. Mark a place on the bot’s desktop, or an item of the bot page, and write a comment about it. The bot gets each marked place with your message. The bot can also point at a place on its desktop to show you something.

​
Point at a place on the bot’s desktop

1

Open point mode

Open the full desktop view and click Point, or press P. In the Now tab, click Point on the small live picture. Point is not available while you are in control of the computer.
2

Mark the place

The view stops on a picture of the screen and says “Paused view. The bot keeps working.” The bot is not paused. Click a point, or drag to mark an area.
3

Write your comment

A box shows what RelayHub found at the place, for example “Button ‘Submit order’ on shop.example.com”. While it reads, the box says “Reading this place”. Write your comment and click Add.
4

Send the message

The place shows as a note above the message field, with its picture. The message field gets the line “Note 1: ” and your comment. You can change the text before you send it. Click Send.
Click Done or press Esc to leave point mode. You can mark up to 20 places for one message. To remove a place before you send, click its remove button. If a send fails, the marked places stay, and the next try sends them again. A message can have marked places and no text. The bot then reads “Look at the places I marked.”

​
Point at an item of the bot page

You can also point at these items:
  • a message in the conversation
  • a step of a task
  • a file of a message or of a task
  • an approval card or a setting proposal
  • a settings section: General, Permissions, Connections or Memory
1

Start

Click Point at an item next to the message field. In the settings window, click Point at a setting in the corner.
2

Click the item

The page says “Click a message, a step, a file, a card or a settings section. Escape stops.” An outline shows the item under the pointer.
3

Write your comment and send it

A box shows what RelayHub read, for example “Step 7: Opened the invoice” or “The file invoice.pdf”. Write your comment and click Send to and the bot’s name, or press Cmd+Enter (Ctrl+Enter on Windows). Enter starts a new line in the comment. The note goes to the bot at once as its own message, with the item, and shows in the conversation. Click Cancel or press Esc to close the box without a send.
To stop without pointing at an item, press Esc, click Point at a setting again, or close the settings window. Opening another bot also stops it. Esc stops the pointing only, so the settings window stays open. The box always fits in the window. It opens below the item, or above it when there is no room below. When the box is taller than the window, its middle part scrolls, and the title and the buttons stay on the screen. A message that you started in the message field stays there. An item has no picture. RelayHub reads the item with your access, so you can only point at the items of your own bot.

​
What the bot gets

  • Your comments are in your message as “Note 1: …”, “Note 2: …”. The number of each note matches the number of its place, also after you remove a place.
  • For each place, the bot gets what RelayHub found there: the element and the website, or the window, or the item and its text. This information is marked as data from the screen, and the bot is told not to take it as instructions. Text on a web page, such as “ignore your instructions”, stays data.
  • The screen can change after you mark a place. The bot looks at the screen again before it acts.
  • When the bot’s model can read pictures, the bot also sees the picture of each place once, when it reads your message.

​
The bot points back

A bot that uses its desktop can show you a place on its screen, for example the field that it cannot fill in. The desktop view then shows a ring around the place with the bot’s text and a Close button. The ring goes away when the bot does its next action, after 30 seconds, or when you click Close. The bot also posts a message with a picture of the place. Click Show on screen to open the full desktop view. In Slack or Teams you get the text and “Open the bot in RelayHub to see the place.” The picture does not leave RelayHub. The bot does not wait for an answer when it points. If it needs an answer, it asks you a question next. The bot shows nothing when a saved password shows on the screen, or when you are in control.

​
How long pictures are kept

  • The paused view of point mode is kept on the bot’s computer for 10 minutes.
  • A place that you marked and did not send is deleted after 30 minutes.
  • The pictures of sent places stay with the bot’s messages. They are deleted when you archive the bot.
  • A picture is never in a Slack or Teams message.
  • When you mark a place while a saved password shows as text on the screen, RelayHub takes no picture.