Honor Debuts a New AI Agent That Can Read and Understand Your Screen

It chose a restaurant but couldn’t complete the process because the location it chose required a credit card to confirm the reservation, when the user had to take over. You can be flexible in your query – In another example, asking it to book a “highly rated” restaurant means it will view highly rated reviews, although the agency’s research has not done more research. It is not a comment that cross-references with data from other parts of the network, especially since all of this data is processed on the device and not sent to the cloud.

This agent artificial intelligence is Current buzzwords in the field of technology. My colleague will be a knight Recently tested the AI ​​assistant This allows you to browse the web and perform tasks online. Google announced its Gemini 2 AI model Trained to take action on your behalf. It also updates the idea of ​​a smartphone’s generated user interface – in MWC 2024, we see some companies working hard to find ways Interact with the application without using the applicationinstead rely on the AI ​​assistant to issue commands when generating the user interface.

The method of honor is a bit like the infamous rabbit Rabbit R1– In progress Teaching modeyou can manually train its assistant to complete tasks. There is no need to access the application’s application programming interface (API), which is the way traditional applications or services communicate with each other. The agent remembers the process, allowing you to issue commands and execute tasks.

But Honor says its self-reliant AI execution model is not trained to follow strict steps – it is able to perform multimodal screen context recognition autonomously. Instead of training the assistant to learn every part of the Opentable App, it is able to understand the semantic elements of the user interface and will follow up through a multi-step process to perform your request. Honor emphasizes that the process is more cost-effective: “Unlike competitors like Apple, Samsung and Google that rely on external APIs – holding higher operating costs – Honor’s AI agents independently manage a wide range of tasks.”

Photo: Julian Chokkattu