OmniParser V2
Turn any LLM into a Computer Use Agent
Featured
315 Votes
Description
OmniParser ‘tokenizes’ UI screenshots from pixel spaces into structured elements in the screenshot that are interpretable by LLMs. This enables the LLMs to do retrieval based next action prediction given a set of parsed interactable elements.