screen-parsing

Here are 3 public repositories matching this topic...

Sabir-Ali-Mondal / SAM-ScreenParser

CPU-friendly screen-to-JSON parser for AI desktop agents. Extracts pixel-perfect coordinates, OCR, UI semantics, cursor context, and structured screen state for reliable LLM-driven automation.

automation ocr tesseract ui-automation coordinates autonomous-agents florence windowsui paddleocr screen-parsing omniparser

Updated Jul 28, 2026
Python

cute-aaa / OmniParser-MCP

Star

MCP server for Microsoft OmniParser: turn screenshots into structured UI elements for GUI agents (such as Claude Desktop / Cursor / Cline)

mcp vision llm screen-parsing omniparser computer-use mcp-server gui-agent

Updated Aug 16, 2026
Python

Pirate-Emperor / SEER

Star

SEER: Enhancing Multimodal Action Grounding with Semantic UI Parsing

python gui ocr semantics seer semantic-parsing rga gpt-4 screen-parsing

Updated Nov 26, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the screen-parsing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the screen-parsing topic, visit your repo's landing page and select "manage topics."

Learn more