Skip to content

Conversation

@hassineabd
Copy link
Contributor

Architecture

Clean Architecture (Android)

Clear and decoupled pipeline:
collecting → filtering → locating → grounding

  • Strict separation of concerns across components
  • Each stage can evolve or be replaced independently

Element Perception

  • Dedicated and isolated Android UI element collector
  • Filtering strategies externalized and configurable
  • Locator builder supporting multiple strategy types
  • Single entry point for locator generation and access

Grounding & Annotation

  • Improved grounding using structured JSON items
  • Better handling of small UI elements
  • Cross-platform support (Linux / Windows)
  • Grounding logic consolidated under a grounding/ directory

Configuration

  • Added configuration variables related to SoM
  • Screen size fallback handling
  • Prompts externalized into a dedicated directory
  • Mobile connector adapted to support these changes

@hassineabd hassineabd merged commit 482e55c into release/0.0.2 Dec 30, 2025
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants