somew1nd
ea3708a98f
feat: implement robust multi-tier text input architecture and ADB diagnostics
...
- Android Text Input & IME Normalization:
- Implement progressive 3-tier input architecture in AndroidAdbDriver and AndroidDeviceController:
- Tier 1 (Primary): Zero-dependency clipboard injection + KEYCODE_PASTE (immune to IME Pinyin interception, full Unicode/Emoji support, preserves multiline formatting).
- Tier 2 (Broadcast): Base64 broadcast injection when ADBKeyboard is active.
- Tier 3 (Fallback): Native ADB physical keyevent fallback.
- Add literal newline normalization (\r\n, \n, \r) to prevent JSON escape string corruption (e.g. '10086\n' -> '10086、n').
- Add set_clipboard method to UIAutomatorClient without auxiliary APK requirements.
- Diagnostics & System Probes:
- Add adb_keys diagnostics probe for ADB key auth checks.
- Integrate diagnostics into CLI doctor command.
- Admin Console & Showcase UI:
- Improve model service and system router in admin console.
- Enhance workspace stream view and session state in showcase UI.
2026-08-24 16:48:45 -07:00
somew1nd
206a9ce921
feat: initial release of ARTEMIS Android Agent & Automation Platform
...
ARTEMIS is an autonomous multimodal Android agent and mobile UI automation
platform engineered for physical devices and emulators. It combines state-of-the-art
multimodal Vision-Language Models (VLMs) with hierarchical closed-loop planning,
resilient self-healing, and deep Android subsystem integration.
Key Features & Architectural Highlights:
- Dual-Engine Orchestration:
* Pro Engine: Multi-agent closed-loop (Planner -> Operator -> Validator/Failure Analyzer -> Summarizer) powered by LangGraph.
* Flash Engine: Ultra-fast reactive loop for deterministic, low-latency UI execution (<35 steps).
- Multimodal Perception & Grounding:
* Hybrid visual screenshot grounding, real-time OCR extraction, and XML accessibility hierarchy parsing.
* Dynamic-First, Coordinate-Fallback locating strategy for maximum resilience against UI drift.
- Autonomous Self-Healing & Diagnostics:
* Failure analyzer and safety net for popup dismissal, crash recovery, and auto-retry.
* Diagnostic sub-agents for log analysis, video recording inspection, and object detection.
- Unified CLI & Python SDK:
* Rich CLI with commands: init, doctor, run, trace, batch, bench, server, and mcp.
* Fluent Python SDK with Pydantic structured output models and package locking.
- Multi-Provider LLM Architecture:
* Support for Google Gemini, OpenAI, Anthropic Claude, Vertex AI, OpenRouter, xAI Grok, and local endpoints (Ollama/vLLM).
* Centralized configuration in config/artemis.jsonc.
- Native MCP & Observability:
* Model Context Protocol (MCP) server endpoints for AI IDEs.
* Full trace recording with before/after screenshots, action overlays, and execution replays.
Change-Id: I430b93ee2b76b54cc5a3c6eeccd15d2cf29830a1
2026-08-13 11:46:47 -07:00
somew1nd