chenmingxuan
1fdf7c0d1d
fix: bound task failures and release stalled workers
2026-10-08 16:10:10 +08:00
chenmingxuan
ab066733b8
feat: add configurable screenshot resolution limit
2026-09-29 17:12:22 +08:00
somew1nd
52749c7f23
feat: add managed accessibility helper with UIAutomator fallback
2026-09-10 19:40:26 -07:00
somew1nd
5d92939d91
refactor: unify agent history and harden runtime diagnostics
...
Preserve user guidance through history compression, stabilize Flash index targets, and retire withdrawn checks without applying stale verdicts.
Improve runtime diagnostics, tool responses, and history rendering. Simplify documentation and comments.
Validation: 2076 tests passed in the full suite; 381 affected tests and 26 frontend tests passed after cleanup. Ruff and the quality ratchet passed.
2026-09-09 21:35:40 -07:00
somew1nd
67248c887e
feat: improve task execution, verification and packaging
...
Add execution incidents, action bursts and shared Flash history.
Expose verification and Explorer settings with streamed check results.
Support graceful cancellation, recording recovery and bundled UI resources.
Add CI quality checks and clean up comments and documentation.
2026-09-02 21:45:51 -07:00
somew1nd
47e7cb6620
refactor(errors): replace silent exception handling in core packages
2026-09-01 15:54:49 -07:00
somew1nd
ea3708a98f
feat: implement robust multi-tier text input architecture and ADB diagnostics
...
- Android Text Input & IME Normalization:
- Implement progressive 3-tier input architecture in AndroidAdbDriver and AndroidDeviceController:
- Tier 1 (Primary): Zero-dependency clipboard injection + KEYCODE_PASTE (immune to IME Pinyin interception, full Unicode/Emoji support, preserves multiline formatting).
- Tier 2 (Broadcast): Base64 broadcast injection when ADBKeyboard is active.
- Tier 3 (Fallback): Native ADB physical keyevent fallback.
- Add literal newline normalization (\r\n, \n, \r) to prevent JSON escape string corruption (e.g. '10086\n' -> '10086、n').
- Add set_clipboard method to UIAutomatorClient without auxiliary APK requirements.
- Diagnostics & System Probes:
- Add adb_keys diagnostics probe for ADB key auth checks.
- Integrate diagnostics into CLI doctor command.
- Admin Console & Showcase UI:
- Improve model service and system router in admin console.
- Enhance workspace stream view and session state in showcase UI.
2026-08-24 16:48:45 -07:00
somew1nd
474e56ef8e
feat: support orientation-aware recording and device wakefulness
...
Roll scrcpy recordings by device rotation and duration, and publish timeline manifests for playback and analysis.
Add seamless segmented playback in the showcase UI and configurable stay-awake strategies for Android automation.
2026-08-22 19:45:02 -07:00
somew1nd
0f5fb1d32c
Improve task resilience and LLM retry visibility
...
Persist and publish recoverable provider retries so temporary 503 and throttling events remain visible in live and historical task streams.
Aggregate repeated retries into an expandable action card, preserve terminal pause recovery, harden Windows worker isolation and output forwarding, and retain reliable Android hierarchy fallbacks with regression coverage.
2026-08-20 00:37:53 -07:00
somew1nd
9a5aaf99b7
feat: introduce MCP server, cross-platform runtime, and Showcase UI reorganization
...
- Showcase UI Reorganization:
* Move web UI dashboard from root directory into apps/showcase_ui/ for cleaner project structure
* Add 'artemis ui' CLI command (artemis/interfaces/cli/commands/ui.py) and launcher scripts for the interactive showcase console
- Standalone MCP Server & Notifiers (mcp_server/):
* Implement dedicated MCP server package with mobile automation tools (device_state, inspect_trace, task_manager, task_runner)
* Add multi-channel notifiers (AgentAPI, Desktop notifications, Webhooks, File output, and Composite routing)
* Introduce background task runner and trace store for autonomous mobile execution monitoring
- Cross-Platform Runtime & Toolchain Support:
* Add artemis/platform/ with OS-specific implementations for Linux, macOS (Darwin), and Windows
* Add artemis/runtime/supervisor.py for resilient process and agent runtime supervision
* Add artemis/toolchain/ with dependency resolution and SDK descriptors
* Add cross-platform launcher scripts (start.sh, start.bat) and installer scripts (scripts/install_deps.*)
- Core Enhancements & Diagnostics:
* Enhance coordinate normalization, OCR API fallback, and perception pipeline
* Add credential validation (credentials_validator.py) and system diagnostics
* Update bilingual documentation (README.md, README_CN.md) and architecture diagrams
- Test Suite Expansion:
* Add integration tests for cloud gateway, remote ADB, and Artemis login
* Add unit tests covering core diagnostics, platform detection, toolchain, credentials validator, optional OCR, and MCP tools
2026-08-18 13:59:27 -07:00
somew1nd
206a9ce921
feat: initial release of ARTEMIS Android Agent & Automation Platform
...
ARTEMIS is an autonomous multimodal Android agent and mobile UI automation
platform engineered for physical devices and emulators. It combines state-of-the-art
multimodal Vision-Language Models (VLMs) with hierarchical closed-loop planning,
resilient self-healing, and deep Android subsystem integration.
Key Features & Architectural Highlights:
- Dual-Engine Orchestration:
* Pro Engine: Multi-agent closed-loop (Planner -> Operator -> Validator/Failure Analyzer -> Summarizer) powered by LangGraph.
* Flash Engine: Ultra-fast reactive loop for deterministic, low-latency UI execution (<35 steps).
- Multimodal Perception & Grounding:
* Hybrid visual screenshot grounding, real-time OCR extraction, and XML accessibility hierarchy parsing.
* Dynamic-First, Coordinate-Fallback locating strategy for maximum resilience against UI drift.
- Autonomous Self-Healing & Diagnostics:
* Failure analyzer and safety net for popup dismissal, crash recovery, and auto-retry.
* Diagnostic sub-agents for log analysis, video recording inspection, and object detection.
- Unified CLI & Python SDK:
* Rich CLI with commands: init, doctor, run, trace, batch, bench, server, and mcp.
* Fluent Python SDK with Pydantic structured output models and package locking.
- Multi-Provider LLM Architecture:
* Support for Google Gemini, OpenAI, Anthropic Claude, Vertex AI, OpenRouter, xAI Grok, and local endpoints (Ollama/vLLM).
* Centralized configuration in config/artemis.jsonc.
- Native MCP & Observability:
* Model Context Protocol (MCP) server endpoints for AI IDEs.
* Full trace recording with before/after screenshots, action overlays, and execution replays.
Change-Id: I430b93ee2b76b54cc5a3c6eeccd15d2cf29830a1
2026-08-13 11:46:47 -07:00