 somew1nd
|
ea3708a98f
|
feat: implement robust multi-tier text input architecture and ADB diagnostics
- Android Text Input & IME Normalization:
- Implement progressive 3-tier input architecture in AndroidAdbDriver and AndroidDeviceController:
- Tier 1 (Primary): Zero-dependency clipboard injection + KEYCODE_PASTE (immune to IME Pinyin interception, full Unicode/Emoji support, preserves multiline formatting).
- Tier 2 (Broadcast): Base64 broadcast injection when ADBKeyboard is active.
- Tier 3 (Fallback): Native ADB physical keyevent fallback.
- Add literal newline normalization (\r\n, \n, \r) to prevent JSON escape string corruption (e.g. '10086\n' -> '10086、n').
- Add set_clipboard method to UIAutomatorClient without auxiliary APK requirements.
- Diagnostics & System Probes:
- Add adb_keys diagnostics probe for ADB key auth checks.
- Integrate diagnostics into CLI doctor command.
- Admin Console & Showcase UI:
- Improve model service and system router in admin console.
- Enhance workspace stream view and session state in showcase UI.
|
2026-08-24 16:48:45 -07:00 |
|
|
somew1nd
|
9a5aaf99b7
|
feat: introduce MCP server, cross-platform runtime, and Showcase UI reorganization
- Showcase UI Reorganization:
* Move web UI dashboard from root directory into apps/showcase_ui/ for cleaner project structure
* Add 'artemis ui' CLI command (artemis/interfaces/cli/commands/ui.py) and launcher scripts for the interactive showcase console
- Standalone MCP Server & Notifiers (mcp_server/):
* Implement dedicated MCP server package with mobile automation tools (device_state, inspect_trace, task_manager, task_runner)
* Add multi-channel notifiers (AgentAPI, Desktop notifications, Webhooks, File output, and Composite routing)
* Introduce background task runner and trace store for autonomous mobile execution monitoring
- Cross-Platform Runtime & Toolchain Support:
* Add artemis/platform/ with OS-specific implementations for Linux, macOS (Darwin), and Windows
* Add artemis/runtime/supervisor.py for resilient process and agent runtime supervision
* Add artemis/toolchain/ with dependency resolution and SDK descriptors
* Add cross-platform launcher scripts (start.sh, start.bat) and installer scripts (scripts/install_deps.*)
- Core Enhancements & Diagnostics:
* Enhance coordinate normalization, OCR API fallback, and perception pipeline
* Add credential validation (credentials_validator.py) and system diagnostics
* Update bilingual documentation (README.md, README_CN.md) and architecture diagrams
- Test Suite Expansion:
* Add integration tests for cloud gateway, remote ADB, and Artemis login
* Add unit tests covering core diagnostics, platform detection, toolchain, credentials validator, optional OCR, and MCP tools
|
2026-08-18 13:59:27 -07:00 |
|
|
Weilin Liu
|
c1803fcb86
|
feat(console): add Artemis Admin & Trace Console backend and management plane
Introduces the comprehensive developer/administrator control plane and trace
inspection console backend for the ARTEMIS mobile automation platform.
Key Features & Backend Architecture:
- Core Server & Modular Routing:
* FastAPI modular architecture with dedicated routers for sessions, steps, tasks, media, stream, and replay.
* Multi-layer repository pattern with SQLite persistence for sessions, traces, and step data.
- Task Control & Queue Management:
* FIFO asynchronous task queue service with support for single/batch goal execution and profile selection (Flash / Pro).
* Session lifecycle controls (run, pause, resume, stop, clear queue).
* Startup orphan cleanup and automatic older replay archiving.
- Live Telemetry & IPC Communication:
* High-performance IPC server for streaming real-time execution logs, agent thoughts, and tool invocations.
* Server-Sent Events (SSE) /api/stream/{session_id} endpoint for live UI updates.
- Real-Time Device Streaming:
* Live ADB screen capture and MJPEG frame generator (/api/stream/device-live).
* Device connectivity and state inspection endpoint (/api/stream/device-state).
- Trace Inspection & Step Replay Engine:
* Hierarchical call tree inspection, pre/post step screenshots, and action overlay metadata.
* Isolated single-step replay manager (/api/replay) for interactive debugging and validation.
|
2026-08-13 12:11:10 -07:00 |
|