somew1nd
a36a66ce6d
feat: add step-by-step visual replay and harden process lifecycle
...
- UI: Implement dual-mode playback in FloatingVideoPlayer supporting video and step-by-step frame replay with scrub controls and auto-fallback
- Runtime: Prevent asyncio event loop hangs on Darwin and Linux by avoiding psutil.wait_procs on direct child processes
- Task Queue: Add worker exit watchdog and automatic recording recovery for completed or interrupted sessions
- Recording: Add ffmpeg ultrafast transcode fallback, shield recording finalization against cancellation, and handle on-the-fly MP4 conversion
- Docs: Polish README_CN styling and streamline flash runner agent prompt
2026-08-26 00:53:24 -07:00
somew1nd
bb16991f2c
feat: harden video analysis and runtime resilience
2026-08-25 20:58:25 -07:00
somew1nd
ea3708a98f
feat: implement robust multi-tier text input architecture and ADB diagnostics
...
- Android Text Input & IME Normalization:
- Implement progressive 3-tier input architecture in AndroidAdbDriver and AndroidDeviceController:
- Tier 1 (Primary): Zero-dependency clipboard injection + KEYCODE_PASTE (immune to IME Pinyin interception, full Unicode/Emoji support, preserves multiline formatting).
- Tier 2 (Broadcast): Base64 broadcast injection when ADBKeyboard is active.
- Tier 3 (Fallback): Native ADB physical keyevent fallback.
- Add literal newline normalization (\r\n, \n, \r) to prevent JSON escape string corruption (e.g. '10086\n' -> '10086、n').
- Add set_clipboard method to UIAutomatorClient without auxiliary APK requirements.
- Diagnostics & System Probes:
- Add adb_keys diagnostics probe for ADB key auth checks.
- Integrate diagnostics into CLI doctor command.
- Admin Console & Showcase UI:
- Improve model service and system router in admin console.
- Enhance workspace stream view and session state in showcase UI.
2026-08-24 16:48:45 -07:00
somew1nd
42b8988661
feat: add global device queue and readiness tracking
2026-08-24 14:34:17 -07:00
somew1nd
a62ac4aef1
fix: finalize recordings before automatic replay
2026-08-23 13:06:19 -07:00
somew1nd
474e56ef8e
feat: support orientation-aware recording and device wakefulness
...
Roll scrcpy recordings by device rotation and duration, and publish timeline manifests for playback and analysis.
Add seamless segmented playback in the showcase UI and configurable stay-awake strategies for Android automation.
2026-08-22 19:45:02 -07:00
somew1nd
71e5bba551
runtime: harden LLM retry handling and operator workflows
2026-08-21 00:34:44 -07:00
somew1nd
0f5fb1d32c
Improve task resilience and LLM retry visibility
...
Persist and publish recoverable provider retries so temporary 503 and throttling events remain visible in live and historical task streams.
Aggregate repeated retries into an expandable action card, preserve terminal pause recovery, harden Windows worker isolation and output forwarding, and retain reliable Android hierarchy fallbacks with regression coverage.
2026-08-20 00:37:53 -07:00
somew1nd
4927c4f0b9
Stabilize task execution and UI lifecycle
2026-08-19 00:47:45 -07:00
somew1nd
c78c201e94
Fix setup UI and improve CLI workflows
2026-08-18 22:35:05 -07:00
somew1nd
9a5aaf99b7
feat: introduce MCP server, cross-platform runtime, and Showcase UI reorganization
...
- Showcase UI Reorganization:
* Move web UI dashboard from root directory into apps/showcase_ui/ for cleaner project structure
* Add 'artemis ui' CLI command (artemis/interfaces/cli/commands/ui.py) and launcher scripts for the interactive showcase console
- Standalone MCP Server & Notifiers (mcp_server/):
* Implement dedicated MCP server package with mobile automation tools (device_state, inspect_trace, task_manager, task_runner)
* Add multi-channel notifiers (AgentAPI, Desktop notifications, Webhooks, File output, and Composite routing)
* Introduce background task runner and trace store for autonomous mobile execution monitoring
- Cross-Platform Runtime & Toolchain Support:
* Add artemis/platform/ with OS-specific implementations for Linux, macOS (Darwin), and Windows
* Add artemis/runtime/supervisor.py for resilient process and agent runtime supervision
* Add artemis/toolchain/ with dependency resolution and SDK descriptors
* Add cross-platform launcher scripts (start.sh, start.bat) and installer scripts (scripts/install_deps.*)
- Core Enhancements & Diagnostics:
* Enhance coordinate normalization, OCR API fallback, and perception pipeline
* Add credential validation (credentials_validator.py) and system diagnostics
* Update bilingual documentation (README.md, README_CN.md) and architecture diagrams
- Test Suite Expansion:
* Add integration tests for cloud gateway, remote ADB, and Artemis login
* Add unit tests covering core diagnostics, platform detection, toolchain, credentials validator, optional OCR, and MCP tools
2026-08-18 13:59:27 -07:00
somew1nd