 yaoyao-open-source
|
2fd70465e6
|
feat(web): add interactive Angular web UI dashboard and execution visualizer
Introduces the full-featured, modern Angular 19 web dashboard for ARTEMIS.
Provides real-time multimodal agent stream visualization, live device feeds,
interactive step inspection, task queue management, and model telemetry.
Key Features & UI Architecture:
- Workspace & Layout:
* Split-pane responsive layout with draggable resizer bar for execution stream and chat/task panel.
* Standalone Angular components powered by Signals and reactive computed state.
- Real-Time Multimodal Agent Stream:
* SSE connection (/api/stream/:session_id) for live streaming of thoughts, actions, and tool calls.
* Hierarchical phase grouping (Planning -> Execution -> Verification -> Summary).
* Interactive step viewer with before/after screenshot overlays, coordinate pins, bounding boxes, and OCR text highlights.
* Live planning loader, error diagnostics banner, retry status indicator, and token usage metrics.
- Task Queue & Chat Interface:
* Goal submission with instant dispatch to backend runner (/api/run).
* Active task queue tracker (running, pending queue in FIFO order, completed/failed historical sessions).
* Session switcher with model info badges and Markdown notes viewer (e.g. task_plan.md).
- Floating Video Player & Live Stream:
* Draggable, floating video player overlay for reviewing session recordings and live device feeds (/api/stream/device-live).
* Playback controls: play/pause, seek scrubber, speed multipliers (0.5x - 4.0x), looping, and theater mode.
- Formatting & Parsing Utilities:
* Android UI action formatter (tap, type, swipe, drag, keyevent, app launch).
* Tool call formatter for ADB commands, note management, video inspection, and failure recovery.
* Markdown parsing and milestone checklist rendering.
|
2026-08-13 11:58:16 -07:00 |
|