ARTEMIS is an autonomous multimodal Android agent and mobile UI automation platform engineered for physical devices and emulators. It combines state-of-the-art multimodal Vision-Language Models (VLMs) with hierarchical closed-loop planning, resilient self-healing, and deep Android subsystem integration. Key Features & Architectural Highlights: - Dual-Engine Orchestration: * Pro Engine: Multi-agent closed-loop (Planner -> Operator -> Validator/Failure Analyzer -> Summarizer) powered by LangGraph. * Flash Engine: Ultra-fast reactive loop for deterministic, low-latency UI execution (<35 steps). - Multimodal Perception & Grounding: * Hybrid visual screenshot grounding, real-time OCR extraction, and XML accessibility hierarchy parsing. * Dynamic-First, Coordinate-Fallback locating strategy for maximum resilience against UI drift. - Autonomous Self-Healing & Diagnostics: * Failure analyzer and safety net for popup dismissal, crash recovery, and auto-retry. * Diagnostic sub-agents for log analysis, video recording inspection, and object detection. - Unified CLI & Python SDK: * Rich CLI with commands: init, doctor, run, trace, batch, bench, server, and mcp. * Fluent Python SDK with Pydantic structured output models and package locking. - Multi-Provider LLM Architecture: * Support for Google Gemini, OpenAI, Anthropic Claude, Vertex AI, OpenRouter, xAI Grok, and local endpoints (Ollama/vLLM). * Centralized configuration in config/artemis.jsonc. - Native MCP & Observability: * Model Context Protocol (MCP) server endpoints for AI IDEs. * Full trace recording with before/after screenshots, action overlays, and execution replays. Change-Id: I430b93ee2b76b54cc5a3c6eeccd15d2cf29830a1
68 lines
1.4 KiB
Docker
68 lines
1.4 KiB
Docker
FROM python:3.12-slim
|
|
|
|
WORKDIR /app
|
|
|
|
# Install necessary build tools
|
|
RUN apt-get update && apt-get install -y --no-install-recommends \
|
|
build-essential \
|
|
curl \
|
|
git \
|
|
adb \
|
|
&& rm -rf /var/lib/apt/lists/*
|
|
|
|
# Copy application source code and apps
|
|
COPY artemis/ /app/artemis/
|
|
COPY apps/ /app/apps/
|
|
COPY config/ /app/config/
|
|
COPY pyproject.toml setup.py README.md LICENSE /app/
|
|
|
|
# Install server and core dependencies
|
|
RUN pip install --no-cache-dir \
|
|
uvicorn \
|
|
fastapi \
|
|
pydantic \
|
|
pydantic-settings \
|
|
python-dotenv \
|
|
sseclient-py \
|
|
websockets \
|
|
adbutils \
|
|
jinja2 \
|
|
colorama \
|
|
psutil \
|
|
httpx \
|
|
retry \
|
|
google-auth \
|
|
langchain \
|
|
langchain-core \
|
|
langchain-community \
|
|
langchain-google-genai \
|
|
langchain-google-vertexai \
|
|
langchain-mcp-adapters \
|
|
google-genai \
|
|
langgraph \
|
|
typer \
|
|
pillow \
|
|
packaging \
|
|
uiautomator2 \
|
|
opencv-python-headless \
|
|
uuid-utils \
|
|
posthog \
|
|
mcp \
|
|
inquirer \
|
|
rich \
|
|
requests \
|
|
imageio-ffmpeg \
|
|
langchain-openai
|
|
|
|
# Install artemis package locally (no-deps to prevent pulling unnecessary heavy optional libraries)
|
|
RUN pip install --no-cache-dir --no-deps -e /app
|
|
|
|
ENV PYTHONUNBUFFERED=1
|
|
ENV PYTHONPATH=/app
|
|
ENV ARTEMIS_APP_DIR=/app
|
|
ENV PORT=8080
|
|
|
|
EXPOSE 8080
|
|
|
|
CMD ["uvicorn", "apps.admin_console.server:app", "--host", "0.0.0.0", "--port", "8080"]
|