feat: prepare 2.2.0 with UI and execution fixes

Add dark theme, richer Markdown and readable plugin results.
Improve Android input evidence, response integrity and diagnostics.
Unify lifecycle, guidance receipts and evidence sources across clients.
Keep direct action dispatch without an added AI quota approval layer.
Align version metadata at 2.2.0 and bundle Helper 1.2.2.

Validation: 3063 backend tests before the version bump; 44 after.
Frontend: 317 tests and production build passed.
This commit is contained in:
chenmingxuan committed 2026-10-26 00:44:13 +08:00
1 parent 83bcfd54d5
commit fac4ccb760
146 files changed
+5689 -2033

No files matched your search

+27 -14
View File
@@ -27,7 +27,8 @@
"view_type"
],
"title": "mobile_get_device_stateArguments",
"type": "object"
"type": "object",
"additionalProperties": false
},
"outputSchema": {
"properties": {
@@ -89,7 +90,8 @@
}
},
"title": "mobile_diagnoseArguments",
"type": "object"
"type": "object",
"additionalProperties": false
},
"outputSchema": {
"additionalProperties": true,
@@ -99,7 +101,7 @@
},
{
"name": "mobile_inspect_trace",
"description": "Retrieves execution details of a mobile automation task (running or finished).\n\nUse it to monitor progress, verify answers, and diagnose agent errors for\nboth Flash and Pro tasks. Every result includes the assigned `device_serial`.\n\n### Actions\n- view_report / view_usage / view_requests / view_logs / view_evidence:\n bounded read-only report, measured token/cache totals, request phases and IDs,\n redacted log tails, or source-specific evidence index. offset/limit paginate;\n start with view_report, then inspect only relevant evidence. No export is generated.\n- **'view_summary'**: High-level execution summary across all steps.\n Pro: hierarchical task plan with per-step status; Flash: paginated execution\n chain with each step's reasoning and action.\n- **'search'**: Deterministic keyword / step-range lookup over the full\n stored history (screen descriptions, exact actions and results,\n reasoning, tool calls, notes, on-screen OCR/UI-tree text incl.\n package/activity names, compressed-history ledgers). Every hit carries\n its step number; a `step_range` also returns that range's per-step\n action ledger. Requires `query` and/or `step_range`.\n- **'view_step_screenshots'**: Local file paths of one step's screenshots:\n `before_screenshot` (what the agent saw), `after_screenshot` (when actually captured, otherwise null), and\n `action_overlay_screenshot` (the action visually marked — e.g. red circle\n for taps — key for verifying the agent tapped the right element).\n- **'view_step_details'**: Stored details of one step exactly as the agent's\n own context showed it: what the screen showed, its reasoning, every tool\n call it made (name, arguments, result — e.g. what the explorer or OCR\n reported), the planned action, any safety-net interception and the\n execution result. Coordinate units depend on the tool: Cua uses screenshot\n pixels; consult the recorded source geometry, never reuse another window. Works for Flash and\n Pro tasks.\n\nArgs:\n action: `\"view_summary\"`, `\"search\"`, `\"view_step_screenshots\"`, or\n `\"view_step_details\"`.\n trace_id: The task's session identifier from `mobile_run_task`.\n step_number: 1-indexed step to query; required for the two per-step\n actions, omit otherwise.\n query: Keywords for `\"search\"` (case-insensitive; every\n whitespace-separated term is matched independently).\n step_range: Optional `[start, end]` step range (inclusive) for\n `\"search\"`.\n max_results: Maximum `\"search\"` hits to return (server-side cap applies).\n",
"description": "Retrieves execution details of a mobile automation task (running or finished).\n\nUse it to monitor progress, verify answers, and diagnose agent errors for\nboth Flash and Pro tasks. Every result includes the assigned `device_serial`.\n\n### Actions\n- view_report / view_usage / view_requests / view_logs / view_evidence:\n bounded read-only report, measured token/cache totals, request phases and IDs,\n redacted log tails, or source-specific evidence index. offset/limit paginate;\n start with view_report, then inspect only relevant evidence. No export is generated.\n- **'view_summary'**: High-level execution summary across all steps.\n Pro: hierarchical task plan with per-step status; Flash: paginated execution\n chain with each step's reasoning and action. Returns summary Markdown plus\n steps.items (stored step_id/step_number), total/offset/limit/next_offset.\n- **'search'**: Deterministic keyword / step-range lookup over the full\n stored history (screen descriptions, exact actions and results,\n reasoning, tool calls, notes, on-screen OCR/UI-tree text incl.\n package/activity names, compressed-history ledgers). Every hit carries\n its step number; a `step_range` also returns that range's per-step\n action ledger. Requires `query` and/or `step_range`.\n- **'view_step_screenshots'**: Local file paths of one step's screenshots:\n `before_screenshot` (what the agent saw), `after_screenshot` (when actually captured, otherwise null), and\n `action_overlay_screenshot` (the action visually marked — e.g. red circle\n for taps — key for verifying the agent tapped the right element).\n- **'view_step_details'**: Stored details of one step exactly as the agent's\n own context showed it: what the screen showed, its reasoning, every tool\n call it made (name, arguments, result — e.g. what the explorer or OCR\n reported), the planned action, any safety-net interception and the\n execution result. Coordinate units depend on the tool: Cua uses screenshot\n pixels; consult the recorded source geometry, never reuse another window. Works for Flash and\n Pro tasks.\n\nArgs:\n action: `\"view_summary\"`, `\"search\"`, `\"view_step_screenshots\"`, or\n `\"view_step_details\"`.\n trace_id: The task's session identifier from `mobile_run_task`.\n step_number: 1-indexed step to query; required for the two per-step\n actions, omit otherwise.\n query: Keywords for `\"search\"` (case-insensitive; every\n whitespace-separated term is matched independently).\n step_range: Optional `[start, end]` step range (inclusive) for\n `\"search\"`.\n max_results: Maximum `\"search\"` hits to return (server-side cap applies).\n",
"inputSchema": {
"properties": {
"action": {
@@ -170,7 +172,8 @@
"trace_id"
],
"title": "mobile_inspect_traceArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -243,7 +246,8 @@
"action"
],
"title": "mobile_manage_taskArguments",
"type": "object"
"type": "object",
"additionalProperties": false
},
"outputSchema": {
"additionalProperties": true,
@@ -379,7 +383,8 @@
"task_desc"
],
"title": "mobile_run_taskArguments",
"type": "object"
"type": "object",
"additionalProperties": false
},
"outputSchema": {
"additionalProperties": true,
@@ -426,7 +431,8 @@
}
},
"title": "mobile_workspaceArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -465,7 +471,8 @@
}
},
"title": "mobile_configArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -498,7 +505,8 @@
"action"
],
"title": "mobile_task_fileArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -594,7 +602,8 @@
"action"
],
"title": "mobile_favoritesArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -659,7 +668,8 @@
"action"
],
"title": "mobile_batchArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -718,7 +728,8 @@
}
},
"title": "mobile_search_historyArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -774,7 +785,8 @@
}
},
"title": "mobile_export_reportArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
},
{
@@ -883,7 +895,8 @@
"action"
],
"title": "mobile_explorationArguments",
"type": "object"
"type": "object",
"additionalProperties": false
}
}
]