PhilArchive
open access
MCP-Driven Accessibility Tree Standardization for AI-Powered Screen Reader Agents
Contemporary assistive technology for users with visual impairments relies on platform-specific screen readers that communicate with applications through fragmented, vendor-defined accessibility APIs. This architectural fragmentation prevents AI agents from navigating heterogeneous digital environments in a consistent, reliable manner. This paper presents MCP-ARIA, a standardized server architecture that leverages the Model Context Protocol (MCP) to expose ARIA-compliant accessibility trees as structured tool outputs consumable by large language model (LLM) based agents. The proposed framework introduces three primary contributions: (1) a canonical JSON-LD schema that maps Web Content Accessibility Guidelines (WCAG) roles, labels, and focus sequences across web, desktop, and mobile platforms; (2) a latency-optimised request-response pipeline that reduces round-trip navigation overhead to below 120 ms compared to 1,840 ms for screenshot-based alternatives; and (3) persistent MCP resource primitives that encode user disability profiles to enable session-aware, personalised agent behaviour. Evaluation over 2,400 structured navigation tasks drawn from four heterogeneous environments yields an average task-completion accuracy of 91.7%, a macro-averaged F1 score of 0.91, and a mean accessibility-role classification precision of 0.92. These results demonstrate that a unified open protocol can supplant fragmented native APIs while simultaneously satisfying real-time latency constraints required in interactive assistive contexts.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- A qualitative study on the needs of visually impaired users in Brazil for smart home interactive technologies#1017097
- A Benchmarking Framework for Context-aware XR Interfaces#1104665
- Mobile Telehealth Systems: Accessibility and Security Challenges#170223
- The performance of individuals with severe physical disabilities on computer interface devices#488955
- Assistron: Bayesian Shared Autonomy with Off-the-shelf Vision-Language-Action Models#1116345
Record · ID 690955
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive