arXiv (All)
open access
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems
As agentic LLM systems move from prototypes to deployment, evaluating them has become more important and more difficult. Evaluation goals are often left implicit. Without a clear account of what a system is expected to do, how it can fail, and which failures matter, metric choices become difficult t
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Evaluating LLM Agents on Automated Software Analysis Tasks#10421
- LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarios#1156205
- CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology#1199619
- ForesightSafety-SAGE:A Fully Automated Scenario Generation and Safety Evaluation Framework for LLM Agents#800068
- Agentic Cognitive Depth: Operational Criteria for Evaluating LLM Agents#1199442
Record · ID 1325194
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive