benchmarks

Documents about benchmarks

• Who Benchmarks the Benchmarks? Towards Comprehensive Evaluation of Commonsense Reasoning Benchmarks#1084004arXiv (OAI Expanded)
• Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agents#432560arXiv CS
• Benchmarking the Benchmarks: Evaluating Automated Safety Benchmarks for Small Language Models#463173arXiv CS
• BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks#141568arXiv CS
• Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks#1186455arXiv (All)
• What AI Benchmarks Actually Measure: Adapting Convergent and Discriminant Validity to Interrogate Fifty-Six AI Benchmarks#986444arXiv (All)
• TestJack: Should you trust the results in coding benchmarks? Agentic Coding Benchmarks Auditing via Evaluator Evolution#1247546arXiv (All)
• Benchmarks for Associative Learning Models#637140PsyArXiv
• AI Model Benchmarks & Pricing Dataset 2026: Performance and Economics of Large Language Models#122327DataCite
• Swedish National Benchmarks in Laparoscopic Bariatric Surgery#398230ClinicalTrials.gov
• Considerations When Using Basic OSPF Convergence Benchmarks#500471IETF RFCs
• Rethinking Code Performance Benchmarks for LLMs#349685arXiv CS
• Benchmarks for Associative Learning Models#637089PsyArXiv
• Large Benchmarks for the Minimum-Cost Flow Problem#640173bonndata Dataverse OAI Archive
• EvalBuilder: Can LLMs Build Efficient Benchmarks?#1355035arXiv (All)
• Cognitive bias benchmarks should incorporate insights from ecological rationality#1505042PhilArchive
• Hardening Agent Benchmarks with Adversarial Hacker-Fixer Loops#267574arXiv CS
• How Benchmarks Mis-Score Computer-Use Agents#414155arXiv CS
• Auditing MCQA Benchmarks through Probability Landscapes#798156arXiv (OAI Expanded)
• Auditing MCQA Benchmarks through Probability Landscapes#799579arXiv (All)
• VeRA: Renewing Reasoning Benchmarks with Executable Specifications#1049754arXiv (All)
• How Reusable Are Benchmarks with Richer Feedback?#1116440arXiv (All)
• Benchmarks Are Surprisingly Compaction-Friendly#1446823arXiv (All)
• EpiCastBench: Datasets and Benchmarks for Multivariate Epidemic Forecasting#178958arXiv CS
• Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?#329114arXiv CS
• Auditing LLM Benchmarks with Item Response Theory#682701arXiv (OAI Expanded)
• Auditing LLM Benchmarks with Item Response Theory#684476arXiv (All)
• Circuit-level benchmarks of GKP-concatenated qLDPC Codes#1129876arXiv (All)
• Variational benchmarks for quantum many-body problems#1134240Infoscience
• OTel: Open Telco AI Datasets, Benchmarks, and Models#1217141arXiv (All)
• What Do RTL Repair Benchmarks Actually Measure?#1412652arXiv (All)
• Round-Trip Translation Reveals What Frontier Multilingual Benchmarks Miss#13130arXiv CS
• Making Intelligence: Ethical Values in IQ and ML Benchmarks#108955PhilArchive
• Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering#282850arXiv CS
• Artificial Intelligence in Orthodontics: From Laboratory Benchmarks to Clinical Care.#385168NCBI PubMed Central
• Ordinal Distributional Change and Conservative Transition Benchmarks: Measurement, Identification, and Inference#664207arXiv (OAI Expanded)
• Ordinal Distributional Change and Conservative Transition Benchmarks: Measurement, Identification, and Inference#665707arXiv (All)
• Fallacy Benchmarks Measure Scheme Recognition, Not Fallacy Detection#965429arXiv CS
• Ask Which, Not How Good: Sizing Benchmarks Scored by an LLM#1064331arXiv (All)
• AgBench: Agentic AI Benchmarks for Personal AI Devices#1143253arXiv (All)
• Time Series Forecasting Benchmarks Need Scenario-Grounded Stress Testing#1186922arXiv (All)
• BenchmarkAnything: Agent-Driven Construction of Simulator-Ready Microarchitecture Benchmarks#1233486arXiv (All)
• Sionna Bench: Towards Benchmarks in Wireless Communications#1402562arXiv (All)
• BenchMeUp: Building Software Engineering Benchmarks from Natural-Language Specifications#1468887arXiv (All)
• SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks#120622arXiv CS
• Audit Materiality and Audit Effort: Evidence From Materiality Benchmarks#224032DORAS
• Claim against Measurement: Statistical Artefacts in Quantum Error Mitigation Benchmarks#241561arXiv CS
• AttackonCTF: Defending Hardware Security Competition Benchmarks in the Age of LLMs#280131arXiv CS
• Exploring Differences Between Tabular Enterprise Data and Public Benchmarks#321841arXiv CS
• Human Capital, Not Model Benchmarks, Predicts Hybrid Intelligence in Forecasting#332559arXiv CS