arXiv (All)
open access
Self-Aware Knowledge Probing: Evaluating Language Models' Relational Knowledge through Confidence Calibration
Knowledge probing quantifies how much relational knowledge a language model (LM) has acquired during pre-training. Existing knowledge probes evaluate model capabilities through metrics like prediction accuracy and precision. Such evaluations fail to account for the model's reliability, reflected in
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- CQ4OE: A benchmark for assessing LLM-assisted ontology generation from competency questions#1061934
- Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation#16596
- From Reasoning Traces to Reusable Modules: Understanding Compositional Generalization in Language Model Reasoning#282788
- Beyond Questions: Evaluating the Stated Knowledge of LLMs#1342496
- Evaluating Cognitive Capabilities in Large Language Models#690065
Record · ID 1296386
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive