Conceptio › Archive › arXiv CS
arXiv CS open access

VIDS-Seg: Towards Reliable Uncertainty Quantification in Pediatric Cardiac Ultrasound Segmentation

2026 · arxiv_cs
arXiv CS · Papers · 2026
Open Source ↗Direct PDF ↓
deep-learningmachine-learningneural-networks
Conceptio Open Archive

Analyze & explore related research in Conceptio

Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.

VIDS-Seg: Towards Reliable Uncertainty Quantification in Pediatric Cardiac Ultrasound Segmentation Paul Fischera , Ece Özkan Elsena

arXiv:2608.10903v1 [cs.CV] 11 Aug 2026

a

Department of Biomedical Engineering, University of Basel, Basel, Switzerland

Abstract Reliable clinical deployment of machine learning requires models that know when they are likely to fail, particularly for subgroups underrepresented in training data. A common case is pediatric care, where models trained on adult cohorts can silently under-perform on children with no indication that something has gone wrong. As retraining with labeled pediatric data is often infeasible, detecting such failures at inference time is a critical clinical need. Building on the VIDS (Variational Inference under Distribution Shifts) framework, we introduce VIDS-Seg, which applies amortized variational inference over a lightweight prediction head to make this adaptive, OOD-aware prior tractable for dense image segmentation. We evaluate VIDS-Seg on left ventricular segmentation in echocardiography, a setting where pediatric anatomy differs systematically from the adult population most segmentation models are trained on, training on an adult cohort (EchoNet-Dynamic) and evaluating zero-shot on a pediatric cohort (EchoNet-Pediatric). Across all age strata, VIDS-Seg matches competitive baselines in segmentation accuracy while producing substantially higher spatial correspondence between predicted uncertainty and segmentation error, an advantage that persists even after applying temperature scaling to all baselines. Downstream, it yields more accurate and stable ejection fraction estimates and more reliable detection of cardiac malfunction in the infant subgroup. Our results indicate that OOD-aware uncertainty quantification can serve as a practical safety layer for deployed segmentation models, enabling detection of silent failures in underrepresented subgroups without retraining or additional labeled data. Email address: paul.fischer@unibas.ch (Paul Fischer)

Keywords: Medical image analysis, Deep learning, Segmentation, Ultrasound, Echocardiography, Uncertainty quantification 1. Introduction Machine learning is rapidly becoming a practical tool in clinical medicine. The number of AI-enabled medical devices cleared by the U.S. Food and Drug Administration has grown substantially over the past decade [1], spanning applications from radiology and pathology to cardiology. This clinical adoption brings new demands for reliability: a model that performs well on the population it was trained on may fail systematically when deployed on a different one. A particularly consequential example of such a distributional mismatch arises when models trained predominantly on adult cohorts are applied to pediatric patients [2]. Children differ substantially from adults in anatomy, physiology, and image acquisition characteristics [3]. A natural response would be to train and evaluate models specifically on pediatric data. In practice, however, this is rarely sufficient. Large, richly annotated pediatric datasets are scarce relative to their adult counterparts, and even where pediatric data exist, children are not a homogeneous population. Anatomy and physiology change rapidly from infancy through adolescence, so a model trained broadly on “pediatric” data can itself exhibit the same silent underperformance on specific pediatric subgroups, such as infants, that motivates this work in the first place. The challenge is therefore not specific to the adult–child boundary but reflects a more general problem: detecting when a model is unreliable for any subgroup underrepresented in its training distribution. Deploying an adult-trained model in a pediatric setting without awareness of this mismatch can produce systematic, clinically relevant errors. Left undetected, such errors may lead to incorrect diagnoses, biased treatment decisions, and unequal care for an already vulnerable population [4, 5]. This effectively establishes a two-tier standard of care, raising both clinical safety and robustness concerns. Out-of-distribution (OOD) detection and uncertainty quantification (UQ) have attracted considerable attention in the machine learning community as potential tools for identifying exactly this kind of failure [6, 7, 8]. OOD detection methods aim to flag inputs that lie far from the training distribution, while UQ methods aim to provide calibrated confidence estimates that track the model’s actual error rate. Together they offer the prospect of models that 2

“know what they don’t know”. In clinical imaging, uncertainty estimates are increasingly being studied not merely as a technical property but for their direct clinical utility such as flagging uncertain predictions for expert review, identifying cases that require additional data acquisition, or triggering escalation to specialist care [9]. Alongside this, there is growing recognition that proper evaluation of uncertainty is essential. Properties such as calibration, coverage, and spatial correspondence between uncertainty and error are now actively studied [10]. A critical but underappreciated limitation of most UQ methods, however, is that their desirable properties, calibration, coverage, and appropriate uncertainty magnitude, are typically established and evaluated on indistribution test data. There is no general mechanism by which standard UQ methods should produce higher uncertainty for inputs that lie outside the training distribution [11]. This is especially problematic when the OOD group is also the group with the worst predictive performance: the model fails silently, producing confident but incorrect predictions. In practice, an adult-trained cardiac segmentation model deployed in a pediatric clinic may produce plausible-looking segmentations for most children while systematically failing for the youngest and most anatomically atypical patients, without any indication in the model’s output that something has gone wrong. Even where labeled pediatric data can be obtained, annotation is costly and may not be available for every relevant subgroup at the point of deployment [12, 13]. In many clinical settings, the realistic question is therefore not how to eliminate every possible performance gap through retraining, but how to reliably detect such gaps at inference time so that appropriate human oversight can be triggered. Detecting such silent, systematic failures is not merely a technical curiosity but rather a prerequisite for the robust and safe deployment of machine learning in diverse clinical populations [14]. The recently introduced VIDS framework [15] offers a promising approach to this problem. By introducing an adaptive prior that conditions on test covariates, VIDS is explicitly designed to increase uncertainty for inputs that deviate from the training distribution, addressing the silent-failure problem at its root. However, VIDS was introduced and evaluated only for classification and regression tasks. Segmentation, often used in medical image analysis for analyses such as volume estimation, disease staging, and treatment planning, was not considered. Adapting VIDS to dense pixel-level prediction is non-trivial. Applying amortized variational inference over the full parameter space of a modern segmentation network is computationally intractable, and 3

the spatial structure of both inputs and outputs demands new design choices in the embedding and energy-function components of the framework. In this work we address these gaps. Our main contributions are: • VIDS-Seg: We extend the VIDS framework to dense segmentation by applying amortized variational inference over a lightweight prediction head. This decomposition makes the variational problem tractable while preserving the OOD-awareness of the adaptive prior, and requires no retraining of the core segmentation network. • Empirical OOD identification and uncertainty evaluation: We systematically evaluate uncertainty quality across age-stratified pediatric subgroups, identifying infants as the OOD population and demonstrating that VIDS-Seg produces significantly better spatial correspondence between uncertainty and prediction error compared to other popular baselines. • Downstream clinical impact: We show that the higher-quality uncertainty from VIDS-Seg translates into more accurate and stable ejection fraction estimates for the OOD subgroup, illustrating that uncertainty quality has direct consequences for clinical decision-making derived from model predictions. • Positioning relative to post-hoc calibration: We show that pure post-hoc calibration cannot substitute for an OOD-aware prior under unknown subgroup shift and that VIDS-Seg composes with rather than competes against them. 2. Related Work 2.1. Probabilistic and Uncertainty-Aware Segmentation Probabilistic segmentation methods aim to produce uncertainty estimates alongside predictions. PHiSeg [16] introduced a hierarchical latent variable model to capture multi-scale aleatoric uncertainty arising from annotation ambiguity. [17] provide a comprehensive review of uncertainty quantification in deep learning for medical image analysis, noting that ensemble methods and Monte Carlo dropout remain the most widely deployed approaches in practice. A shared limitation of all these methods is that their uncertainty properties are typically validated on in-distribution data, without explicit treatment of covariate shift. 4

2.2. Out-of-Distribution Detection in Medical Segmentation Several works have studied the problem of detecting OOD inputs specifically in the context of segmentation. [10] evaluated a range of uncertainty frameworks for OOD detection in multiple sclerosis lesion segmentation, finding that predictive uncertainty from standard binary segmentation models often fails to detect OOD inputs reliably, while multi-label approaches show improvement. [18] explored self-supervised OOD detection for cardiac segmentation in Cine Magnetic Resonance Images, demonstrating that selfsupervised signals can help identify distribution shifts without explicit OOD supervision. While these methods detect or adapt to distribution shift, none of them provides a principled probabilistic mechanism to condition uncertainty on the relationship between training and test distributions, which is the core contribution of our approach. VIDS [15] takes a fundamentally different approach by introducing an adaptive prior over network parameters that is conditioned on both training and test covariates, explicitly modeling the dependence of uncertainty on distributional novelty. 2.3. Relation to Post-hoc Calibration VIDS-Seg targets a different failure mode than post-hoc calibration methods, and the two are complementary rather than competing. Temperature scaling and conformal prediction adjust an existing uncertainty signal: a single scalar temperature, or a single conformal score threshold, is estimated on a calibration set and applied uniformly at test time. Two properties follow. First, per-pixel temperature scaling is a monotone transformation of the predicted confidence and therefore leaves the spatial ordering of entropy within an image largely intact. It can correct the magnitude of uncertainty but not its location. Second, the coverage guarantees of split conformal prediction require exchangeability between the calibration and test sets. This is precisely the assumption violated under covariate shift. Class- or group-conditional variants restore guarantees only when subgroup membership is known at test time, which is exactly the information unavailable in the deployment scenario we consider: the model is not told that the patient is an infant. Conformalizing dense segmentation introduces further difficulty, as prediction sets must be defined over spatial structures rather than scalars [19]. Our contribution is therefore situated upstream of calibration: we aim to improve the quality of the base uncertainty estimate, in particular its spatial correspondence with error under shift, which any subsequent calibration 5

Figure 1: VIDS-Seg overview. The U-Net backbone (gray) is frozen. For each environment, training images are embedded and spatially pooled to form a context summary (mean and std across images). Each test image is also embedded and pooled. The inference network hγ takes the concatenated context and test embedding and outputs the parameters of the variational distribution qϕ (θ) over the prediction-head parameters. The predictive entropy map serves as the pixel-level uncertainty estimate.

step inherits. We make this concrete in Section 4.2.2, where we show that temperature scaling fitted on in-distribution (adult) data leaves the relative ordering of methods unchanged, and that VIDS-Seg remains the strongest base estimator with and without post-hoc adjustment. 3. Methods We build on VIDS [15], a Bayesian approach for uncertainty quantification under covariate shift, and extend it to the task of dense image segmentation. Section 3.1 summarizes the key ideas of VIDS that are necessary to understand our extension. Sections 3.2–3.4 describe VIDS-Seg. 3.1. VIDS: Variational Inference under Distribution Shifts Let D = {(xi , yi )}N i=1 denote the training set, where xi ∈ X are input covariates and yi ∈ Y are labels. Let θ ∈ Rdθ denote the parameters of a predictive network fθ , and let x∗ ∈ X be a new test covariate drawn from a potentially shifted distribution. In a standard Bayesian neural network, the posterior predictive distribution is Z ∗ ∗ p(y | x , x1:N , y1:N ) = p(y ∗ | x∗ , θ) p(θ | x1:N , y1:N ) dθ, (1) 6

where p(θ | x1:N , y1:N ) is the posterior over parameters. Because x∗ does not enter the posterior, this formulation cannot raise uncertainty when x∗ lies far from the training distribution. VIDS addresses this by replacing the fixed prior p(θ) with an adaptive prior p(θ | x1:N , x∗ ) conditioned on both training covariates and the test point, defined via an energy function: Z  PN ∗ ∗ p(θ | x1:N , x ) ∝ exp (2) i=1 log p(y | xi , θ) + log p(y | x , θ) dy . This causes the posterior over θ, and therefore the predictive uncertainty, to widen whenever x∗ is novel relative to x1:N . Since the resulting posterior is intractable, VIDS fits an amortized variational distribution qϕ (θ; x∗ ), where the parameters ϕ = (µ, σ 2 ) are produced by an inference network hγ : (µ, log σ) = hγ (ḡ(x1:n ), ĝ(x∗ )) ,

(3)

P with ĝ : X → Rk a pre-trained embedding network, ḡ(x1:n ) = n1 ni=1 ĝ(xi ) a permutation-invariant summary of the context set {xi }ni=1 , and hγ a fullyconnected network with learnable weights γ. The variational parameters are optimized by maximizing the Evidence Lower Bound (ELBO): L(ϕ; x∗ , D) = Eqϕ [log p(y1:N | x1:N , θ)] − KL(qϕ (θ; x∗ ) ∥ p(θ | x1:N , x∗ )) . (4) Since shifted test covariates are unavailable at training time, VIDS constructs L synthetic environments {e(ℓ) }Lℓ=1 by drawing small bootstrap subsamples (ℓ) (ℓ) (Dtr , Dte ) from D, each of size n and m respectively. Because low-probability subsamples deviate from the empirical distribution of D, they simulate plausible covariate shifts. The inference network is optimized over all environments using a cross-environment objective with a variance penalty [20]: L=

L  1 X (ℓ) L − τ Var L(1) , . . . , L(L) , L ℓ=1

(5)

where L(ℓ) is the ELBO on environment ℓ, and τ > 0 is the variance-penalty weight. At test time, S samples θ(s) ∼ qϕ are drawn via the reparametrization trick (θ = µ + σ ⊙ ε, ε ∼ N (0, I)) and used to form the posterior predictive distribution. 7

3.2. VIDS-Seg The original VIDS framework was designed for classification and regression tasks, where the prediction network is a compact fully-connected model. Applying amortized variational inference naively to a full segmentation network such as a U-Net is infeasible: a standard U-Net has on the order of 107 –108 parameters [21], making the variational posterior over θ intractably high-dimensional and the inference network hγ prohibitively large. Variational inference on the prediction head only. We observe that the vast majority of a U-Net’s parameters are responsible for building a rich, spatially structured feature representation: the encoding and decoding pathway. The final prediction (i.e., the assignment of a class to each pixel) is performed by a lightweight 1×1 convolution that maps the feature map to class logits. We therefore decompose the network into two components with very different roles, and apply variational inference only to the latter: • Embedding network gξ (frozen after pre-training): The full UNet except its final layer, comprising the encoder, bottleneck, and decoder up to the last feature map. Given an input image x ∈ RC×H×W , it produces a dense embedding gξ (x) ∈ RD×H×W , preserving the full spatial resolution. This network is pre-trained to convergence on the segmentation task using a standard supervised loss, then frozen for all subsequent VIDS training. • Segmentation prediction head fθ (stochastic): A single 1×1 convolution with weight matrix W ∈ RCout ×D and bias b ∈ RCout , such that θ = vec(W, b) has dimension dθ = D · Cout + Cout . For binary segmentation (Cout = 2), this yields dθ = 2D + 2, which is small enough for amortized variational inference to be tractable. The prediction for image x under parameters θ is fθ (gξ (x)) = W ⋆ gξ (x) + b ∈ RCout ×H×W ,

(6)

where ⋆ denotes a 1×1 convolution. This decomposition means the inference network hγ only needs to produce parameters for the small 1×1 convolution rather than for the entire U-Net, making the approach computationally feasible. Figure 1 summarizes this architecture 8

Spatial aggregation for the inference network. In the original VIDS, embeddings are scalar vectors, and P the training-set summary is simply the mean embedding ḡ(x1:n ) = n1 ni=1 gξ (xi ). For dense image embeddings gξ (xi ) ∈ RD×H×W , we first reduce each image to a global descriptor by spatial average pooling, yielding g̃(xi ) ∈ RD . We then form a richer summary of the context set by concatenating the sample mean and sample standard deviation across images in the environment: " n # 1X ḡ(x1:n ) = g̃(xi ) stdi (g̃(xi )) ∈ R2D . (7) n i=1 Together with the test image embedding gξ (x∗ ), these form the input to the inference network (Equation (3)), which in VIDS-Seg takes dimension 4D input and outputs the mean µ ∈ Rdθ and log-standard-deviation log σ ∈ Rdθ of the variational posterior over the prediction-head parameters. Segmentation-adapted energy function. The original VIDS energy function integrates over the output space Y. For classification, this is a summation over class labels; for regression, a Monte Carlo integral over the real line. For segmentation, the output is a spatial probability map, and the energy function is adapted accordingly. For a predicted logit map ŷ = fθ (gξ (x)) ∈ RC×H×W , we compute the pixel-averaged log-probability under the predictive distribution: N X 1 X 1 X ∗ log p(yhw | xi , θ) + log p(yhw | x∗ , θ). E(θ; x1:N , x ) = HW h,w HW h,w i=1 ∗

(8) Averaging over spatial locations rather than summing ensures the energy scale is independent of image resolution, which is important for stability across datasets with different image sizes. Segmentation log-likelihood. The reconstruction term in the ELBO (Equation (4)) uses a pixel-wise cross-entropy loss, averaged over pixels and then summed over the batch: N

log p(y1:N | x1:N , θ) = −

1 XX CE(fθ (gξ (xi ))hw , yi,hw ) , N i=1 h,w

where yi,hw ∈ {0, 1} is the ground-truth binary label at pixel (h, w). 9

(9)

3.3. Two-Stage Training Procedure Training VIDS-Seg proceeds in two stages. Stage 1: Pre-training the embedding network. We train the full U-Net (embedding network gξ plus a temporary 1×1 convolution head) on the segmentation task using a hybrid loss: Lpre = αCE LCE + (1 − αCE ) LDice ,

(10)

After convergence, the temporary head is discarded and the embedding network weights ξ are frozen. This stage establishes a strong, task-relevant feature representation before variational inference is introduced. Stage 2: Variational fine-tuning with synthetic environments. The inference network hγ and the stochastic prediction head parameters θ (sampled via the reparametrization trick) are jointly optimized using the cross-environment ELBO (Equation (5)). The total loss is the negative mean ELBO plus a variance penalty (Equation (5)).Only hγ is updated; gξ remains frozen throughout the fine-tuning. 3.4. Inference and Uncertainty Estimation At test time, given training images {xi }N i=1 as the context set and a new ∗ image x , we estimate the segmentation and its associated uncertainty as summarized in Algorithm 1. The entropy map H serves as our pixel-level uncertainty estimate, where high entropy indicates that the sampled parameter vectors disagree on the label at that location. By design of the adaptive prior, this should occur more frequently for OOD inputs. 4. Experiments and Results 4.1. Experimental Setup 4.1.1. Datasets We evaluate our method on two publicly available datasets on echocardiography.

10

Algorithm 1 VIDS-Seg Inference and Uncertainty Estimation ∗ Require: Training images {xi }N i=1 , test image x , frozen embedding network gξ , inference network hγ , number of samples S Ensure: Predicted segmentation ŷ, entropy map H 1: Compute context summary ḡ(x1:N ) via Equation (7) ▷ Context set embedding 2: Compute test embedding gξ (x∗) 3: (µ, log σ) ← hγ ḡ(x1:N ), gξ (x∗ ) ▷ Variational posterior parameters 4: for s = 1 to S do  5: Sample θ(s) ∼ N µ, diag(σ 2 ) ▷ Reparametrization trick  (s) ∗ 6: p:,h,w ← fθ(s) gξ (x ) :,h,w ▷ Per-sample probability map 7: end for PS (s) ▷ Mean predictive probability 8: p̄hw,c ← S1 s=1 phw,c 9: ŷhw ← arg maxc p̄hw,c ▷ Final segmentation mask H×W (s) S ▷ Pixel-level 10: Compute entropy map H ∈ R from {p }s=1 uncertainty 11: return ŷ, H EchoNet-Dynamic [22]. EchoNet-Dynamic is a large-scale dataset of apicalfour-chamber echocardiography videos acquired from adult patients at Stanford University Medical Center. It comprises over 10,000 studies, each accompanied by frame-level expert tracings of the left ventricular (LV) endocardium at end-diastole (ED) and end-systole (ES), as well as ground-truth ejection fraction (EF) measurements. We use this dataset as the in-distribution (ID) training source, since all subjects are adults. EchoNet-Pediatric [23]. EchoNet-Pediatric contains echocardiography data from pediatric patients spanning a wide age range from infancy through adolescence. Similar to EchoNet-Dynamic, the dataset provides LV tracings at ED and ES frames together with clinician-measured EF values. We use the whole pre-processed data of the apical-4-chamber view of this dataset exclusively for evaluation, treating it as the target domain to study the model’s behavior under covariate shift induced by the transition from adult to pediatric cardiac anatomy.

11

4.1.2. Pre-processing and Segmentation Mask Generation Neither dataset provides binary segmentation masks directly. Instead, annotations are given as contour-tracing representations of the LV boundary at the ED and ES frames. To obtain binary segmentation masks, we applied a contour-filling algorithm using the OpenCV library [24]. We rasterized each tracing onto the corresponding video frame and filled the enclosed region to produce a pixel-wise binary mask. To verify the geometric correctness of the resulting masks, we inverted the process by re-deriving the tracing representation from the binary mask and re-computing the EF estimate via Simpson’s biplane method [25]. Subjects for whom the re-derived EF deviated by more than 5% (absolute) from the reference EF provided in the dataset were excluded, ensuring that any segmentation artifacts introduced by the rasterization step did not corrupt the evaluation. Because tracings are only available at the ED and ES frames, segmentation masks, and therefore EF estimates, can be computed for exactly two frames per study. 4.1.3. Baseline Methods and Training All models are trained on EchoNet-Dynamic (adults only) and evaluated on EchoNet-Pediatric (children only) on a single NVIDIA A100 GPU. Deep Ensemble. We train an ensemble of M = 10 U-Nets [26], each with the same standard architecture but a different random initialization. Each member is trained independently with the Adam optimizer (learning rate 1 × 10−4 ) using a hybrid cross-entropy / soft-Dice loss (αCE = 0.5) until convergence, with a maximum budget of 8 hours; all members converged within this limit. At inference time, each member produces one probability map, and the M maps are treated as equally-weighted samples for computing the predictive distribution and pixel-wise uncertainty. PHiSeg [16]. PHiSeg is a hierarchical probabilistic segmentation model that captures uncertainty through a multi-scale latent variable framework. We use the official implementation with the default hyperparameters of [16]. At inference time, 20 posterior samples are drawn to approximate the predictive distribution. VIDS-Seg (Ours). Training proceeds in two stages. Stage 1: The U-Net backbone is pre-trained with the same hybrid loss and optimizer settings as the Ensemble members for 30 epochs. Stage 2: The backbone is frozen and 12

the inference network hγ together with the 1 × 1 prediction head are finetuned for 30 epochs using the cross-environment ELBO (Equation (5)) with L = 40 synthetic environments of size n = 32, KL weight λKL = 0.1, and variance-penalty weight τ = 10−3 . The framework is trained using the Adam optimizer with a learning rate of 1×10−4 . At inference time, S = 20 samples of θ are drawn from the variational posterior. Code will be made available upon acceptance. 4.2. Results 4.2.1. Identifying the OOD Subgroup: Segmentation Performance Across Age Groups Motivation. Children constitute a highly heterogeneous population: a teenager may be anatomically far more similar to an adult than an infant. It is therefore not immediately obvious which pediatric subgroup, if any, should be considered out-of-distribution with respect to models trained on adults. To identify the subgroup that poses the greatest challenge for adult-trained models, and thus constitutes our primary OOD evaluation population, we stratify EchoNet-Pediatric into five clinically meaningful age groups [27] and measure segmentation performance for each. Evaluation protocol. We define the following age strata: infants ([0, 1) years, n = 304), toddlers ([1, 3) years, n = 442), pre-schoolers ([3, 6) years, n = 702), school-age children ([6, 13) years, n = 1982), and teenagers ([13, 18] years, n = 2366), totaling n = 5796 segmentations. All models are trained solely on EchoNet-Dynamic and evaluated on each stratum. Segmentation performance is measured by the Dice Similarity Coefficient (DSC) and the 95th percentile Hausdorff Distance (HD95) between the ground-truth binary mask and the model’s main prediction, defined as the mean of the per-sample logit predictions thresholded at 0.5. Findings. Figure 2 reports DSC and HD95 for all methods across age groups. All models achieve consistently high segmentation performance (DSC > 0.90) on toddlers, pre-schoolers, school-age children, and teenagers. In contrast, the infant group shows a pronounced and statistically significant performance drop to DSC ≈ 0.84 − 0.85 across all methods, along with markedly higher intra-group variance. Similarly, we observe an under-performance on the infant group for HD95 compared to the other groups. Crucially, this degradation is consistent across all three methods, indicating that the effect is driven 13

Ensemble

Dice Score

0.8 0.6 0.4

infa

PHiSeg 8 6 4 2 0

VIDS-Seg

HD95 (pixel)

1.0

nt

dler

tod

er ge ler nag ol a hoo e o c e s h t sc pre Age Group

nt

infa

dler

tod

er ge ler nag ol a hoo e o c e s h t sc pre Age Group

Figure 2: Mean ± standard deviation of Dice score (left) and 95th percentile Hausdorff Distance (right) for each pediatric age group. All models are trained on EchoNet-Dynamic (adults) and evaluated zero-shot on EchoNet-Pediatric.

by the data distribution rather than by any model-specific property. The consistent performance drop for infants supports the hypothesis that this subgroup is anatomically sufficiently distinct from adults to be considered OOD. Infants have proportionally different cardiac dimensions, higher heart rates, and distinct acoustic windows compared to older children or adults [3], all of which can plausibly cause a distribution mismatch with respect to features learned from EchoNet-Dynamic. We therefore designate the infant group as our OOD evaluation population in all subsequent analyses. 4.2.2. Uncertainty Quality for ID and OOD Populations Motivation. A practically useful uncertainty estimator should exhibit high uncertainty precisely where the model is likely to err, and this correspondence should be preserved both for in-distribution (ID) data and for OOD data. Standard uncertainty methods are known to be overconfident in the presence of covariate shift. We investigate whether this is the case here and whether VIDS-Seg mitigates this problem. A natural question is how VIDSSeg’s uncertainty estimates compare against post-hoc calibration baselines such as temperature scaling [28]. Rather than treating temperature scaling as a competing UQ method in its own right, we use it to test a stronger hypothesis. If the baselines’ poor spatial alignment is merely a symptom of poorly scaled confidence rather than a genuine failure to localize uncertainty, then calibrating them should close the gap to VIDS-Seg. We therefore additionally evaluate all three baselines after applying temperature scaling. Evaluation protocol. We evaluate uncertainty quality on two subgroups of EchoNet-Pediatric: the infant group (OOD, n = 304 segmentations) and 14

non-infant group (ID-proximal, n = 5492 segmentations). As the primary metric we use the pixel-wise Normalized Cross-Correlation (NCC) between the per-pixel entropy map and a binary error map. The entropy at pixel p is computed as Hp = −s̄p log s̄p − (1 − s̄p ) log(1 − s̄p ), where s̄p is the mean predicted probability across S samples (S = 20 for PHiSeg and VIDS-Seg; S = 10 for the Ensemble). The error map is defined as the pixel-wise cross entropy between the mean logits and the ground-truth mask. A higher NCC indicates better spatial alignment between uncertainty and prediction error which is the desired property for a trustworthy estimator. To test whether the baselines’ uncertainty maps merely require rescaling rather than being spatially uninformative, we further evaluate each baseline after temperature scaling [28] where a single scalar temperature T is fitted per method on a held-out calibration split on the adult cohort by minimizing the negative log-likelihood of the predicted probabilities, and s̄p is replaced by its temperature-rescaled counterpart before computing Hp and the resulting NCC. Findings. Results are summarized in Table 1. PHiSeg achieves the lowest NCC for both the non-infant and infant groups, suggesting that its uncertainty estimates are poorly calibrated spatially. The Ensemble shows a clear improvement in NCC over PHiSeg for both populations. VIDS-Seg attains the highest NCC among all methods for both groups, indicating superior spatial alignment between predicted uncertainty and actual prediction error. Temperature scaling improves NCC for all three methods and in both subgroups, confirming that part of the baselines’ raw NCC deficit is attributable to poorly scaled confidence rather than purely spatial misalignment. However, the ranking between methods is preserved after calibration: VIDS-Seg’s calibrated NCC (0.61 ± 0.13 non-infant, 0.62 ± 0.11 infant) remains higher than both temperature-scaled PHiSeg (0.35 ± 0.12 non-infant, 0.33 ± 0.12 infant) and the temperature-scaled Ensemble (0.50 ± 0.15 noninfant, 0.54 ± 0.16 infant). This indicates that VIDS-Seg’s advantage is not an artifact of better-scaled confidence that a simple post-hoc rescaling could replicate, but reflects a genuinely better-localized correspondence between predicted uncertainty and prediction error. The results suggest that common uncertainty quantification methods, even strong ones such as deep ensembles, tend to remain overconfident when 15

confronted with OOD inputs, producing uncertainty maps that do not adequately reflect the elevated prediction error, and that this shortcoming persists even after standard post-hoc calibration. VIDS-Seg, by contrast, is explicitly designed to model the uncertainty arising from distribution shift through its adaptive prior and inverse-bootstrapping training procedure, which appears to translate into a more spatially reliable uncertainty signal under distribution shift, even after standard post-hoc calibration is applied to all methods. Table 1: Spatial uncertainty quality (NCC ↑, mean ± std. across subjects) for non-infant (ID) and infant (OOD) subgroups, before (Raw) and after (Temp.-scaled) temperature scaling.

Non-infant NCC ↑ Method Ensemble PHiSeg VIDS-Seg (Ours)

Infant NCC ↑

Raw

Temp.-scaled

Raw

Temp.-scaled

0.35 ± 0.15 0.14 ± 0.11 0.50 ± 0.14

0.50 ± 0.15 0.35 ± 0.12 0.61 ± 0.13

0.39 ± 0.17 0.11 ± 0.09 0.52 ± 0.12

0.54 ± 0.16 0.33 ± 0.12 0.62 ± 0.11

To assess whether the NCC improvement of VIDS-Seg over the Ensemble is statistically meaningful rather than an artifact of subgroup variance, we performed a Wilcoxon signed-rank test on paired per-subject NCC values, for both the raw (uncalibrated) predictions and the temperature-scaled predictions. For the uncalibrated predictions, the difference is significant for both the infant group (p = 1.9 × 10−8 , rank-biserial effect size rrb = 0.86) and the non-infant group (p = 1.1 × 10−170 , rrb = 0.94), indicating a large and consistent effect. For the calibrated predictions, the difference remains significant, with p = 2.4 × 10−5 (rrb = 0.68) for the infant group and p = 5.5 × 10−135 (rrb = 0.83) for the non-infant group. The effect sizes are somewhat smaller after calibration, consistent with temperature scaling closing part of the raw NCC gap. Nonetheless, the difference remains large and highly significant in both subgroups, confirming that VIDS-Seg’s improvement over the Ensemble is not explained away by simple post-hoc recalibration. We restrict formal significance testing to the VIDS-Seg vs. Ensemble comparison, as the Ensemble is the stronger of the two baselines in both raw and calibrated NCC. The corresponding gap to PHiSeg is larger throughout (Table 1) and we omit its statistics for brevity. 16

4.2.3. Qualitative Analysis Figure 3 shows representative examples of predictions, uncertainty (entropy) maps, and pixel-wise error maps for one infant (OOD) and one noninfant (ID) subject, for each method. Across all three methods, the magnitude of the error map is broadly comparable, consistent with the quantitative findings in Section 4.2.1 showing similar Dice scores for all models. However, there are clear qualitative differences in how each method distributes its uncertainty. For PHiSeg, the entropy map tends to be very narrow and only around the immediate border of the prediction. The Ensemble produces more spatially focused uncertainty, with higher entropy at the LV boundary, but still misses many of the error-prone regions in the infant cases. VIDS-Seg, in particular for the infant example, shows entropy that is more tightly concentrated at the location of prediction errors. This qualitative behavior directly mirrors the superior NCC scores reported in Table 1. Image

GT Mask

Image

GT Mask

Image

GT Mask

Ensemble | NCC=0.443

Mean Pred

PHiSeg | NCC=0.069

Mean Pred

VIDS-Seg | NCC=0.618 Mean Pred

Entropy Map

CE Error Map

Entropy Map

CE Error Map

Entropy Map

CE Error Map

Figure 3: Qualitative comparison of uncertainty and error maps for a representative infant (OOD) case.Each row corresponds to one method: Deep Ensemble (NCC= 0.443), PHiSeg (NCC= 0.069), and VIDS-Seg (NCC= 0.618). Columns show, from left to right: the input echocardiogram frame, the ground-truth left ventricular segmentation mask, the mean prediction, the pixel-wise entropy map, and the pixel-wise cross-entropy error map.

17

4.2.4. Downstream Clinical Impact: Ejection Fraction Estimation and Cardiac Health Assessment Motivation. In clinical practice, LV segmentations are rarely an end goal. They are typically used to derive quantitative biomarkers such as the ejection fraction, which directly informs cardiac health assessment and treatment decisions. It is therefore important to assess not only segmentation quality but also the downstream impact of the model’s predictions and their associated uncertainties. EF estimation and cardiac health assessment protocol. From each binary segmentation mask we recover a contour tracing and apply Simpson’s biplane method to estimate the LV volume at ED and ES. The EF is then computed as: VED − VES × 100%, (11) EF = VED where VED and VES denote the end-diastolic and end-systolic volumes, respectively. Beyond estimating EF as a continuous quantity, we also consider the clinically relevant task of identifying cardiac malfunction for the infant subgroup, which we define as EF < 50%. Framing this as a binary classification problem allows us to assess whether the predicted EF values are not only numerically accurate but also reliable for flagging patients who require closer clinical attention. For the Ensemble, each of the 10 members produces one segmentation for each of the ED and ES frames, yielding 10 paired EF estimates; we report their mean. For PHiSeg and VIDS-Seg, we draw S = 20 samples from the posterior independently for ED and ES, since the samples across frames do not share a latent variable and therefore carry no natural pairing. We form 20 EF estimates by randomly pairing ED and ES samples, then report the mean as the final EF prediction. Performance is evaluated by the Mean Absolute Error (MAE) between the predicted and ground-truth EF across each age stratum. Findings. Results are shown in Figure 4. For all non-infant age groups, the three methods perform comparably, exhibiting similar MAE values and standard deviations. The infant group reveals a clear differentiation. PHiSeg shows the highest MAE for infants and the largest variance across subjects, indicating that it not only makes larger errors but also does so inconsistently. The Ensemble improves upon PHiSeg in mean MAE, but still exhibits 18

Ejection Fraction MAE (%)

Ejection Fraction MAE by Age Group Ensemble PHiSeg VIDS-Seg

50 40 30 20 10 0

infant

toddler

preschooler

Age Group

school age

teenager

Figure 4: Mean Absolute Error (MAE, %) ± standard deviation of ejection fraction estimates per age group. Lower is better.

substantial variance, suggesting that it frequently fails for individual infant cases. VIDS-Seg achieves the lowest MAE for infants and, notably, substantially lower variance, demonstrating a more stable and reliable EF prediction even for this OOD population. In general, the MAE is a bit higher compared to other state-of-the-art methods for EF prediction [29]. We note that our model was not optimized for ejection fraction prediction directly which explains the elevated error compared to other methods. This pattern is supported by the cardiac malfunction classification results. VIDS-Seg attains the highest AUROC (0.94), followed by the Ensemble (0.90), while PHiSeg trails behind with an AUROC of 0.81. The ranking mirrors the MAE findings in the infant subgroup: the higher variance and larger errors observed for PHiSeg translate into a reduced ability to correctly discriminate between healthy and impaired cardiac function, whereas VIDS-Seg’s more stable EF estimates yield the most reliable classification of cardiac malfunction. 5. Discussion and Conclusion Systematic under-performance on OOD subgroups is a well-documented failure mode of clinical ML [2], yet most UQ methods provide no mechanism to increase uncertainty precisely when the model is most likely to fail. We introduced VIDS-Seg, an extension of VIDS [15] to dense segmentation, and demonstrated it on left ventricular segmentation in echocardiography across adult and pediatric cohorts. Our three principal findings are: (1) infants are the only age group for which segmentation performance degrades 19

consistently across all models, justifying their treatment as OOD; (2) VIDSSeg produces significantly higher spatial correspondence between uncertainty and prediction error on this OOD group compared to deep ensembles and PHiSeg, without sacrificing segmentation performance; and (3) this uncertainty quality improvement translates directly into more stable ejection fraction estimates for infants, demonstrating a positive effect on downstream clinical biomarkers. The concentration of under-performance in infants, rather than in children broadly, is clinically meaningful rather than incidental. Cardiac dimensions and left ventricular geometry scale non-linearly with age, and infants additionally present with higher heart rates and distinct acoustic windows compared to older children or adults [3], all of which plausibly place this subgroup anatomically furthest from the adult training distribution. This pattern is consistent with reports of analogous pediatric performance gaps in other clinical imaging tasks, including organ segmentation and chest radiograph interpretation [2, 30], suggesting that infant-specific distribution shift is a recurring rather than dataset-specific challenge for models trained on adult populations. The uncertainty quality ordering, PHiSeg < Ensemble < VIDS-Seg, holds across both ID and OOD populations and has a natural interpretation. PHiSeg was designed to capture aleatoric uncertainty from annotation ambiguity rather than covariate shift. Deep ensembles implicitly capture epistemic uncertainty through initialization diversity, but without an explicit OOD mechanism. VIDS-Seg is the only method with a principled posterior that widens in response to distributional novelty. Notably, this ordering is not simply an artifact of the baselines’ confidence being poorly scaled: when we apply post-hoc temperature scaling to all three methods, NCC improves across the board, yet VIDS-Seg’s advantage over the calibrated Ensemble and calibrated PHiSeg remains large and statistically significant (Section 4.2.2). This indicates that VIDS-Seg’s uncertainty maps are better spatially localized, not merely better scaled in magnitude — a distinction that a simple recalibration step, such as one might apply as a lightweight fix to an existing deployed model, cannot replicate. While VIDS-Seg’s uncertainty-error correspondence is the strongest, it may not yet suffice as a standalone alert signal without further calibration. Post-hoc frameworks such as conformal prediction [31] or RCPS [32] could be applied on top, though their global coverage guarantees explicitly do not hold on OOD data, due to their assumption of exchangeability. 20

The downstream clinical relevance of this uncertainty quality gap is most apparent in the ejection fraction results. VIDS-Seg not only achieves the lowest EF estimation error for infants but also the highest AUROC (0.94) for detecting cardiac malfunction (EF < 50%), compared to 0.90 for the Ensemble and 0.81 for PHiSeg. This is a clinically more legible result than EF MAE alone. A clinician ultimately cares less about the exact percentagepoint error of an EF estimate than about whether a patient requiring closer follow-up is correctly flagged. The consistency between the uncertainty quality ranking, the EF error ranking, and the malfunction classification ranking suggests that better-localized uncertainty is not merely a diagnostic property of the model but one that propagates through the full pipeline to the metric that actually matters at the point of care. Clinical utility. The most direct clinical implication of this work is that VIDS-Seg can serve as an uncertainty-based safety layer on top of any deployed segmentation model. When the predicted entropy exceeds a threshold, the clinician is alerted that the case may lie outside the model’s reliable operating range, prompting expert review before downstream biomarkers are acted upon. It requires no retraining, no additional labeled data, and no modifications to the core segmentation network. A key remaining step is translating pixel-level entropy into a clinically interpretable scalar, such as a predicted confidence interval on ejection fraction, to make the uncertainty signal actionable without requiring clinicians to interpret spatial maps. Prospective evaluation with clinical partners is the ultimate test of whether this alert mechanism delivers on its promise of safer, more robust ML deployment. VIDS-Seg takes a step towards clinical ML that can communicate its own limitations. Not by eliminating distributional gaps, but by making them visible. Future work should explore uncertainty propagation along the full diagnostic pipeline, extension to multi-organ settings, and co-design of uncertainty-driven workflow integrations with clinical stakeholders. CRediT Authorship Contribution Statement Paul Fischer: Writing – review & editing, Writing – original draft, Visualization, Validation, Software, Methodology, Investigation, Formal analysis, Conceptualization. Ece Özkan Elsen: Supervision, Writing – review & editing, Validation, Methodology, Conceptualization, Resources, Project administration. 21

Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. Acknowledgments The authors thank Yuli Slavutsky for helpful discussions on the original VIDS method and for providing code and optimization advice. References [1] U.S. Food and Drug Administration, Artificial Intelligence and Machine Learning (AI/ML)-Enabled Medical Devices, publicly available database. Data downloaded as a CSV file for analysis. Accessed: 202508-01 (oct 2023). [2] D. Chatterjee, A. Kanhere, F. X. Doo, J. Zhao, A. Chan, A. Welsh, P. Kulkarni, A. Trang, V. S. Parekh, P. H. Yi, Children are not small adults: addressing limited generalizability of an adult deep learning ct organ segmentation model to the pediatric population, Journal of Imaging Informatics in Medicine 38 (3) (2025) 1628–1641. [3] L. Lopez, D. L. Saurers, P. C. Barker, M. S. Cohen, S. D. Colan, J. Dwyer, D. Forsha, M. K. Friedberg, W. W. Lai, B. F. Printz, et al., Guidelines for performing a comprehensive pediatric transthoracic echocardiogram: recommendations from the american society of echocardiography, Journal of the American Society of Echocardiography 37 (2) (2024) 119–170. [4] C. Joseph, M. Mrudang, K. Dhamanpreet, D. Matthew, D. Adil, K. Aravind, L. Matthew, S. Rohan, A. K. Gonzalez, L. Joseph, et al., A multi-task deep learning model for pediatric echocardiography analysis, medRxiv (2025) 2025–10. [5] V. Muralidharan, A. Burgart, R. Daneshjou, S. Rose, Recommendations for the use of pediatric data in artificial intelligence and machine learning accept-ai, NPJ digital medicine 6 (1) (2023) 166. 22

[6] J. Yang, K. Zhou, Y. Li, Z. Liu, Generalized out-of-distribution detection: A survey, International Journal of Computer Vision 132 (12) (2024) 5635–5662. [7] Z. Hong, Y. Yue, Y. Chen, L. Cong, H. Lin, Y. Luo, M. H. Wang, W. Wang, J. Xu, X. Yang, et al., Out-of-distribution detection in medical image analysis: A survey, arXiv preprint arXiv:2404.18279 (2024). [8] K. Zou, Z. Chen, X. Yuan, X. Shen, M. Wang, H. Fu, A review of uncertainty estimation and its application in medical imaging, MetaRadiology 1 (1) (2023) 100003. [9] P. K. Han, Uncertainty in Medicine: A Framework for Tolerance, 1st Edition, Oxford University PressNew York, 2021. doi:10.1093/oso/ 9780190270582.001.0001. [10] B. Lambert, F. Forbes, S. Doyle, A. Tucholka, M. Dojat, Improving uncertainty-based out-of-distribution detection for medical image segmentation (2022). arXiv:2211.05421. URL https://arxiv.org/abs/2211.05421 [11] Y. Ovadia, E. Fertig, J. Ren, Z. Nado, D. Sculley, S. Nowozin, J. Dillon, B. Lakshminarayanan, J. Snoek, Can you trust your model’s uncertainty? evaluating predictive uncertainty under dataset shift, Advances in neural information processing systems 32 (2019). [12] A. Wang, T. T. Doan, C. Reddy, P.-N. Jone, Artificial intelligence in fetal and pediatric echocardiography, Children 12 (1) (2024) 14. [13] C. González, K. Gotkowski, M. Fuchs, A. Bucher, A. Dadras, R. Fischbach, I. J. Kaltenborn, A. Mukhopadhyay, Distance-based detection of out-of-distribution silent failures for covid-19 lung lesion segmentation, Medical image analysis 82 (2022) 102596. [14] K. Lekadir, A. F. Frangi, A. R. Porras, B. Glocker, C. Cintas, C. P. Langlotz, E. Weicken, F. W. Asselbergs, F. Prior, G. S. Collins, et al., Future-ai: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare, bmj 388 (2025). [15] Y. Slavutsky, D. M. Blei, Quantifying uncertainty in the presence of distribution shifts, arXiv preprint arXiv:2506.18283 (2025). 23

[16] C. F. Baumgartner, K. C. Tezcan, K. Chaitanya, A. M. Hötker, U. J. Muehlematter, K. Schawkat, A. S. Becker, O. Donati, E. Konukoglu, PHiSeg: Capturing uncertainty in medical image segmentation, in: D. Shen, T. Liu, T. M. Peters, L. H. Staib, C. Essert, S. Zhou, P.-T. Yap, A. Khan (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2019, Vol. 11765, Springer International Publishing, 2019, pp. 119–127, series Title: Lecture Notes in Computer Science. [17] B. Lambert, F. Forbes, S. Doyle, H. Dehaene, M. Dojat, Trustworthy clinical ai solutions: a unified review of uncertainty quantification in deep learning models for medical image analysis, Artificial Intelligence in Medicine 150 (2024) 102830. [18] C. Gonzalez, A. Mukhopadhyay, Self-supervised out-of-distribution detection for cardiac cmr segmentation, in: Medical Imaging with Deep Learning, PMLR, 2021, pp. 205–218. [19] L. Mossina, C. Friedrich, Conformal prediction for image segmentation using morphological prediction sets, in: J. C. Gee, D. C. Alexander, J. Hong, J. E. Iglesias, C. H. Sudre, A. Venkataraman, P. Golland, J. H. Kim, J. Park (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2025, Springer Nature Switzerland, Cham, 2026, pp. 78–88. [20] D. Krueger, E. Caballero, J.-H. Jacobsen, A. Zhang, J. Binas, D. Zhang, R. Le Priol, A. Courville, Out-of-distribution generalization via risk extrapolation (rex), in: International conference on machine learning, PMLR, 2021, pp. 5815–5826. [21] S.-T. Tran, C.-H. Cheng, T.-T. Nguyen, M.-H. Le, D.-G. Liu, Tmd-unet: Triple-unet with multi-scale input features and dense skip connection for medical image segmentation, in: Healthcare, Vol. 9, MDPI, 2021, p. 54. [22] D. Ouyang, B. He, A. Ghorbani, N. Yuan, J. Ebinger, C. P. Langlotz, P. A. Heidenreich, R. A. Harrington, D. H. Liang, E. A. Ashley, et al., Video-based ai for beat-to-beat assessment of cardiac function, Nature 580 (7802) (2020) 252–256.

24

[23] C. D. Reddy, L. Lopez, D. Ouyang, J. Y. Zou, B. He, Video-based deep learning for automated assessment of left ventricular ejection fraction in pediatric patients, Journal of the American Society of Echocardiography 36 (5) (2023) 482–489. [24] G. Bradski, The OpenCV Library, Dr. Dobb’s Journal of Software Tools (2000). [25] M. Grossgasteiger, M. D. Hien, B. Graser, H. Rauch, J. Motsch, M. Gondan, C. Rosendal, Image quality influences the assessment of left ventricular function: an intraoperative comparison of five 2-dimensional echocardiographic methods with real-time 3-dimensional echocardiography as a reference, Journal of Ultrasound in Medicine 33 (2) (2014) 297–306. [26] O. Ronneberger, P. Fischer, T. Brox, U-net: Convolutional networks for biomedical image segmentation, in: N. Navab, J. Hornegger, W. M. Wells, A. F. Frangi (Eds.), Medical Image Computing and ComputerAssisted Intervention – MICCAI 2015, Vol. 9351, Springer International Publishing, 2015, pp. 234–241, series Title: Lecture Notes in Computer Science. [27] J. M. Zubler, L. D. Wiggins, M. M. Macias, T. M. Whitaker, J. S. Shaw, J. K. Squires, J. A. Pajek, R. B. Wolf, K. S. Slaughter, A. S. Broughton, et al., Evidence-informed milestones for developmental surveillance tools, Pediatrics 149 (3) (2022) e2021052138. [28] C. Guo, G. Pleiss, Y. Sun, K. Q. Weinberger, On calibration of modern neural networks, in: International conference on machine learning, PMLR, 2017, pp. 1321–1330. [29] T. Akan, S. Alp, M. S. Bhuiyan, T. Helmy, A. W. Orr, M. M. R. Bhuiyan, S. A. Conrad, J. A. Vanchiere, C. G. Kevil, M. A. N. Bhuiyan, Viviechoformer: deep video regressor predicting ejection fraction, Journal of imaging informatics in medicine 38 (4) (2025) 2041–2052. [30] H. J. Shin, N.-H. Son, M. J. Kim, E.-K. Kim, Diagnostic performance of artificial intelligence approved for adults for the interpretation of pediatric chest radiographs, Scientific reports 12 (1) (2022) 10215.

25

[31] A. N. Angelopoulos, S. Bates, A gentle introduction to conformal prediction and distribution-free uncertainty quantification (2022). arXiv: 2107.07511[cs], doi:10.48550/arXiv.2107.07511. URL http://arxiv.org/abs/2107.07511 [32] S. Bates, A. Angelopoulos, L. Lei, J. Malik, M. I. Jordan, Distributionfree, risk-controlling prediction sets (2021). arXiv:2101.02703[cs], doi:10.48550/arXiv.2101.02703. URL http://arxiv.org/abs/2101.02703

26

Related documents

Record · ID 444638 · SHA-256 40743c9975172479
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive