ConceptioArchivearXiv CS
arXiv CSopen access

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

Unknown · 2026 · arxiv_cs
arXiv CS · Papers · License: Open Access · 2026
Open Source ↗Direct PDF ↓
neuralnetworks
machine learning, deep learning, neural networks

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

Erjian Zhang 1 Yatong Hao 1 Liejun Wang 1 2 Zhiqing Guo 1 2

Abstract

(a) Report Generation

Clinical Constraints

arXiv:2605.22635v1 [cs.LG] 21 May 2026

Chest X-Ray

Pursue smoothness and tend to generate safe but mediocre sentences.

Multi-task RRG

While multi-task learning based automatic radiology report generation (RRG) is widely adopted to ensure clinical consistency, most focus on architectural designs yet remain limited to coarse linear scalarization strategies. These strategies cannot effectively balance the hard constraints of discriminative clinical supervision with the smoothness requirements of report generation. To address these problems, we analyze the failure mechanism of linear scalarization from the perspective of gradient dynamics, utilizing the stochastic differential equation (SDE) framework to characterize it as a “Double Dilemma” of drift term deviation and diffusion term decay. Based on this, we propose a backbone-agnostic optimizer named Conflict-Averse Magnitude-Enhanced Gradient Descent (CAME-Grad). Through conflict-averse direction rectification and magnitude-enhanced energy injection, the algorithm not only ensures geometric validity, but also avoids local optimal solutions. Then, the adaptive gradient fusion mechanism is used to establish a dynamic balance between the theoretical optimal direction and the task-specific inductive bias. Experiments show that as a universal plug-andplay optimizer, CAME-Grad brings substantial and consistent improvements across eight diverse RRG methods, elevating overall clinical efficacy performance by an average of 2.3% on MIMIC-CXR and 1.9% on IU X-Ray. Our code is available at https://github.com/ vpsg-research/CAME-Grad.

Figure 1. The “Double Dilemma” in RRG multi-task optimization and its resolution via CAME-Grad. (a) In multi-task RRG, there is an intrinsic conflict between report generation and clinical constraints. (b) Under linear scalarization, this conflict simultaneously induces drift term deviation and diffusion term decay. (c) CAMEGrad employs direction rectification to ensure geometric validity and energy injection to escape sharp minima.

School of Computer Science and Technology, Xinjiang University, Urumqi, China 2 Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center, Urumqi, China. Correspondence to: Liejun Wang <[email protected]>, Zhiqing Guo <[email protected]>.

The technical evolution of this paradigm introduces diverse clinical constraint tasks, encompassing disease classification strategies aiming to explicitly enhance diagnostic accuracy (Li et al., 2025), image-text alignment mechanisms designed to bridge cross-modal disparities (Wang et al., 2024), and retrieval enhancement modules assisting generation by incorporating external medical knowledge (Song et al., 2025). Although these sophisticated architectural designs improve

Main RRG Gradient

Small Nodule

Nodule Label Strengthening clinical constraints, but inconsistent with RRG direction.

Auxiliary Clinical Gradient

Pathological Details (Rare yet critical)

(b) Linear Scalarization

Direction Rectification

(c) CAME-Grad (Ours)

Drift Deviation (Directional Oscillation)

Sharp Minima

Flat Minima

Report The lungs are clear. No nodule. (Missed Diagnosis!) (Safe but Mediocre)

Failure Case

Report

Energy Injection

Sharp Minima

There is a small nodular opacity in the right mid lung. (Small nodule detected!)

Successful Case

Diffusion Decay (Energy Depletion)

1. Introduction Automated radiology report generation (RRG) aims to reduce the heavy workload of radiologists and improve diagnostic efficiency. Early methods (Vinyals et al., 2015; Chen et al., 2020) predominantly adopted a single-task learning paradigm, relying solely on a single text likelihood supervision to optimize generation quality. However, this single supervision signal often fails to guarantee clinical diagnostic accuracy. To address this, existing works have widely shifted to multi-task learning (MTL) paradigms to enhance feature representation and clinical consistency.

1

Preprint. May 22, 2026.

1

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

performance, existing works largely overlook the underlying gradient dynamics of multi-task optimization, defaulting to simple linear scalarization strategies. This coarse optimization strategy fails to effectively reconcile the intrinsic conflict between two types of tasks in RRG. In particular, strengthening the hard constraints of discriminative clinical supervision often leads to the degradation of generated report quality (Jin et al., 2024), while prioritizing the smoothness of language models makes it difficult to capture rare and critical pathological details (Li et al., 2025). Consequently, this dilemma limits the full realization of model potential.

biases, effectively preventing the catastrophic forgetting of semantic features. The main contributions of this paper are summarized as follows: • We investigate the failure mechanism of linear scalarization from the perspective of gradient dynamics, utilizing the SDE framework to characterize it as a “Double Dilemma” of drift term deviation and diffusion term decay, thereby revealing the geometric roots of suboptimality in RRG multi-task optimization. • We propose CAME-Grad, a gradient optimization algorithm designed for multi-task RRG. Formulated as a backbone-agnostic optimizer, it enables plug-and-play integration into diverse model architectures.

To bridge this gap, it is imperative to deeply analyze the geometric roots underlying the suboptimality of existing RRG multi-task optimization. From the perspective of gradient dynamics, the optimization dynamics in RRG inherently involve the interplay between the drift term driven by the first-order moment and the diffusion term arising from the second-order covariance. Motivated by this, we leverage the stochastic differential equation (SDE) framework (Mandt et al., 2017) to characterize the failure mechanism of linear scalarization in handling these dynamics as a “Double Dilemma” (Figure 1). Specifically, under traditional linear scalarization strategies, the intrinsic conflict between the RRG primary report generation task and auxiliary clinical constraint tasks causes the resultant force direction to deviate from the Pareto optimal trajectory, thereby inducing drift term deviation. This fundamentally constitutes directional instability in optimization dynamics, manifesting as severe directional oscillation that hinders optimization efficiency. Simultaneously, this conflict leads to a structural collapse in gradient magnitude, thereby triggering diffusion term decay. This fundamentally constitutes a deficiency in exploration kinetic energy, manifesting as severe energy depletion, which renders the model unable to escape local optimal solutions.

• We conduct extensive evaluations of CAME-Grad on the MIMIC-CXR and IU X-Ray datasets across eight representative RRG methods, demonstrating average clinical efficacy improvements of 2.3% and 1.9%, respectively.

2. Related Work 2.1. Radiology Report Generation Radiology report generation (RRG) aims to automatically generate accurate and coherent diagnostic reports from medical images. Unlike general natural image captioning tasks (Vinyals et al., 2015), RRG requires processing longer text sequences and capturing subtle pathological details. Early research (Jing et al., 2018; Li et al., 2019; Chen et al., 2020; 2021) primarily adopted single-task learning paradigms, utilizing mechanisms such as co-attention, prior knowledge injection, or shared memory to bridge the visualsemantic gap. However, relying solely on a single generation supervision signal, models struggle to align these complex cross-modal representations and are prone to generating hallucinations for long-tail disease descriptions.

Based on this theoretical insight, we propose ConflictAverse Magnitude-Enhanced Gradient Descent (CAMEGrad). As a backbone-agnostic optimizer, CAME-Grad directly replaces traditional linear scalarization strategies without modifying the core network architecture, aiming to resolve this “Double Dilemma” by reshaping the optimization dynamics via three cascaded stages. First, we employ Conflict-Averse Direction Rectification to suppress destructive interference, thereby mitigating the drift term deviation and establishing geometric validity in the tangent space. Second, we introduce a Magnitude-Enhanced Energy Injection mechanism to actively restore and enhance the gradient magnitude. This step compensates for the diffusion term decay by injecting escape kinetic energy to drive the model from sharp minima toward flat minima. Finally, we implement Adaptive Gradient Fusion to balance the theoretical optimal direction with task-specific inductive

To overcome single-task bottlenecks, multi-task learning (MTL) has become the mainstream research paradigm. Specifically, disease classification tasks (Jin et al., 2024; Li et al., 2025) are introduced to inject clinical priors, while image-text alignment methods (Wang et al., 2022; 2024; Yan et al., 2021; Li et al., 2023) strive to maintain anatomical consistency and learn discriminative features. Additionally, retrieval-based enhancement methods (Zhou et al., 2025; Song et al., 2025) leverage external knowledge bases or patient historical data to supplement diagnostic information. Despite the increasingly sophisticated architectures, existing works still predominantly adopt static linear scalarization in their optimization strategies. This overlooks the complex gradient dynamics among multiple tasks, thereby limiting the release of the potential inherent in RRG models. 2

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Multi-Task Framework Report Generation Task (Primary task)

Input Image

Visual Encoder

Findings: There is a small nodular opacity in the right mid lung. There is no pulmonary edema.

Disease Classification

Visual Features Clinical Constraint Tasks (Auxiliary tasks)

Input Report (Optional)

Text Encoder

Auxiliary Loss (ℒk )

Retrieval Enhancement

𝐠𝐤

Backward Gradients

S2. Energy Injection

S1. Direction Rectification 𝐠𝟎

Image-Text Alignment

Text Features

CAME-Grad Optimizer

NLL Loss (ℒrg )

𝐠𝟎

S3. Adaptive Fusion

Original Joint Gradient

𝐮∗𝐫𝐞𝐜𝐭

Restored & Enhanced Power

Parameter Update 𝚯𝒕+𝟏

RRG Multi-Task Learning Backbone

𝜈

𝐠𝐤

Figure 2. Architecture of the proposed CAME-Grad optimizer. (Top) The multi-task backbone integrates disease classification, image-text alignment, and retrieval enhancement as clinical constraints. (Bottom) The CAME-Grad optimizer operates via three stages. (S1) Direction rectification resolves drift deviation via geometric projection. (S2) Energy injection reverses diffusion decay by restoring and enhancing gradient magnitude. (S3) Adaptive fusion balances the theoretically optimal direction with task-specific inductive biases.

2.2. Gradient Dynamics and Optimization Dilemmas

3. Method

To mitigate gradient conflicts by rectifying update directions, algorithms evolved from classic projection (Sener & Koltun, 2018; Yu et al., 2020), Pareto optimization (Liu et al., 2021), and game-theoretic perspectives (Navon et al., 2022) to recent fast adaptive approaches (Liu et al., 2023), task priority quantification (Jeong & Yoon, 2024), and bi-level consistency (Qin et al., 2025). Meanwhile, magnitude regulation strategies advanced from normalization (Chen et al., 2018) and uncertainty weighting (Kendall et al., 2018) to selective grouping (Wei & Hu, 2024; Jeong & Yoon, 2025) and prioritized multipliers (Cheng et al., 2025), enhancing the implicit regularization of stochastic gradient descent (SGD). Nevertheless, directly applying these paradigms to RRG encounters dynamical conflicts where direction rectification sacrifices diffusion kinetic energy, while strategies solely boosting magnitude struggle to ensure geometric validity in direction. To address this dilemma, CAME-Grad leverages the SDE framework to reshape the dynamics of the drift term and the diffusion term. By establishing a novel evolution mechanism, it enhances the diffusion kinetic energy within the geometrically valid tangent space of the manifold, thereby fully releasing the potential in RRG models.

In this section, we first provide a theoretical analysis of gradient dynamics in multi-task RRG. Addressing the “Double Dilemma” characterized by the SDE formulation, we propose the CAME-Grad gradient optimization algorithm. The overall architecture is illustrated in Figure 2. 3.1. Multi-Task RRG Let D = {(In , Yn )}N n=1 denote a dataset with N samples, where In represents a medical image, and Yn = {y1 , . . . , yT } denotes the corresponding report sequence. We utilize a visual encoder Eϕ and a text decoder Dψ to construct the primary report generation task. Let Θrg = {ϕ, ψ} denote the parameters for this task. The encoder maps In to latent features Zn = Eϕ (In ), and the decoder models the conditional probability PΘrg (Yn | In ). The primary objective is to minimize the negative log-likelihood: N

Lrg (Θrg ) = −

1 X log PΘrg (Yn | In ). N n=1

(1)

We introduce K auxiliary clinical constraint tasks. These 3

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

Gradient Dynamics (Aggregated over 6 Epochs)

tasks map the pooled visual features z̄n = Pool(Zn ) to discrete clinical labels ln ∈ {0, 1}C via task-specific projection heads fθk . The optimization objective for these constraints is formulated as:

Probability Density

3.5

N X C h X

1 Lk (ϕ, θk ) = − ln,c log σ(fθk (z̄n )c ) N n=1 c=1 i + (1 − ln,c ) log(1 − σ(fθk (z̄n )c )) .

(2)

3.0 2.5 2.0 1.5 1.0 0.5 0.0

0.4

To establish a unified optimization framework, we denote the total parameter set as Θ = Θrg ∪ {θ1 , . . . , θK }. We index the primary task as 0 (i.e., L0 ≜ Lrg ), and auxiliary tasks as 1, . . . , K. The overall multi-task objective is a linear weighted combination of all task losses: Ljoint (Θ) =

K X

ωi Li (Θ),

(3)

Let gi = ∇Θ Li (Θ) ∈ Rd be the gradient vector for the i-th task regarding shared parameters Θ. In standard SGD using the linear scalarization strategy (Sener & Koltun, 2018), the joint update direction gjoint comes from the linear superposition of task gradients:

0.4

diffusion term

drift term

where gjoint is the expected joint gradient, Σ is the covariance matrix of gradient noise, and Wt represents Brownian motion. In this framework, the drift term controls the convergence direction, while the diffusion term provides exploration noise to escape local minima. PK Under the linear combination gjoint = i=0 ωi gi , the energy of the joint gradient is bound by the interaction term from Section 3.2.1:

(4)

i=0

where ωi are static scalar weights. In this section, we analyze the theoretical flaws of this static linear scalarization strategy in handling the intrinsic conflict of RRG multi-task learning, from both geometric and dynamical dimensions.

2

∥gjoint ∥

≈ ω02 ∥g0 ∥2 +

K X k=1

3.2.1. G EOMETRIC Q UANTIFICATION OF C ONFLICT

ωk2 ∥gk ∥2 + 2

K X

Ik ,

(7)

k=1

where inter-auxiliary interference is neglected as secondary. Since linear weights are strictly positive, linear scalarization fails to mathematically decouple destructive gradient interference. This limitation characterizes a “Double Dilemma” within our SDE-based mechanistic hypothesis. Severe gradient conflicts cause the resultant force gjoint to diverge from the Pareto optimal direction, inducing drift deviation. Simultaneously, the magnitude collapse caused by negative interactions directly results in diffusion decay, stifling exploration noise.

We define the gradient conflict between the primary task (indexed as 0) and an auxiliary task k ∈ {1, . . . , K} as the occurrence of a negative cosine similarity between their respective gradients g0 and gk . To analyze the energy interaction, we expand the squared norm of the linear combination: ∥ω0 g0 + ωk gk ∥2 = ω02 ∥g0 ∥2 + ωk2 ∥gk ∥2 + 2 ω0 ωk (g0⊤ gk ) . | {z }

0.2

To reveal the dynamical consequences of this intrinsic conflict, we model the optimization dynamics of SGD using SDE. The discrete SGD update rule Θt+1 = Θt − ηĝ(Θt ) approximates the following continuous-time SDE process: p (6) dΘt = −gjoint (Θt )dt + ηΣ(Θt )dWt , {z } {z } | |

3.2. Theoretical Analysis of Gradient Dynamics

ωi gi ,

0.0

3.2.2. C HARACTERIZING THE D OUBLE D ILEMMA VIA SDE

where ωi represents predefined static task weights.

K X

0.2

Gradient Cosine Similarity (cos )

Figure 3. The substantial negative ratio of 53.8% quantitatively confirms the intrinsic conflict between the report generation and clinical constraint tasks.

i=0

gjoint =

Gradient Density Destructive Synergy

Model: REVTAF Dataset: MIMIC-CXR --------------------Analysis Result: Negative Ratio: 53.8% Mean Cosine: -9.3e-03 Total Samples: 90258

(5)

interaction term Ik

3.3. CAME-Grad Gradient Optimization Algorithm

The RRG primary report generation task requires a smooth semantic manifold, whereas auxiliary clinical constraint tasks induce rigid, discretized feature structures. This intrinsic conflict causes persistent destructive interference, manifested as a significantly negative interaction term Ik ≪ 0, as illustrated in Figure 3 and generalized in Appendix A.

As a backbone-agnostic optimizer, CAME-Grad serves as a direct substitute for traditional linear scalarization strategies, effectively resolving this “Double Dilemma” by reshaping the optimization dynamics via three integrated stages, as summarized in Algorithm 1. 4

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

direction u∗rect via its closed-form solution: √ ξ u∗rect = µ + gα∗ . ∥gα∗ ∥

Algorithm 1 CAME-Grad Optimization Process Input: Dataset D, Parameters Θ, Learning rate η Hyperparams: Task weights ω, Radius ρ, Gain factor κ, Fusion coefficient ν while not converged do Sample batch B ∼ D; Compute task gradients gi ← ∇Θ Li (Θ) PK Compute joint gradient gjoint ← i=0 ωi gi and P K 1 mean gradient µ ← K+1 g i=0 i // Stage 1: Conflict-Averse Direction Rectification Solve dual problem for α∗ and compute rectified direction u∗rect (closed-form) // Stage 2: Magnitude-Enhanced Energy Injection Calculate target magnitude: τmag ← κ∥gjoint ∥ τ Compute enhanced gradient: uen ← u∗rect · ∥u∗mag∥+ϵ rect // Stage 3: Adaptive Gradient Fusion Compute final direction: gf inal ← (1 − ν)uen + ν(κgjoint ) Update parameters: Θ ← Θ − ηgf inal end while

This direction rectification process is intended to reshape the drift coefficient −gjoint in the SDE, aiming to keep the update trajectory within the geometrically valid tangent space of the manifold, thereby mitigating the drift deviation caused by task conflicts. Stage 2: Magnitude-Enhanced Energy Injection While u∗rect mitigates directional conflicts, the constrained optimization significantly compresses its magnitude. To counteract this magnitude collapse, we introduce a magnitude enhancement mechanism to define a target magnitude τmag through a dual-level process. First, we restore the magnitude to the baseline level of the original joint gradient ∥gjoint ∥ to retrieve the lost fundamental diffusion kinetic energy. Second, upon this basis, we introduce a gain factor κ ≥ 1 for further enhancement to inject additional exploration noise. The target magnitude is calculated as: τmag = κ · ∥gjoint ∥.

Stage 1: Conflict-Averse Direction Rectification First, to ensure geometric validity across all tasks, we search for a vector u that maximizes the worst-case local improvement. Inspired by the optimization principles of CAGrad (Liu et al., 2021), this search happens within PK a trust region centered at 1 the mean gradient µ = K+1 i=0 gi . We define the primal problem as: max

min

u∈Rd i∈{0,...,K}

gi⊤ u

s.t.

∥u − µ∥ ≤ ρ∥µ∥,

α∈∆K+1 2

p ξ∥gα ∥,

(11)

Subsequently, we restore and enhance the magnitude of the rectified direction u∗rect to the target level τmag , yielding the enhanced gradient uen , formulated as: uen = u∗rect ·

τmag , ∗ ∥urect ∥ + ϵ

(12)

where ϵ is a small constant for numerical stability. By strictly enforcing the target magnitude τmag , CAME-Grad is designed to compensate for the diffusion intensity governed by Σ(Θt ) in the SDE. This step seeks to counteract the diffusion decay induced by energy depletion, facilitating the exploration needed to escape sharp minima toward flatter loss basins.

(8)

where ρ ∈ [0, 1) is a hyperparameter controlling the radius. To guarantee global convergence stability, our rectification step strictly adheres to the trust region assumption, ensuring that the corrected gradient u resides within a bounded proximity of the mean gradient µ. This constraint ensures optimization stability by limiting the deviation from the mean gradient. Instead of resolving the intractable highdimensional conflicts directly in the parameter space, we introduce dual variables α ∈ ∆K+1 and a weighted graPK dient gα = i=0 αi gi to transform this primal problem into a solvable convex optimization problem over the unit simplex, where the dual objective is formulated as: ⊤ min F(α) := gα µ+

(10)

Stage 3: Adaptive Gradient Fusion Pure mathematical rectification might overly orthogonalize the gradients. This causes the loss of weak but important feature signals, such as gradients for long-tail tokens. To keep these task-specific inductive biases, we design an adaptive fusion mechanism. We use a fusion coefficient ν ∈ [0, 1] to linearly interpolate between the theoretical optimal gradient uen and the magnitude-enhanced original joint gradient ′ gjoint = κgjoint :

(9)

′ gf inal = (1 − ν)uen + νgjoint .

2

where ξ = ρ ∥µ∥ . Furthermore, by solving this tensorized dual problem directly on the GPU, CAME-Grad inherently avoids the host-device communication bottlenecks typical of O(d) gradient manipulations, ensuring a negligible computational overhead during training to obtain the optimal weights α∗ . Subsequently, we recover the optimal rectified

(13)

The final parameter update rule with learning rate η is: Θt+1 = Θt − η · gf inal .

(14)

This mechanism strikes a balance between the theoretically optimal direction and task-specific inductive biases. A small 5

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Table 1. Performance comparison on the MIMIC-CXR test set. Best results for each baseline pair are highlighted in bold and ↑ indicates higher is better. All models are reproduced following the unified experimental setup described in Section 4.3. CE Average denotes the arithmetic mean of Precision, Recall, and F1-score.

M ODEL

P UBLICATION

WCL + CAME-G RAD

CE M ETRICS

NLG M ETRICS

CE AVG . ↑

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

EMNLP’21

0.382 0.424

0.298 0.324

0.312 0.344

0.329 0.349

0.203 0.219

0.136 0.150

0.098 0.108

0.135 0.142

0.277 0.284

0.331 0.364

XP RO N ET + CAME-G RAD

ECCV’22

0.382 0.391

0.304 0.309

0.314 0.322

0.325 0.329

0.202 0.204

0.137 0.138

0.099 0.099

0.134 0.135

0.260 0.261

0.333 0.341

DCL + CAME-G RAD

CVPR’23

0.265 0.319

0.246 0.298

0.236 0.286

0.234 0.280

0.136 0.162

0.087 0.104

0.061 0.074

0.108 0.122

0.211 0.220

0.249 0.301

P ROMPT MRG + CAME-G RAD

AAAI’24

0.505 0.514

0.518 0.530

0.482 0.491

0.396 0.396

0.236 0.236

0.152 0.153

0.105 0.105

0.155 0.157

0.265 0.266

0.502 0.512

CAMAN ET + CAME-G RAD

JBHI’24

0.405 0.410

0.303 0.313

0.321 0.330

0.327 0.327

0.202 0.203

0.136 0.137

0.097 0.099

0.134 0.135

0.274 0.275

0.343 0.351

DDATR + CAME-G RAD

TMI’25

0.408 0.432

0.444 0.463

0.418 0.438

0.393 0.405

0.235 0.245

0.152 0.161

0.106 0.113

0.158 0.161

0.267 0.273

0.423 0.444

TGRG + CAME-G RAD

M ED IA’25

0.457 0.493

0.435 0.466

0.417 0.450

0.423 0.438

0.258 0.268

0.164 0.173

0.109 0.117

0.162 0.169

0.284 0.285

0.436 0.470

REVTAF + CAME-G RAD

ICCV’25

0.615 0.633

0.617 0.637

0.589 0.607

0.465 0.466

0.319 0.320

0.236 0.237

0.184 0.185

0.199 0.200

0.336 0.336

0.607 0.626

ν (e.g., 0.2) effectively avoids conflicts and ensures sufficient magnitude while preserving fine-grained semantic information, thereby fully releasing the potential inherent in RRG models.

lexical overlap and linguistic fluency at the n-gram level. Regarding CE metrics, following the recommendations of Nicolson et al. (2023), we assess diagnostic accuracy using CheXbert (Smit et al., 2020). This BERT-based labeler extracts 14 distinct observation categories from both generated and reference reports to calculate Precision (Prec.), Recall (Rec.), and F1-score (F1).

Comprehensive theoretical validations and a terminology glossary are provided in Appendices B and C.

4. Experiments

4.3. Implementation Details

4.1. Datasets

We implement CAME-Grad in PyTorch (Paszke et al., 2019) using a single NVIDIA A40 GPU. To ensure a fair and consistent comparison, we strictly adhere to the official implementations and default configurations reported in the original papers for all baseline models, while introducing two necessary standardizations to align the evaluation protocol. First, regarding model selection, we unify the criterion for saving the best model by utilizing the clinical F1-score on the validation set to prioritize clinical diagnostic accuracy. Second, we standardize the calculation of clinical efficacy metrics across all baselines to the protocol described in Section 4.2, specifically calculating the instance-level F1-score over 14 diseases using CheXbert. Regarding the IU X-Ray dataset, we adopt an adaptive strategy to align with baseline protocols by applying zero-shot inference for cross-domain methods (Jin et al., 2024; Song et al., 2025; Zhou et al., 2025) and conducting standard supervised training on official splits for the remaining baselines (Yan et al., 2021; Wang et al., 2022; Li et al., 2023; Wang et al., 2024; Li et al., 2025). We initialize CAME-Grad with ρ = 0.5, κ = 1.5, ν = 0.2 and tailor these hyperparameters

MIMIC-CXR (Johnson et al., 2019) serves as the largest public dataset consisting of chest X-ray images and paired radiology reports. To ensure a fair comparison with baseline works, we strictly follow the official split and preprocessing pipeline proposed by Chen et al. (2020). Consequently, the processed dataset contains 270,790 samples for training, 2,130 for validation, and 3,858 for testing. The IU X-Ray dataset (Demner-Fushman et al., 2016), provided by Indiana University, comprises 7,470 frontal and lateral chest X-ray images associated with 3,955 diagnostic reports. 4.2. Evaluation Metrics To comprehensively evaluate the performance of our model, we employ both Natural Language Generation (NLG) and Clinical Efficacy (CE) metrics. For NLG metrics, we report standard natural language processing scores including BLEU-1 to BLEU-4 (B-1 to B-4) (Papineni et al., 2002), METEOR (MTR) (Denkowski & Lavie, 2011), and ROUGE-L (R-L) (Lin, 2004), which primarily measure the 6

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Table 2. Performance comparison on the IU X-Ray test set. Best results for each baseline pair are highlighted in bold and ↑ indicates higher is better. All models are reproduced following the unified experimental setup in Section 4.3 where ∗ and † represent zero-shot inference and supervised training respectively. CE Average denotes the arithmetic mean of Precision, Recall, and F1-score.

M ODEL

P UBLICATION

WCL† + CAME-G RAD

CE M ETRICS

NLG M ETRICS

CE AVG . ↑

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

EMNLP’21

0.490 0.522

0.498 0.514

0.491 0.516

0.325 0.362

0.195 0.226

0.137 0.163

0.101 0.124

0.137 0.156

0.318 0.332

0.493 0.517

XP RO N ET† + CAME-G RAD

ECCV’22

0.598 0.619

0.588 0.603

0.590 0.606

0.440 0.463

0.271 0.292

0.183 0.204

0.132 0.151

0.182 0.181

0.336 0.333

0.592 0.609

DCL† + CAME-G RAD

CVPR’23

0.527 0.575

0.525 0.569

0.525 0.571

0.393 0.399

0.255 0.262

0.186 0.193

0.144 0.151

0.185 0.191

0.298 0.312

0.526 0.572

P ROMPT MRG∗ + CAME-G RAD

AAAI’24

0.200 0.207

0.210 0.217

0.197 0.203

0.419 0.419

0.248 0.248

0.158 0.159

0.106 0.107

0.161 0.158

0.314 0.308

0.202 0.209

CAMAN ET† + CAME-G RAD

JBHI’24

0.503 0.520

0.490 0.514

0.494 0.516

0.398 0.409

0.256 0.261

0.185 0.190

0.142 0.145

0.166 0.170

0.339 0.349

0.496 0.517

DDATR∗ + CAME-G RAD

TMI’25

0.308 0.281

0.282 0.308

0.257 0.259

0.428 0.433

0.253 0.257

0.160 0.164

0.107 0.110

0.161 0.163

0.314 0.313

0.282 0.283

TGRG† + CAME-G RAD

M ED IA’25

0.508 0.527

0.497 0.530

0.500 0.525

0.471 0.498

0.302 0.308

0.204 0.207

0.146 0.145

0.189 0.194

0.392 0.382

0.502 0.527

REVTAF∗ + CAME-G RAD

ICCV’25

0.292 0.304

0.291 0.302

0.283 0.294

0.420 0.424

0.249 0.251

0.159 0.159

0.106 0.105

0.178 0.177

0.311 0.310

0.289 0.300

for each backbone, with detailed configurations provided in Appendices D and E.

domain baselines such as PromptMRG and REVTAF under zero-shot settings. Furthermore, CAME-Grad delivers more substantial improvements for in-domain fine-tuning models like WCL and DCL by effectively resolving the “Double Dilemma” to release model potential during target-domain training. Finally, to rigorously confirm that CAME-Grad preserves the underlying clinical supervisory signals without degrading the diagnostic anchors, we present the detailed performance evaluation of the auxiliary classification task in Appendix F.

4.4. Results 4.4.1. C OMPARISON WITH RRG BASELINES To verify the effectiveness of CAME-Grad, we conduct experiments on two widely used datasets, namely MIMICCXR and IU X-Ray. We compare our method with eight state-of-the-art baselines, including WCL (Yan et al., 2021), XProNet (Wang et al., 2022), DCL (Li et al., 2023), PromptMRG (Jin et al., 2024), CAMANet (Wang et al., 2024), DDaTR (Song et al., 2025), TGRG (Li et al., 2025), and REVTAF (Zhou et al., 2025). For the MIMIC-CXR dataset, as shown in Table 1, CAME-Grad achieves substantial and consistent performance improvements across all baseline models. Specifically, it achieves an average absolute improvement of 2.3% in CE metrics, while the NLG metrics remain stable. As emphasized by Song et al. (2025), since NLG scores are sensitive to stylistic variations, excelling in CE metrics that directly reflect diagnostic accuracy is more indicative of a model’s clinical utility. Notably, on the strongest baseline REVTAF, we increase the F1-score from 0.589 to 0.607, reaching state-of-the-art performance. Table 2 illustrates the performance on the IU X-Ray dataset where CAME-Grad achieves a 1.9% average CE improvement while exhibiting robustness against data scarcity and gradient noise. Although domain shift and stylistic variances lead to more modest gains compared to MIMIC-CXR, our approach still improves the primary clinical efficacy of cross-

4.4.2. C OMPARISON WITH MTL O PTIMIZERS To further validate the superiority of our optimization strategy, we compare CAME-Grad with seven multi-task optimizers, including UW (Kendall et al., 2018), GradNorm (Chen et al., 2018), CAGrad (Liu et al., 2021), RotoGrad (Javaloy & Valera, 2022), FAMO (Liu et al., 2023), MMPareto (Wei & Hu, 2024), and STGU (Jeong & Yoon, 2025). All methods are implemented on the strongest REVTAF baseline and evaluated on the MIMIC-CXR dataset using their default hyperparameters. As Table 3 shows, while traditional methods demonstrate incremental improvements, their gains are constrained by specific failure modes. Magnitude-weighting methods like UW, GradNorm, and FAMO merely scale loss weights, rendering them powerless against destructive directional conflicts exceeding 90◦ . Meanwhile, globally-applied strict Pareto-based approaches like MMPareto suffer a performance collapse with average clinical efficacy plunging to 0.076. Minimizing the global gradient norm across non-shared parameters severely penal7

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Ground Truth: a nasogastric tube passes into the stomach . endotracheal tube terminates approximately 5 cm from the carina . there is increased right mid lung atelectasis . bibasilar opacities were better demonstrated on prior radiographs . diffuse right lung opacity is compatible with layering pleural effusion as seen on subsequest ct of the neck ." REVTAF Attention Map

REVTAF: endotracheal tube tip terminates approximately 5 cm from the carina. an enteric tube tip is within the stomach. heart size is normal. mediastinal and hilar contours are unremarkable. pulmonary vasculature is not engorged. patchy opacities are noted in the lung bases likely reflective of atelectasis. small left pleural effusion is likely present. no pneumothorax is identified.", MISSED: Diffuse Right Lung Opacity

+ CAME-Grad (Ours) Attention Map

+CAME-Grad (Ours): as compared to the previous radiograph the patient has been intubated. the tip of the endotracheal tube projects 4 cm above the carina. the patient has also received a nasogastric tube. the course of the tube is unremarkable the tip of the tube projects over the middle parts of the stomach. there is no evidence of complications notably no pneumothorax. the pre - existing bilateral parenchymal opacities are constant in extent and severity. also constant is a small left pleural effusion. unchanged retrocardiac atelectasis. normal size of the cardiac silhouette.",

Figure 4. Qualitative comparison on the MIMIC-CXR test set. The Ground Truth report is shown at the top. The generated results of REVTAF and CAME-Grad are shown on the left and right, respectively. Green text indicates accurate clinical observations consistent with the Ground Truth, while red text indicates factual errors or missed diagnoses. Various colored highlights and arrows (e.g., green, cyan, purple) illustrate the correspondence between visual attention regions and specific descriptions in the generated text. Table 3. Performance comparison with multi-task optimizers on the MIMIC-CXR test set. All methods are evaluated using REVTAF as the strong baseline. The best and second-best results in each metric are highlighted in bold and underlined, respectively, and ↑ indicates higher is better. CE Average denotes the arithmetic mean of Precision, Recall, and F1-score.

REVTAF

P UBLICATION

L INEAR + UW + G RAD N ORM + CAG RAD + ROTO G RAD + FAMO + MMPARETO + STGU + CAME-G RAD

ICCV’25 CVPR’18 ICML’18 N EUR IPS’21 ICLR’22 N EUR IPS’23 ICML’24 ICLR’25 -

CE M ETRICS

NLG M ETRICS

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-4 ↑

MTR ↑

R-L ↑

0.615 0.619 0.615 0.636 0.620 0.619 0.071 0.622 0.633

0.617 0.622 0.612 0.613 0.614 0.631 0.085 0.633 0.637

0.589 0.593 0.586 0.596 0.589 0.597 0.073 0.600 0.607

0.465 0.457 0.466 0.467 0.468 0.465 0.010 0.459 0.466

0.184 0.178 0.185 0.186 0.187 0.186 0.000 0.181 0.185

0.199 0.196 0.199 0.198 0.199 0.201 0.004 0.198 0.200

0.336 0.333 0.336 0.335 0.337 0.336 0.016 0.334 0.336

izes the primary generative task, causing language modeling failure. Furthermore, while direction-projection methods like CAGrad successfully mitigate conflicts to achieve 0.636 precision, their rigid geometric projections restrict stochastic exploration. This triggers diffusion decay, trapping the model in sharp minima and degrading recall to 0.613, while gradient homogenization (e.g., RotoGrad) overly favors language fluency at the cost of diluting sharp diagnostic features. Ultimately, through its three cascaded stages, CAMEGrad simultaneously rectifies directional conflicts and compensates for kinetic energy loss to achieve the highest overall average clinical efficacy of 0.626 while maintaining stable report generation quality.

CE AVG . ↑ 0.607 0.611 0.604 0.615 0.608 0.616 0.076 0.618 0.626

necessity of resolving direction conflicts. Enhancing magnitude without the direction guidance of S1 causes the F1score to drop from the baseline of 0.482 to 0.476. This suggests that blind energy injection harms model performance without proper geometric direction guidance. Second, the results on DDaTR verify the importance of restoring and enhancing magnitude. Removing S2 leads to a significant decrease in F1-score from 0.438 of the full CAME-Grad to 0.425, indicating that compensating for projection-induced decay is essential to help the model escape local minima. Finally, removing the adaptive gradient fusion mechanism S3 results in a decrease in precision, while some NLG metrics degrade (e.g., BLEU-1) compared to the full CAME-Grad. This implies that S3 acts as a regularizer by introducing the inductive bias of the original gradient. It effectively balances aggressive exploration momentum with language smoothness, thereby improving overall diagnostic precision.

4.5. Analysis of CAME-Grad 4.5.1. A BLATION S TUDY We conduct ablation studies on the MIMIC-CXR dataset using PromptMRG and DDaTR as representative models, as presented in Table 4 (full results in Appendices D and E). These results verify the contribution of the three stages of CAME-Grad. First, the results on PromptMRG confirm the

4.5.2. Q UALITATIVE R ESULTS To intuitively evaluate the clinical accuracy and coherence of generated reports, Figure 4 compares the qualitative re8

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Table 4. Ablation study on the MIMIC-CXR dataset using PromptMRG and DDaTR as representative backbones. Best results are highlighted in bold and ↑ indicates higher is better. We compare the baseline linear scalarization with ablated variants to verify the contribution of each stage where S1, S2, and S3 represent Conflict-Averse Direction Rectification, Magnitude-Enhanced Energy Injection, and Adaptive Gradient Fusion, respectively.

BASE M ODEL

C OMPONENTS

CE M ETRICS

NLG M ETRICS

CE AVG . ↑

S1

S2

S3

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

P ROMPT MRG

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.505 0.500 0.513 0.508 0.514

0.518 0.511 0.520 0.531 0.530

0.482 0.476 0.487 0.489 0.491

0.396 0.393 0.393 0.395 0.396

0.236 0.235 0.235 0.236 0.236

0.152 0.152 0.152 0.153 0.153

0.105 0.105 0.105 0.105 0.105

0.155 0.156 0.156 0.156 0.157

0.265 0.266 0.265 0.266 0.266

0.502 0.496 0.507 0.509 0.512

DDATR

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.408 0.439 0.434 0.425 0.432

0.444 0.452 0.446 0.467 0.463

0.418 0.436 0.425 0.435 0.438

0.393 0.396 0.403 0.402 0.405

0.235 0.240 0.244 0.244 0.245

0.152 0.158 0.160 0.160 0.161

0.106 0.111 0.111 0.113 0.113

0.158 0.160 0.157 0.162 0.161

0.267 0.271 0.270 0.272 0.273

0.423 0.442 0.435 0.442 0.444

sults of REVTAF and the CAME-Grad equipped REVTAF on the MIMIC-CXR test set. As shown in the figure, the ground truth clearly indicates diffuse right lung opacity and increased right mid lung atelectasis. However, REVTAF exhibits clinical limitations where it correctly identifies support devices by relying on high-frequency features in the upper mediastinum but fails to attend to the lung bases and misses the right-sided pathology. In contrast, the report generated by CAME-Grad aligns highly with the ground truth. It not only accurately localizes the endotracheal tube but also captures the global context to diagnose bilateral parenchymal opacities. The attention map confirms that the model successfully attends to the right lung base highlighted in cyan which is a critical region missed by the baseline model. This demonstrates that CAME-Grad successfully guides the model to focus on rare yet critical pathological features in the image by rectifying gradient direction and enhancing exploration momentum. Consequently, it significantly reduces the risk of clinical missed diagnoses and greatly improves the diagnostic credibility of the reports. More results are provided in Appendix G.

extending this SDE-based gradient dynamics optimization algorithm to a broader range of multi-task medical imaging report generation tasks, providing theoretically deeper solutions to break the optimization bottlenecks in multi-task learning.

Acknowledgements This work was supported in part by the National Natural Science Foundation of China under Grant 62472368, Grant 62302427, and Grant 62462060, in part by the National Key Research and Development Program of China under Grant 2025YFF0515600.

Impact Statement This paper advances Machine Learning in automated radiology report generation (RRG). While the proposed CAMEGrad optimizer demonstrates potential in improving diagnostic efficiency and alleviating radiologist workload, deploying such models without rigorous clinical oversight carries risks of misdiagnosis and automation bias.

5. Conclusion

We explicitly acknowledge several limitations. First, clinical efficacy is evaluated via automatic labelers (e.g., CheXbert) and lexical metrics rather than direct clinician judgment. Consequently, real-world deployment requires stronger clinical safety validations. Second, our method introduces multiple hyperparameters, adding a tuning burden. Specifically, under extreme data scarcity and gradient noise (e.g., the IU X-Ray dataset), CAME-Grad guarantees a mathematically safe lower bound but requires careful tuning to reach the performance upper bound. Finally, our theoretical interpretation of the SDE dynamics currently exceeds direct empirical validation. Bridging this gap in real-world clinical trials remains a critical direction for future work to safely translate these theoretical gains into tangible clinical benefits.

This study establishes the critical role of gradient dynamics in optimizing multi-task RRG. Our analysis reveals that the failure of traditional linear scalarization is rooted in its inability to decouple destructive gradient interference, thereby inducing the “Double Dilemma” of drift term deviation and diffusion term decay. CAME-Grad successfully overcomes this by constructing a coupling mechanism to reshape the optimization dynamics, thereby effectively reconciling the intrinsic conflict between report generation and clinical constraints. Experiments on the MIMIC-CXR and IU X-Ray datasets across eight baseline models demonstrate that CAME-Grad improves clinical efficacy by an average of 2.3% and 1.9%, respectively. Future work will focus on 9

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

References

Jing, B., Xie, P., and Xing, E. P. On the automatic generation of medical imaging reports. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 2577–2586, July 2018.

Chen, Z., Badrinarayanan, V., Lee, C.-Y., and Rabinovich, A. Gradnorm: Gradient normalization for adaptive loss balancing in deep multitask networks. In Proceedings of the International Conference on Machine Learning (ICML), pp. 794–803, 2018.

Johnson, A. E. W., Pollard, T. J., Berkowitz, S. J., Greenbaum, N. R., Lungren, M. P., Deng, C.-y., Mark, R. G., and Horng, S. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Scientific Data, 6(1):317, 2019.

Chen, Z., Song, Y., Chang, T.-H., and Wan, X. Generating radiology reports via memory-driven transformer. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1439–1449, November 2020.

Kendall, A., Gal, Y., and Cipolla, R. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7482–7491, 2018.

Chen, Z., Shen, Y., Song, Y., and Wan, X. Cross-modal memory networks for radiology report generation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (ACLIJCNLP), pp. 5904–5914, August 2021.

Li, C. Y., Liang, X., Hu, Z., and Xing, E. P. Knowledgedriven encode, retrieve, paraphrase for medical image report generation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pp. 6666–6673, 2019.

Cheng, Z., Huang, Y., Zhang, Z., Ou, D., and Liu, Q. No more tuning: Prioritized multi-task learning with lagrangian differential multiplier methods. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pp. 11536–11543, 2025.

Li, G., Huang, C., Zhou, X., Ji, D., and Zhang, H. Report is a mixture of topics: Topic-guided radiology report generation. Medical Image Analysis, 103:103586, 2025.

Demner-Fushman, D., Kohli, M. D., Rosenman, M. B., Shooshan, S. E., Rodriguez, L., Antani, S. K., Thoma, G. R., and McDonald, C. J. Preparing a collection of radiology examinations for distribution and retrieval. Journal of the American Medical Informatics Association, 23(2): 304–310, 2016.

Li, M., Lin, B., Chen, Z., Lin, H., Liang, X., and Chang, X. Dynamic graph enhanced contrastive learning for chest X-ray report generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3334–3343, 2023.

Denkowski, M. J. and Lavie, A. Meteor 1.3: Automatic metric for reliable optimization and evaluation of machine translation systems. In Proceedings of the Sixth Workshop on Statistical Machine Translation (WMT), pp. 85–91, July 2011.

Lin, C.-Y. ROUGE: A package for automatic evaluation of summaries. In Proceedings of the Workshop on Text Summarization Branches Out, pp. 74–81, 2004. Liu, B., Liu, X., Jin, X., Stone, P., and Liu, Q. Conflictaverse gradient descent for multi-task learning. In Advances in Neural Information Processing Systems (NeurIPS), volume 34, pp. 18878–18890, 2021.

Javaloy, A. and Valera, I. RotoGrad: Gradient homogenization in multitask learning. In Proceedings of the International Conference on Learning Representations (ICLR), 2022.

Liu, B., Feng, Y., Stone, P., and Liu, Q. FAMO: Fast adaptive multitask optimization. In Advances in Neural Information Processing Systems (NeurIPS), volume 36, pp. 57226–57243, 2023.

Jeong, W. and Yoon, K.-J. Quantifying task priority for multi-task optimization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 363–372, 2024.

Mandt, S., Hoffman, M. D., and Blei, D. M. Stochastic gradient descent as approximate Bayesian inference. Journal of Machine Learning Research, 18:134:1–134:35, 2017.

Jeong, W. and Yoon, K.-J. Selective task group updates for multi-task optimization. In Proceedings of the International Conference on Learning Representations (ICLR), 2025.

Navon, A., Shamsian, A., Achituve, I., Maron, H., Kawaguchi, K., Chechik, G., and Fetaya, E. Multi-task learning as a bargaining game. In Proceedings of the International Conference on Machine Learning (ICML), pp. 16428–16446, 2022.

Jin, H., Che, H., Lin, Y., and Chen, H. PromptMRG: Diagnosis-driven prompts for medical report generation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pp. 2607–2615, 2024. 10

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

Nicolson, A., Dowling, J., and Koopman, B. Improving chest X-ray report generation by leveraging warm starting. Artificial Intelligence in Medicine, 144:102633, 2023.

Wei, Y. and Hu, D. MMPareto: Boosting multimodal learning with innocent unimodal assistance. In Proceedings of the International Conference on Machine Learning (ICML), pp. 52559–52572, 2024.

Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 311–318, July 2002.

Yan, A., He, Z., Lu, X., Du, J., Chang, E. Y., Gentili, A., McAuley, J. J., and Hsu, C.-N. Weakly supervised contrastive learning for chest X-Ray report generation. In Findings of the Association for Computational Linguistics: EMNLP, pp. 4009–4015, November 2021.

Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Köpf, A., Yang, E. Z., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J., and Chintala, S. PyTorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems (NeurIPS), volume 32, pp. 8024–8035, 2019.

Yu, T., Kumar, S., Gupta, A., Levine, S., Hausman, K., and Finn, C. Gradient surgery for multi-task learning. In Advances in Neural Information Processing Systems (NeurIPS), volume 33, pp. 5824–5836, 2020. Zhou, Q., Liang, G., Li, X., Chen, J., Wang, Z., Yao, C., and Wu, S. Learnable retrieval enhanced visual-text alignment and fusion for radiology report generation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 22529–22538, 2025.

Qin, X., Wang, X., and Yan, J. Towards consistent multitask learning: Unlocking the potential of task-specific parameters. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10067–10076, 2025. Sener, O. and Koltun, V. Multi-task learning as multiobjective optimization. In Advances in Neural Information Processing Systems (NeurIPS), volume 31, pp. 525–536, 2018. Smit, A., Jain, S., Rajpurkar, P., Pareek, A., Ng, A. Y., and Lungren, M. P. Combining automatic labelers and expert annotations for accurate radiology report labeling using BERT. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1500–1519, November 2020. Song, S., Tang, H., Yang, H., and Li, X. DDaTR: Dynamic difference-aware temporal residual network for longitudinal radiology report generation. IEEE Transactions on Medical Imaging, 44(12):5345–5357, 2025. Vinyals, O., Toshev, A., Bengio, S., and Erhan, D. Show and tell: A neural image caption generator. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3156–3164, 2015. Wang, J., Bhalerao, A., and He, Y. Cross-modal prototype driven network for radiology report generation. In Proceedings of the European Conference on Computer Vision (ECCV), pp. 563–579. Springer, 2022. Wang, J., Bhalerao, A., Yin, T., See, S., and He, Y. CAMANet: Class activation map guided attention network for radiology report generation. IEEE Journal of Biomedical and Health Informatics, 28(4):2199–2210, 2024. 11

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

A. Universality Analysis of Internal Conflicts In Section 3.2.1 of the main paper, we visualized the gradient dynamics using the REVTAF backbone to illustrate the intrinsic conflict in multi-task RRG. To further demonstrate that this “Double Dilemma” is a universal challenge inherent to the task paradigm rather than a model-specific issue, we extend this analysis to another representative baseline, PromptMRG. As illustrated in Figure A.1, the gradient dynamics of PromptMRG exhibit a striking resemblance to those of REVTAF shown in the main text. Specifically, PromptMRG exhibits a negative cosine similarity ratio of 49.8%, which is highly consistent with the 53.8% conflict ratio observed in REVTAF. This implies that regardless of the architecture, the intrinsic conflict between report generation and clinical constraints persists, causing the optimization direction to oscillate frequently. Furthermore, similar to the main experiments, the mean cosine similarity here is only 2.7 × 10−3 , indicating that the effective gradient magnitude is drastically reduced due to cancellations. This empirical evidence verifies that the negative interaction term Ik ≪ 0 is a widespread bottleneck in existing multi-task RRG methods, further justifying the necessity of our proposed CAME-Grad optimizer.

Gradient Dynamics (Aggregated over 10 Epochs) 3.5

Probability Density

3.0 2.5

Gradient Density Destructive Synergy

Model: PromptMRG Dataset: MIMIC-CXR --------------------Analysis Result: Negative Ratio: 49.8% Mean Cosine: 2.7e-03 Total Samples: 169240

2.0 1.5 1.0 0.5 0.0 0.4

0.2

0.0

0.2

Gradient Cosine Similarity (cos )

0.4

Figure A.1. Visualization of Gradient Conflict in PromptMRG. We analyze the distribution of gradient cosine similarities accumulated over 10 epochs on the MIMIC-CXR dataset. The x-axis represents the cosine similarity (cos θ) between gradients. The red area indicates destructive interference (negative similarity), where gradients cancel each other out, while the green area indicates synergy. Quantitatively, the Negative Ratio is 49.8%, meaning that nearly half of the gradient updates are conflicting during the training process. The mean cosine similarity is near zero (2.7 × 10−3 ), suggesting significant optimization instability.

B. Extended Analysis on SDE Dynamics B.1. Geometric Validity of Drift Correction To theoretically address the drift bias within our mechanistic hypothesis framework, we construct a minimax optimization in the tangent space: max u

min i∈{0,...,K}

⟨gi , u⟩

s.t.

∥u − µ∥ ≤ ρ∥µ∥,

(15)

where gi denotes the gradient of the i-th task. By solving this optimization, the rectified direction u∗rect is explicitly optimized to maximize the common descent alignment among all tasks. Within the continuous-time SDE dynamics, the expected parameter drift rate is defined as: E[dΘt ] = −u∗rect . dt 12

(16)

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

This construction seeks to ensure that for each task, the first-order contribution to the local loss evolution is minimized or kept non-positive: E[dΘt ] ⟨∇Θ Li (Θt ), ⟩ = −⟨gi , u∗rect ⟩ ≤ 0. (17) dt This provides a grounded geometric mechanism to suppress directional conflicts within the trust region, thereby mitigating the drift deviation suggested by our hypothesis. B.2. Dynamical Compensation and Covariance Measurements As discussed in Section 3.3, Stage 2 compensates for the diffusion term decay by restoring and enhancing the gradient magnitude. In discrete mini-batch SGD, the parameter update along the projected direction involves implicit gradient noise û∗rect ∼ N (u∗rect , Σrect ). With amplification κ, the update becomes ∆Θ = −ηκû∗rect . The expected drift E[∆Θ] = −ηκu∗rect strictly preserves Stage 1’s Pareto validity. Meanwhile, amplifying the update magnitude by κ is dynamically equivalent to applying a larger local effective learning rate ηef f = ηκ along this 1D safe trajectory. As established in classical SGD theory (Mandt et al., 2017), increasing the effective learning rate directly amplifies the stationary covariance of implicit noise. Mathematically, since the noise covariance is proportional to the outer product of gradients: Σ(Θ) ∝ gg⊤ , (18) scaling the gradient by a factor κ results in the covariance trace growing by a factor of κ2 . Thus, CAME-Grad avoids adding unconstrained isotropic noise (which, as shown in Setting B below, destroys the clinical manifold). Instead, we use this directional scaling to amplify anisotropic exploration noise, compensating for the momentum decay caused by Stage 1’s restricted projection. To empirically verify this theoretical compensation, we monitor the evolution of the SGD noise covariance trace Tr(Σ) during the training process. For the baseline (REVTAF with linear scalarization) on the MIMIC-CXR dataset, Tr(Σ) remains at a low level of approximately 0.3215. In contrast, CAME-Grad significantly increases this physical quantity to approximately 4.4886 at convergence. This 14-fold increase in the physical measurement confirms that Stage 2 substantially enlarges the noise scale of the SDE, providing the necessary dynamical compensation to restore exploration kinetic energy. B.3. Comparative Analysis of Diffusion Mechanisms To verify the necessity of magnitude enhancement strictly along the optimized direction, we conduct a comparative analysis between CAME-Grad and isotropic noise injection (Setting B: SGLD). As shown in Table B.1, while Setting A (omitting Stage 2) improves over the baseline via drift correction, it remains suboptimal due to energy depletion. Crucially, Setting B’s drop in clinical efficacy performance reveals the inherent difficulty of unconstrained high-dimensional optimization. Although isotropic noise N (0, σ 2 I) supplements the diffusion scale, it is highly likely to be orthogonal to the true gradient manifold. This directionless noise destroys the Stage 1 Pareto projection u∗rect , causing the trajectory to deviate from the clinical semantic manifold. Conversely, CAME-Grad restores the diffusion scale by scaling the magnitude along the rectified direction, maintaining both geometric validity and exploration momentum. Table B.1. Comprehensive ablation study of diffusion mechanisms on REVTAF (MIMIC-CXR). Setting B utilizes Stochastic Gradient Langevin Dynamics (SGLD) to inject isotropic noise. CE Metrics Methods

Ablation

REVTAF (Linear) Setting A Setting B CAME-Grad (Ours)

S1+S3 S1+SGLD+S3 S1+S2+S3

NLG Metrics

Prec. ↑

Rec. ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

0.615 0.627 0.610 0.633

0.617 0.632 0.585 0.637

0.589 0.601 0.569 0.607

0.465 0.466 0.466 0.466

0.319 0.320 0.319 0.320

0.236 0.237 0.236 0.237

0.184 0.186 0.184 0.185

0.199 0.201 0.196 0.200

0.336 0.337 0.332 0.336

CE Avg. ↑ 0.607 0.620 0.588 0.626

C. Glossary of Multi-Task Optimization Terminology To provide a comprehensive background on the multi-task optimization landscape and elaborate on the technical details of CAME-Grad, we outline the core terminologies, mathematical assumptions, and implementation mechanisms discussed in 13

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

this paper. Linear Scalarization: The default and most prevalent baseline approach in multi-task learning (MTL). It formulates the globalP optimization objective as a static or dynamically weighted linear combination of individual task losses (i.e., K Ljoint = i=0 ωi Li ). While computationally efficient, it inherently fails to address directional conflicts between task gradients. Geometric Validity: A strict condition in gradient-based multi-task optimization requiring that the updated global gradient does not conflict with any individual task’s descent direction. Geometrically, it mandates that the inner product between the rectified update vector u∗rect and each task gradient gi is non-negative (i.e., ⟨u∗rect , gi ⟩ ≥ 0, meaning the angle does not exceed 90◦ ). Diffusion Kinetic Energy: Viewed through the lens of Stochastic Differential Equations (SDEs), this term represents the inherent stochastic noise and exploration capability injected by mini-batch SGD during training. In the complex loss landscape of radiology report generation, maintaining sufficient diffusion kinetic energy is essential for the model to escape sharp, suboptimal local minima. Dual Variables (α): In gradient manipulation methods, dual variables α ∈ ∆K+1 (the (K + 1)-dimensional unit simplex) are used to represent the optimal combination weights. They allow the transformation of an intractable high-dimensional conflict resolution problem in the parameter space into a solvable convex optimization problem. Trust Region Assumption: A foundational mathematical constraint in our optimization framework. It explicitly assumes that the corrected update direction u must reside within a bounded neighborhood of the mean gradient µ. This ensures that the rectified update preserves the underlying inductive bias and guarantees stable global convergence. Tensorized GPU Acceleration: An implementation mechanism designed to overcome the computational bottleneck of high-dimensional gradient manipulations. Instead of transferring parameters to the CPU, CAME-Grad solves the tensorized dual problem and executes the rectification stages directly on the GPU via parallel operations, ensuring minimal training overhead. Min-Max Trust-Region Formulation: The core theoretical outcome of the min-max formula Eq. 8 in Stage 1 is providing a mathematical guarantee for strict local Pareto descent. Specifically, the inner min operator locates the most easily sacrificed task, while the outer max operator maximizes the descent benefit of this worst task. Incorporating the trust region constraint forces the generation of a consensus direction possessing a positive inner product with all task gradients. This mathematically establishes a safe lower bound, ensuring the model never destroys the generation manifold while capturing clinical features, thus eliminating negative transfer.

D. Comprehensive Analysis on MIMIC-CXR In this section, we provide a comprehensive analysis of hyperparameter sensitivity and present the full quantitative results on the MIMIC-CXR dataset. All models were implemented following the unified experimental setup described in Section 4.3 of the main paper, ensuring a fair comparison across backbone architectures. D.1. Hyperparameter Sensitivity Table D.1 summarizes the optimal hyperparameter configurations for the eight baseline models. We observe a strong correlation between the optimal settings and the rigidity of the auxiliary tasks employed by each baseline, revealing distinct optimization behaviors across different constraint types. Models employing rigid, discrete auxiliary tasks, specifically PromptMRG, REVTAF, DDaTR, and DCL, consistently require a lower adaptive fusion coefficient (ν ∈ [0.1, 0.2]) combined with standard energy injection (κ = 1.5). This configuration is attributed to the severe gradient direction deviation caused by their respective auxiliary objectives, such as multi-label classification or retrieval-based alignment. As demonstrated in our gradient analysis, these hard constraints often induce gradients that are nearly orthogonal or opposing to the report generation manifold. Empirically, we observed that increasing ν beyond 0.3 for these models leads to a resurgence of conflict issues, manifesting as unstable convergence or regression to baseline performance. Consequently, a lower ν effectively down-weights the original joint gradient, forcing the optimization to rely more heavily on the rectified direction u∗rect computed in Stage 1 to mitigate destructive interference. In contrast, models relying on geometric or prototype-based constraints, such as XProNet and CAMANet, benefit from a 14

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Table D.1. Detailed hyperparameter settings of CAME-Grad for different baselines on MIMIC-CXR. The settings correlate with the rigidity of auxiliary tasks: models with hard constraints (e.g., Classification) generally require lower ν to rely more on rectified gradients, while soft constraints allow higher ν. ρ

κ

ν

High Conflict / Rigid Constraints PromptMRG Multi-label Classification REVTAF Retrieval & Alignment DDaTR Longitudinal Diff. DCL Graph Node Classif.

0.2 0.5 0.5 0.5

1.5 1.5 1.5 1.5

0.1 0.2 0.2 0.2

Geometric / Prototype Constraints XProNet Prototype Matching CAMANet CAM-guided Attention

0.3 0.4

1.5 1.5

0.4 0.5

Soft / Weak Constraints TGRG Topic Modeling WCL Weakly-supervised Contrastive

0.1 0.2

1.7 1.0

0.8 0.9

Model

Auxiliary Task Type

Table D.2. Complete performance comparison on the MIMIC-CXR test set with specific hyperparameter configurations. Best results for each baseline pair are highlighted in bold. The inclusion of ρ, κ, ν demonstrates the specific tuning required for each architecture.

M ODEL

P UBLICATION

WCL + CAME-G RAD

EMNLP’21

XP RO N ET + CAME-G RAD

ECCV’22

DCL + CAME-G RAD

CVPR’23

P ROMPT MRG + CAME-G RAD

AAAI’24

CAMAN ET + CAME-G RAD

JBHI’24

DDATR + CAME-G RAD

TMI’25

TGRG + CAME-G RAD

M ED IA’25

REVTAF + CAME-G RAD

ICCV’25

H YPERPARAMS

CE M ETRICS

NLG M ETRICS

CE AVG . ↑

ρ

κ

ν

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

0.2

1.0

0.9

0.382 0.424

0.298 0.324

0.312 0.344

0.329 0.349

0.203 0.219

0.136 0.150

0.098 0.108

0.135 0.142

0.277 0.284

0.331 0.364

0.3

1.5

0.4

0.382 0.391

0.304 0.309

0.314 0.322

0.325 0.329

0.202 0.204

0.137 0.138

0.099 0.099

0.134 0.135

0.260 0.261

0.333 0.341

0.5

1.5

0.2

0.265 0.319

0.246 0.298

0.236 0.286

0.234 0.280

0.136 0.162

0.087 0.104

0.061 0.074

0.108 0.122

0.211 0.220

0.249 0.301

0.2

1.5

0.1

0.505 0.514

0.518 0.530

0.482 0.491

0.396 0.396

0.236 0.236

0.152 0.153

0.105 0.105

0.155 0.157

0.265 0.266

0.502 0.512

0.4

1.5

0.5

0.405 0.410

0.303 0.313

0.321 0.330

0.327 0.327

0.202 0.203

0.136 0.137

0.097 0.099

0.134 0.135

0.274 0.275

0.343 0.351

0.5

1.5

0.2

0.408 0.432

0.444 0.463

0.418 0.438

0.393 0.405

0.235 0.245

0.152 0.161

0.106 0.113

0.158 0.161

0.267 0.273

0.423 0.444

0.1

1.7

0.8

0.457 0.493

0.435 0.466

0.417 0.450

0.423 0.438

0.258 0.268

0.164 0.173

0.109 0.117

0.162 0.169

0.284 0.285

0.436 0.470

0.5

1.5

0.2

0.615 0.633

0.617 0.637

0.589 0.607

0.465 0.466

0.319 0.320

0.236 0.237

0.184 0.185

0.199 0.200

0.336 0.336

0.607 0.626

balanced configuration with a medium fusion coefficient (ν ∈ [0.4, 0.5]). While these methods utilize prototypes or attention maps that impose structural requirements on the feature space, their constraints are softer than hard labels. The moderate ν value indicates a necessary trade-off where the optimizer must rectify conflicting components while preserving the beneficial inductive biases, such as cluster structures provided by the prototypes. Notably, CAMANet requires a larger rectification radius (ρ = 0.4), which suggests that its attention-guided gradients exhibit a higher variance in angular distribution. A broader trust region is thus necessary to prevent the optimizer from over-correcting potentially useful attention shifts, balancing stability with flexibility. Finally, for baselines incorporating loose or global semantic guidance, namely TGRG and WCL, we find that a higher fusion coefficient (ν ∈ [0.8, 0.9]) yields optimal performance. The auxiliary tasks in these models, such as topic modeling or weakly-supervised contrastive learning, provide global semantic regularization rather than per-sample penalties. This results in a high degree of synergy between tasks, allowing the optimizer to trust the original joint gradient direction. For WCL specifically, the conflict is often merely stochastic noise rather than structural misalignment, justifying the high retention of the original gradient to maintain training efficiency. Interestingly, TGRG requires the highest energy gain (κ = 1.7), likely because topic distributions induce a flatter optimization landscape, requiring stronger kinetic energy to escape local minima.

15

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Table D.3. Comprehensive ablation study of CAME-Grad across eight baseline architectures on MIMIC-CXR, ordered by publication year. We strictly compare the Baseline (Linear Scalarization) with three ablated variants and the Full model. S1: Conflict-Averse Direction Rectification; S2: Magnitude-Enhanced Energy Injection; S3: Adaptive Gradient Fusion. The results demonstrate that CAME-Grad (Full) consistently achieves the best trade-off between clinical consistency and generation quality.

BASE M ODEL

C OMPONENTS

CE M ETRICS

NLG M ETRICS

CE AVG . ↑

S1

S2

S3

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

WCL

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.382 0.412 0.412 0.379 0.424

0.298 0.304 0.331 0.275 0.324

0.312 0.322 0.341 0.293 0.344

0.329 0.341 0.352 0.332 0.349

0.203 0.213 0.220 0.204 0.219

0.136 0.144 0.150 0.137 0.150

0.098 0.105 0.108 0.099 0.108

0.135 0.139 0.142 0.136 0.142

0.277 0.280 0.282 0.274 0.284

0.331 0.346 0.361 0.316 0.364

XP RO N ET

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.382 0.362 0.392 0.389 0.391

0.304 0.279 0.307 0.303 0.309

0.314 0.294 0.321 0.317 0.322

0.325 0.329 0.323 0.323 0.329

0.202 0.205 0.200 0.199 0.204

0.137 0.139 0.135 0.134 0.138

0.099 0.101 0.098 0.096 0.099

0.134 0.134 0.134 0.132 0.135

0.260 0.262 0.259 0.257 0.261

0.333 0.312 0.340 0.336 0.341

DCL

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.265 0.288 0.290 0.313 0.319

0.246 0.262 0.276 0.291 0.298

0.236 0.255 0.262 0.281 0.286

0.234 0.281 0.279 0.294 0.280

0.136 0.162 0.161 0.170 0.162

0.087 0.105 0.104 0.110 0.104

0.061 0.074 0.074 0.077 0.074

0.108 0.122 0.121 0.125 0.122

0.211 0.222 0.222 0.223 0.220

0.249 0.268 0.276 0.295 0.301

P ROMPT MRG

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.505 0.500 0.513 0.508 0.514

0.518 0.511 0.520 0.531 0.530

0.482 0.476 0.487 0.489 0.491

0.396 0.393 0.393 0.395 0.396

0.236 0.235 0.235 0.236 0.236

0.152 0.152 0.152 0.153 0.153

0.105 0.105 0.105 0.105 0.105

0.155 0.156 0.156 0.156 0.157

0.265 0.266 0.265 0.266 0.266

0.502 0.496 0.507 0.509 0.512

CAMAN ET

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.405 0.387 0.395 0.404 0.410

0.303 0.292 0.314 0.322 0.313

0.321 0.312 0.326 0.337 0.330

0.327 0.336 0.328 0.327 0.327

0.202 0.209 0.203 0.204 0.203

0.136 0.141 0.137 0.139 0.137

0.097 0.102 0.099 0.100 0.099

0.134 0.137 0.135 0.134 0.135

0.274 0.276 0.273 0.276 0.275

0.343 0.330 0.345 0.354 0.351

DDATR

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.408 0.439 0.434 0.425 0.432

0.444 0.452 0.446 0.467 0.463

0.418 0.436 0.425 0.435 0.438

0.393 0.396 0.403 0.402 0.405

0.235 0.240 0.244 0.244 0.245

0.152 0.158 0.160 0.160 0.161

0.106 0.111 0.111 0.113 0.113

0.158 0.160 0.157 0.162 0.161

0.267 0.271 0.270 0.272 0.273

0.423 0.442 0.435 0.442 0.444

TGRG

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.457 0.483 0.483 0.484 0.493

0.435 0.487 0.467 0.448 0.466

0.417 0.455 0.445 0.436 0.450

0.423 0.440 0.436 0.429 0.438

0.258 0.268 0.269 0.260 0.268

0.164 0.175 0.176 0.169 0.173

0.109 0.119 0.121 0.114 0.117

0.162 0.169 0.169 0.166 0.169

0.284 0.287 0.290 0.285 0.285

0.436 0.475 0.465 0.456 0.470

REVTAF

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.615 0.624 0.627 0.628 0.633

0.617 0.630 0.632 0.630 0.637

0.589 0.599 0.601 0.601 0.607

0.465 0.468 0.466 0.467 0.466

0.319 0.322 0.320 0.321 0.320

0.236 0.239 0.237 0.239 0.237

0.184 0.187 0.186 0.187 0.185

0.199 0.201 0.201 0.202 0.200

0.336 0.338 0.337 0.337 0.336

0.607 0.618 0.620 0.620 0.626

D.2. Performance Evaluation Table D.2 presents the comprehensive performance comparison on the MIMIC-CXR test set. By explicitly listing the hyperparameter configuration (ρ, κ, ν) alongside Clinical Efficacy (CE) and Natural Language Generation (NLG) metrics, we demonstrate how specific tuning adapts to different backbone architectures to achieve consistent improvements. D.3. Ablation Study for Component In this subsection, we provide a detailed component analysis of CAME-Grad across eight baseline architectures. To rigorously evaluate the contribution of each algorithmic stage, we strictly compare the Full CAME-Grad model against the baseline (Linear Scalarization) and three variants, each removing one key stage: Stage 1 (Conflict-Averse Direction Rectification), Stage 2 (Magnitude-Enhanced Energy Injection), and Stage 3 (Adaptive Gradient Fusion). 16

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

Stage 1: Conflict-Averse Direction Rectification. The contribution of conflict rectification in Stage 1 is most pronounced in models employing rigid auxiliary constraints, such as PromptMRG and REVTAF. These models introduce hard constraints—multi-label classification or retrieval alignment—that often generate gradients orthogonal or even opposing to the primary generation objective. For PromptMRG, removing Stage 1 results in a significant drop in F1-score from 0.491 to 0.476, alongside a notable decrease in Precision. This validates our hypothesis that without manifold-guided rectification, the sharp gradient conflicts stemming from hard labels destructively interfere with the language modeling manifold. Similarly, for REVTAF, the removal of Stage 1 leads to a regression in clinical efficacy metrics, suggesting that projecting auxiliary gradients onto a tangent space is essential for transforming conflicting signals into beneficial guidance. Stage 2: Magnitude-Enhanced Energy Injection. Stage 2 acts as a universal stabilizer by restoring and enhancing the gradient magnitude after rectification. While Stage 1 ensures the update direction is correct, the rectification process (projection) often reduces the vector norm, potentially causing a loss of kinetic energy during optimization. Our results on XProNet and DDaTR confirm this theoretical concern. For XProNet, removing Stage 2 leads to a consistent, albeit subtle, decline in both clinical efficacy (CE Average drops from 0.341 to 0.340) and NLG metrics compared to the full model. This suggests that without energy injection, the optimizer may suffer from “gradient vanishing” in the projected space, causing it to stall in saddle points or converge slower. Restoring and enhancing the magnitude ensures that the rectified update retains sufficient momentum to escape local minima. Stage 3: Adaptive Gradient Fusion. Stage 3, governed by the adaptive fusion coefficient ν, proves critical for models with complex or weak constraints, such as WCL and DCL. This stage dynamically balances the trust between the original joint gradient and the rectified update based on the current conflict level. WCL exhibits the highest sensitivity to this stage. Removing adaptive fusion causes a catastrophic performance drop, with the F1-score plummeting from 0.344 to 0.293. This confirms that for weakly-supervised tasks, a fixed weighting scheme fails to capture the time-varying synergy between contrastive learning and language modeling. Stage 3 allows the optimizer to dynamically “trust” the original gradient when synergy is high, which is essential for preserving the training efficiency of synergistic tasks. For DCL, while removing Stage 3 marginally improves NLG scores, it degrades clinical efficacy, indicating that adaptive fusion is key to steering the model towards clinically accurate terminology rather than just fluent text. Precision-Recall Trade-off. It is also worth noting the trade-off behavior observed in models like TGRG and CAMANet. In some cases, specific ablated variants (e.g., without S1 or S3) achieve higher Recall, F1-scores, or lexical metrics than the full model. However, the full CAME-Grad configuration generally maintains highly competitive or superior Precision across most baselines. The full tri-stage mechanism effectively suppresses the generation of non-existent pathologies driven by noisy auxiliary signals. Therefore, while individual stages might occasionally be omitted to maximize specific recall-oriented metrics, the complete CAME-Grad framework provides the most robust and clinically reliable generation strategy across diverse constraint types.

E. Generalizability and Robustness Analysis on IU X-Ray In this section, we extend our evaluation to the IU X-Ray dataset to verify the generalizability of CAME-Grad across different data scales and domain distributions. We provide a detailed analysis of hyperparameter adaptation strategies in Table E.1, followed by a comprehensive performance comparison in Table E.2. E.1. Hyperparameter Sensitivity and Zero-Shot Settings Consistent with our observations on MIMIC-CXR, the optimal hyperparameter settings on IU X-Ray exhibit a strong correlation with task rigidity. However, the distinct data scarcity of the IU X-Ray dataset and our experimental setup involving cross-domain evaluation introduce specific adaptation patterns. A key distinction in our experiments is the use of zero-shot inference for PromptMRG, REVTAF, and DDaTR. As these models utilize checkpoints pre-trained on MIMIC-CXR and are evaluated directly on IU X-Ray without fine-tuning, their hyperparameter configurations (ρ, κ, ν) are strictly inherited from the MIMIC-CXR training phase. The consistent improvements in overall clinical efficacy observed in Table E.2, such as PromptMRG achieving a 0.209 CE Average compared to the 0.202 baseline, demonstrate the intrinsic transferability of the optimization trajectory found by CAME-Grad. This suggests that the rectified gradient directions computed on the source domain successfully capture generalized geometric properties of the report generation manifold, which remains valid even when transferred to a target domain with different distribution characteristics. 17

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution Table E.1. Detailed hyperparameter settings of CAME-Grad for different baselines on IU X-Ray. For zero-shot models, parameters are inherited from MIMIC-CXR (marked as -). For supervised models, we observe a general trend towards higher ν values (e.g., DCL, XProNet) for regularization, with the notable exception of WCL, which requires a lower ν to suppress increased label noise in low-resource contrastive learning. ρ

κ

ν

Zero-Shot Inference (Inherited Configs) PromptMRG Multi-label Classification REVTAF Retrieval & Alignment DDaTR Longitudinal Diff.

-

-

-

Supervised Training (High Regularization) DCL Graph Node Classif. XProNet Prototype Matching CAMANet CAM-guided Attention TGRG Topic Modeling

0.5 0.1 0.5 0.1

1.5 1.0 2.0 1.0

0.8 0.8 0.9 0.9

Supervised Training (Others) WCL Weakly-supervised Contrastive

0.1

1.1

0.4

Model

Auxiliary Task Type

Table E.2. Complete performance comparison on the IU X-Ray test set. ∗ indicates zero-shot inference, where models are evaluated directly using MIMIC-CXR checkpoints; thus, their hyperparameters are inherited rather than tuned on IU X-Ray. † denotes standard supervised training. Best results are in bold.

M ODEL

P UBLICATION

WCL† + CAME-G RAD

EMNLP’21

XP RO N ET† + CAME-G RAD

ECCV’22

DCL† + CAME-G RAD

CVPR’23

P ROMPT MRG∗ + CAME-G RAD

AAAI’24

CAMAN ET† + CAME-G RAD

JBHI’24

DDATR∗ + CAME-G RAD

TMI’25

TGRG† + CAME-G RAD

M ED IA’25

REVTAF∗ + CAME-G RAD

ICCV’25

H YPERPARAMS

CE M ETRICS

NLG M ETRICS

CE AVG . ↑

ρ

κ

ν

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

0.1

1.1

0.4

0.490 0.522

0.498 0.514

0.491 0.516

0.325 0.362

0.195 0.226

0.137 0.163

0.101 0.124

0.137 0.156

0.318 0.332

0.493 0.517

0.1

1.0

0.8

0.598 0.619

0.588 0.603

0.590 0.606

0.440 0.463

0.271 0.292

0.183 0.204

0.132 0.151

0.182 0.181

0.336 0.333

0.592 0.609

0.5

1.5

0.8

0.527 0.575

0.525 0.569

0.525 0.571

0.393 0.399

0.255 0.262

0.186 0.193

0.144 0.151

0.185 0.191

0.298 0.312

0.526 0.572

-

-

-

0.200 0.207

0.210 0.217

0.197 0.203

0.419 0.419

0.248 0.248

0.158 0.159

0.106 0.107

0.161 0.158

0.314 0.308

0.202 0.209

0.5

2.0

0.9

0.503 0.520

0.490 0.514

0.494 0.516

0.398 0.409

0.256 0.261

0.185 0.190

0.142 0.145

0.166 0.170

0.339 0.349

0.496 0.517

-

-

-

0.308 0.281

0.282 0.308

0.257 0.259

0.428 0.433

0.253 0.257

0.160 0.164

0.107 0.110

0.161 0.163

0.314 0.313

0.282 0.283

0.1

1.0

0.9

0.508 0.527

0.497 0.530

0.500 0.525

0.471 0.498

0.302 0.308

0.204 0.207

0.146 0.145

0.189 0.194

0.392 0.382

0.502 0.527

-

-

-

0.292 0.304

0.291 0.302

0.283 0.294

0.420 0.424

0.249 0.251

0.159 0.159

0.106 0.105

0.178 0.177

0.311 0.310

0.289 0.300

In contrast, for models trained from scratch on IU X-Ray, such as DCL, XProNet, CAMANet, and TGRG, we observe a significant shift towards higher fusion coefficients compared to their MIMIC-CXR counterparts. For instance, DCL requires ν = 0.2 on MIMIC-CXR but favors ν = 0.8 on IU X-Ray, and similarly, XProNet shifts from ν = 0.4 to ν = 0.8. This phenomenon is attributed to the necessity of regularization in low-resource scenarios. Since the IU X-Ray dataset contains significantly fewer samples, the generator is highly prone to overfitting the training data. In this context, auxiliary tasks such as graph node classification or prototype matching provide essential structural priors. A higher ν instructs the optimizer to retain more of the original gradient information derived from these tasks, effectively acting as a regularizer that prevents the model from collapsing into memorization. Interestingly, WCL is the only exception where the optimal ν decreases to 0.4 on IU X-Ray. This is attributed to the fact that weakly-supervised contrastive signals become significantly noisier in low-resource settings; thus, a lower ν is required to allow CAME-Grad to more aggressively rectify stochastic interference and maintain optimization stability. E.2. Quantitative Performance Comparison Table E.2 presents the comprehensive performance comparison. CAME-Grad consistently improves overall clinical efficacy, as evidenced by the gains in CE Average across all baselines, despite minor trade-offs in specific NLG metrics for some 18

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

models. Notably, even for the supervised models that require strong regularization (high ν), our method achieves substantial improvements (e.g., DCL improves by 4.6% in CE Average), validating that CAME-Grad effectively balances the trade-off between conflict resolution and structural regularization. E.3. Ablation Study for Component In this subsection, we present a comprehensive component analysis of CAME-Grad on the IU X-Ray dataset. As detailed in Table E.3, we rigorously compare the full CAME-Grad optimizer against the baseline (Linear Scalarization) and three ablated variants. Unlike the MIMIC-CXR experiments, the IU X-Ray benchmark involves a complex mix of supervised training on small-scale data and zero-shot inference using cross-domain checkpoints. This unique experimental setup reveals distinct behavioral patterns in how the three stages of CAME-Grad contribute to generalization and robustness across domains. Table E.3. Comprehensive ablation study of CAME-Grad across eight baseline architectures on IU X-Ray, ordered by publication year. ∗ and † denote zero-shot inference and supervised training, respectively. We strictly compare the Baseline (Linear Scalarization) with three ablated variants and the Full model. S1: Conflict-Averse Direction Rectification; S2: Magnitude-Enhanced Energy Injection; S3: Adaptive Gradient Fusion. CE Avg. denotes the average of Precision, Recall, and F1-score. The best results for each backbone are highlighted in bold.

BASE M ODEL

C OMPONENTS

CE M ETRICS

NLG M ETRICS

CE AVG . ↑

S1

S2

S3

P REC . ↑

R EC . ↑

F1 ↑

B-1 ↑

B-2 ↑

B-3 ↑

B-4 ↑

MTR ↑

R-L ↑

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.490 0.515 0.505 0.512 0.522

0.498 0.506 0.499 0.505 0.514

0.491 0.508 0.501 0.506 0.516

0.325 0.330 0.297 0.298 0.362

0.195 0.194 0.177 0.182 0.226

0.137 0.134 0.124 0.129 0.163

0.101 0.098 0.092 0.097 0.124

0.137 0.140 0.134 0.136 0.156

0.318 0.316 0.311 0.317 0.332

0.493 0.510 0.502 0.508 0.517

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.598 0.610 0.589 0.564 0.619

0.588 0.592 0.572 0.555 0.603

0.590 0.597 0.577 0.558 0.606

0.440 0.491 0.457 0.442 0.463

0.271 0.315 0.282 0.269 0.292

0.183 0.219 0.198 0.190 0.204

0.132 0.162 0.148 0.144 0.151

0.182 0.200 0.180 0.181 0.181

0.336 0.348 0.327 0.327 0.333

0.592 0.600 0.579 0.559 0.609

DCL†

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.527 0.558 0.575 0.537 0.575

0.525 0.551 0.571 0.531 0.569

0.525 0.553 0.572 0.532 0.571

0.393 0.396 0.384 0.386 0.399

0.255 0.260 0.245 0.250 0.262

0.186 0.192 0.176 0.182 0.193

0.144 0.150 0.134 0.140 0.151

0.185 0.192 0.179 0.188 0.191

0.298 0.310 0.296 0.301 0.312

0.526 0.554 0.573 0.533 0.572

P ROMPT MRG∗

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.200 0.194 0.205 0.203 0.207

0.210 0.203 0.211 0.221 0.217

0.197 0.191 0.199 0.202 0.203

0.419 0.417 0.413 0.411 0.419

0.248 0.244 0.243 0.243 0.248

0.158 0.153 0.155 0.155 0.159

0.106 0.101 0.104 0.104 0.107

0.161 0.157 0.158 0.158 0.158

0.314 0.304 0.309 0.306 0.308

0.202 0.196 0.205 0.209 0.209

CAMAN ET†

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.503 0.510 0.522 0.519 0.520

0.490 0.508 0.515 0.506 0.514

0.494 0.509 0.517 0.510 0.516

0.398 0.243 0.268 0.350 0.409

0.256 0.148 0.164 0.218 0.261

0.185 0.106 0.118 0.155 0.190

0.142 0.081 0.090 0.116 0.145

0.166 0.120 0.126 0.152 0.170

0.339 0.312 0.316 0.323 0.349

0.496 0.509 0.518 0.512 0.517

DDATR∗

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.308 0.305 0.305 0.301 0.281

0.282 0.277 0.293 0.304 0.308

0.257 0.251 0.249 0.265 0.259

0.428 0.425 0.432 0.430 0.433

0.253 0.249 0.258 0.253 0.257

0.160 0.157 0.165 0.159 0.164

0.107 0.105 0.111 0.106 0.110

0.161 0.161 0.164 0.163 0.163

0.314 0.309 0.321 0.312 0.313

0.282 0.278 0.282 0.290 0.283

TGRG†

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.508 0.518 0.507 0.523 0.527

0.497 0.511 0.504 0.509 0.530

0.500 0.513 0.503 0.513 0.525

0.471 0.499 0.509 0.505 0.498

0.302 0.311 0.323 0.324 0.308

0.204 0.204 0.218 0.225 0.207

0.146 0.136 0.151 0.165 0.145

0.189 0.213 0.205 0.202 0.194

0.392 0.382 0.390 0.383 0.382

0.502 0.514 0.505 0.515 0.527

REVTAF∗

× × ✓ ✓ ✓

× ✓ × ✓ ✓

× ✓ ✓ × ✓

0.292 0.304 0.299 0.305 0.304

0.291 0.303 0.298 0.301 0.302

0.283 0.295 0.289 0.294 0.294

0.420 0.429 0.422 0.436 0.424

0.249 0.254 0.250 0.260 0.251

0.159 0.162 0.160 0.168 0.159

0.106 0.108 0.106 0.114 0.105

0.178 0.176 0.176 0.177 0.177

0.311 0.310 0.310 0.314 0.310

0.289 0.301 0.295 0.300 0.300

WCL†

XP RO N ET

19

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

Stage 1: Conflict-Averse Direction Rectification. The contribution of conflict rectification is particularly pivotal for the zero-shot models, namely PromptMRG, REVTAF, and DDaTR. Since these models inherit parameters trained on MIMICCXR, the auxiliary gradients they generate—derived from multi-label classification or retrieval tasks—are intrinsically biased towards the source domain distribution. When applied directly to IU X-Ray images, these raw gradients often deviate significantly from the optimal generation direction of the target domain. For instance, in PromptMRG, removing Stage 1 leads to a notable regression in the F1-score from 0.203 to 0.191. This empirical evidence suggests that the manifold-guided rectification in Stage 1 acts as a dynamic domain adapter. By projecting the conflicting auxiliary gradients onto the tangent space of the primary objective, Stage 1 effectively filters out source-domain noise while preserving the generalized semantic features. Conversely, for REVTAF, removing Stage 1 marginally outperforms the full model (CE Avg 0.301 vs. 0.300), indicating that forced geometric alignment is counterproductive when cross-domain retrieval gradients degenerate into pure noise. Similarly, its higher NLG scores without Stage 3 confirm that completely discarding these corrupted original gradients prevents flawed retrieval priors from disrupting language fluency. Stage 2: Magnitude-Enhanced Energy Injection. Stage 2 serves as a critical stabilizer, consistent across both zero-shot and supervised settings. In low-resource scenarios like IU X-Ray, the gradient landscape is often sparse and irregular. The projection operation in Stage 1, while correcting the angular direction, inevitably reduces the gradient norm. Without energy compensation, this reduction can lead to vanishing updates and premature convergence, trapping the model in suboptimal local minima. The results on XProNet demonstrate this effect clearly. Removing Stage 2 leads to a comprehensive degradation in performance, with the average clinical efficacy dropping significantly from 0.609 to 0.579. This confirms that restoring the kinetic energy of the optimization trajectory is indispensable for traversing the rugged loss landscape of small datasets. It ensures that the model retains sufficient momentum to escape saddle points and reach a more robust solution, effectively counteracting the side effects of the geometric projection. Stage 3: Adaptive Gradient Fusion. For the supervised models trained from scratch, such as WCL, DCL, and TGRG, Stage 3 plays a critical role that extends beyond simple conflict management; it functions as a vital regularization mechanism. Given the severe data scarcity of IU X-Ray, models are highly susceptible to overfitting the training set, often manifesting as high lexical overlap but poor clinical reasoning on unseen data. Stage 3 governs how much the optimizer relies on the structural priors provided by auxiliary tasks versus the data-driven language modeling loss. In the case of WCL, removing Stage 3 causes the F1-score to decline from 0.516 to 0.506. This indicates that a fixed fusion strategy fails to dynamically leverage the global semantic regularization provided by contrastive learning. By adaptively up-weighting the auxiliary gradients when the synergy is high—consistent with the higher fusion coefficients observed in our hyperparameter analysis—Stage 3 prevents the generator from collapsing into memorization. It forces the model to respect the auxiliary structural constraints, ensuring that the learned representations remain robust and generalizable to the test set. Trade-off Analysis. Finally, we observe an interesting trade-off regarding Natural Language Generation metrics in specific baselines. For models like XProNet, the variant without Stage 1 occasionally yields higher BLEU scores than the full model. However, this increase in surface-level fluency comes at the cost of clinical accuracy, as evidenced by the lower Precision and Recall scores. This phenomenon suggests that without the constraint of conflict rectification, the model may overfit to frequent linguistic patterns in the training captions, generating fluent but factually incorrect reports. CAME-Grad prioritizes clinical correctness by suppressing these ungrounded language priors, ensuring that the generated reports are not only readable but, more importantly, diagnostically accurate.

F. Performance of Auxiliary Classification Task Assessing the auxiliary classification task is fundamental to ensuring that gradient rectification does not compromise the underlying clinical supervisory signals. In the multi-task radiology report generation (RRG) framework, the classification branch provides critical diagnostic anchors that ground the primary generative manifold. To comprehensively evaluate this multi-label classification performance, we report the Area Under the Curve (AUC), Precision, Recall, and F1-score. Given the inherent long-tailed disease distribution in the MIMIC-CXR dataset, we calculate both Macro-averaged metrics (which treat each of the 14 observation classes equally) and Micro-averaged metrics (which aggregate contributions globally to account for class imbalance). This dual perspective ensures a rigorous and unbiased assessment of the auxiliary branch’s diagnostic capacity. As summarized in Table F.1, CAME-Grad demonstrates robust performance preservation and enhancement on the auxiliary 20

The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

branch across different backbones. On the PromptMRG baseline, the Macro F1-score improves from 0.404 to 0.415, while the Micro F1-score increases from 0.585 to 0.593. For the REVTAF backbone, CAME-Grad yields a notable gain in the Macro F1-score from 0.595 to 0.610. Although the Macro Precision of REVTAF exhibits a minor reduction from 0.654 to 0.651, the overall diagnostic efficacy reflected by the AUC and F1-score consistently improves. These findings confirm that CAME-Grad effectively resolves mutual interference and achieves synergistic optimization across both tasks, allowing the model to reach a superior equilibrium between diagnostic accuracy and report quality. Table F.1. Classification performance comparison on the MIMIC-CXR dataset. The best results for each baseline pair are highlighted in bold. AUC and F1-score provide a comprehensive evaluation of the auxiliary diagnostic branch.

M ODEL

P UBLICATION

P ROMPT MRG + CAME-G RAD REVTAF + CAME-G RAD

M ACRO M ETRICS

M ICRO M ETRICS

AUC ↑

P REC . ↑

R EC . ↑

F1 ↑

AUC ↑

P REC . ↑

R EC . ↑

F1 ↑

AAAI’24

0.811 0.814

0.439 0.460

0.387 0.397

0.404 0.415

0.874 0.877

0.610 0.617

0.562 0.571

0.585 0.593

ICCV’25

0.905 0.907

0.654 0.651

0.562 0.588

0.595 0.610

0.936 0.938

0.741 0.742

0.702 0.721

0.721 0.732

G. Extended Qualitative Analysis In this section, we provide an extended qualitative evaluation to intuitively demonstrate the clinical accuracy and coherence of the reports generated by CAME-Grad. Figure G.1 compares the qualitative results of the baseline PromptMRG and the CAME-Grad equipped PromptMRG on the MIMIC-CXR test set. As illustrated in the case, the Ground Truth (GT) clearly indicates “areas of moderate retrocardiac atelectasis” along with the presence of multiple support devices. However, the baseline PromptMRG exhibits serious clinical limitations driven by visual tunnel vision. It allocates excessive attention to the support devices in the upper mediastinum, generating redundant descriptions of catheter positions (e.g., “projects 4 cm above the carina”). Consequently, it completely fails to attend to the retrocardiac region—indicated by the cold blue regions in its attention map—and misses the critical finding of atelectasis. In contrast, the report generated by the model optimized by CAME-Grad aligns highly with the gold standard. It not only accurately verifies the support devices but also successfully penetrates the anatomical occlusion to diagnose “subsequent areas of atelectasis”. The attention map further confirms that the model successfully attended to the retrocardiac region highlighted in cyan/yellow, a critical pathological area missed by the baseline model. This demonstrates that CAME-Grad successfully guides the model to explore distinct discriminative features beyond salient objects (like tubes) by rectifying gradient direction and enhancing exploration momentum. Consequently, it significantly reduces the risk of clinical missed diagnoses and greatly improves the diagnostic credibility of the reports. Ground Truth: as compared to the previous radiograph the previously visible right internal jugular vein catheter has been removed . the patient is still intubated with an unchanged position of the endotracheal tube nasogastric tube and the right picc line . unchanged moderate cardiomegaly . unchanged mild-to-moderate right pleural effusion unchanged mild fluid overload and areas of moderate retrocardiac atelectasis . there is no newly occurred focal parenchymal opacity .", PromptMRG Attention Map

MISSED: Moderate

PromptMRG: Retrocardiac Atelectasis as compared to the previous radiograph the patient has been intubated. the tip of the endotracheal tube projects 4 cm above the carina. the patient has also received a nasogastric tube. the course of the tube is unremarkable the tip of the tube projects over the middle parts of the stomach the sidehole is approximately 5 cm below the gastroesophageal junction. no evidence of complications. unchanged moderate cardiomegaly with bilateral pleural effusions and signs of mild - to - moderate fluid overload.",

+ CAME-Grad (Ours) Attention Map

+CAME-Grad (Ours): as compared to the previous radiograph there is no relevant change. the monitoring and support devices are constant. moderate cardiomegaly with bilateral pleural effusions and subsequent areas of atelectasis. mild fluid overload is present in unchanged manner. the lung volumes have slightly increased potentially reflecting increased ventilatory pressure. no newly appeared parenchymal changes. the nasogastric tube and the endotracheal tube are in constant position."

Figure G.1. Qualitative comparison and attention visualization on the MIMIC-CXR test set. The Ground Truth report is shown at the top. The PromptMRG baseline (left) is distracted by the support devices in the upper mediastinum and misses the “moderate retrocardiac atelectasis” (marked in red). In contrast, CAME-Grad (right) successfully allocates attention to the retrocardiac region (highlighted by the cyan arrow and heatmap hotspot) and correctly identifies the atelectasis, demonstrating superior anatomical consistency.

21

Record · ID 216845 · SHA-256 02c1540d4703dd36
Retrieved via Conceptio — every document is proof-bundled with source, license, and retrieval metadata.