Conceptio › Archive › arXiv CS
arXiv CS open access

ScreenShot: A Foundation Model for Few-Shot Combination Drug Screening

2026 · arxiv_cs
arXiv CS · Papers · 2026
Open Source ↗Direct PDF ↓
deep-learningmachine-learningneural-networks
Conceptio Open Archive

Analyze & explore related research in Conceptio

Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.

ScreenShot: A Foundation Model for Few-Shot Combination Drug Screening

Antoine de Mathelin, Christopher Tosh and Wesley Tansey Computational Oncology Memorial Sloan Kettering Cancer Center New York, NY 10065 tanseyw@mskcc.org

arXiv:2608.12219v1 [cs.LG] 12 Aug 2026

Abstract Treating patients with combinations of drugs reduces the risk of resistance to any individual drug. Finding effective combinations is difficult because the large search space makes combinatorial screens prohibitively expensive, time consuming, and often technically infeasible. Predictive models can fill this gap, yet existing methods typically require molecular profiling of each sample and per-cohort training, limiting their applicability when time and tissue are scarce. To address this challenge, we introduce ScreenShot, a hierarchical transformer pretrained on 40 drug screening datasets covering 3,700 drugs and 6,000 biological samples, whose architecture mirrors the nested structure of screening data. Given a few-shot context of observations from a new patient, ScreenShot predicts the response of the sample to combination therapies through in-context learning, operating directly on functional measurements with no fine-tuning and no molecular profiling. On four held-out datasets, ScreenShot outperforms all baselines in both prediction accuracy and identification of selectively effective treatments. ScreenShot’s internal representations are directly useful for experimental design: we use them to drive a weighted k-means++ active learning strategy that selects which experiments to run, achieving the same hit detection as uniform screening with a third of the budget. Source code and interactive dashboard: https://github.com/tansey-lab/screenshot.

1

Introduction

Drug screens enable functional characterization of tumors in terms of vulnerabilities to candidate therapies. Screens in triple negative breast cancer [1], fibrolamellar carcinoma [2], glioblastoma [3, 4], pancreatic adenocarcinoma [5–7], acute myeloid leukemia [8, 9], and epithelial ovarian cancers [10–12] have revealed novel vulnerabilities and new potential therapies for patients. Multiple recent clinical trials [13, 14] have integrated drug screens into the clinical decision making process and demonstrated that screen-guided treatments can improve patient outcomes. A key limitation of existing screens and trials is the inability to scale the number of experiments. In many clinical settings, only a small number of cells can be gathered, limiting the number of experiments possible. Further, all trials to-date have focused on single drug screens with combinations designed based on ad hoc assessments of putative drug targets and the perceived molecular susceptibility of a tumor to combination targeting. Similarly, the largest combination screens to-date [15–17] screened only a small subset of combinations, since exhaustively enumerating all combinations would have been cost and time prohibitive. There is a pressing need to develop methods for combination drug screens that maximize sample efficiency and can determine responses to a broad panel of drugs based on relatively few observations. Preprint.

To address this need, we developed ScreenShot, a transformer-based foundation model for few-shot prediction in combination drug screens. ScreenShot performs in-context learning at inference: given a small set of drug-dose-viability measurements from a new patient sample, it predicts the remaining (untested) responses, without fine-tuning and without requiring molecular profiling of the sample. This contrasts with prior methods that rely on genomic or transcriptomic features to encode biological context [18–20], which are often unavailable or inconsistent for patient-derived samples [21]. By operating directly on the functional measurements produced by the screen, ScreenShot can be applied to new samples with no feature engineering and without the need for time and cost-intensive molecular profiling. Beyond prediction, we develop a multi-round active learning strategy to identify the most effective treatments with minimal experimental budget. The strategy selects experiments using k-means++ seeding [22] in ScreenShot’s embedding space, weighting candidates by their predicted effectiveness to prioritize likely hits while ensuring diversity across rounds. In our benchmarks, our adaptive selection algorithm achieves the same hit recall as uniform selection with only a third of the budget. Our contributions are: • Foundation model for functional drug response. We introduce ScreenShot, a hierarchical transformer pretrained on a pan-cancer collection of 40 drug screen datasets, which predicts dose-response behavior for new patient samples via in-context learning using only drugdose-viability measurements (no omics features; no per-patient finetuning). • Embedding-driven experimental design. We develop a practical screening policy that uses ScreenShot’s pretrained drug-dose embeddings for cold-start batch selection and its context-conditioned embeddings for active learning, explicitly trading off testing promising treatments with broad coverage of the drug-dose design space. • Strong empirical performance. We demonstrate state-of-the-art few-shot prediction and hit detection on held-out monotherapy and combination screens, outperforming XGBoost [23], TabPFN [24], and pretrained neural network baselines across budgets.

2

Method

2.1

Problem formulation

We consider a drug screen setting in which a biological sample s (e.g., a cell line or organoid) is treated with a drug combination d = (d1 , . . . , dq ) at respective doses δ = (δ1 , . . . , δq ), producing a viability measurement y ∈ [0, 1]. The combination size q varies across experiments (e.g., q=1 for monotherapy, q=2 for pairwise combinations, etc.). We assume a fixed drug library of size M , and encode each drug identity as an integer index d ∈ {1, . . . , M }; doses are real-valued, δ ∈ R. Given a small context set of labeled observations for a new sample s, Ds = {(dj , δ j , yj )}nj=1 , our goal is to predict the viability for untested drug-dose queries (d′ , δ ′ ) on the same sample, outputting a prediction ŷ. To best match many precision medicine settings where only small biopsies and thus limited cells are available, we assume that no molecular profiling of s (e.g., gene expression or mutation data) is available: the model must condition only on the observed (drug, dose, viability) tuples in Ds . Formally, ScreenShot is a parametric predictor fθ with parameters θ ∈ RW that maps a query perturbation and its context to a viability estimate,  n  fθ : {1, . . . , M }q × Rq × {1, . . . , M }q × Rq × [0, 1] → [0, 1], ŷ = fθ (d′ , δ ′ ), Ds . | {z } |{z} | {z } | {z } query

few-shot context

query

context

This differs from the classical transfer-learning approach, where one first trains a global predictor hθ : {1, . . . , M }q × Rq → [0, 1] and then fine-tunes it on Ds to obtain sample-specific parameters θs , yielding predictions ŷ = hθs (d′ , δ ′ ). In contrast, ScreenShot follows the paradigm of recent foundation models for tabular data such as TabPFN [24], and amortizes the adaptation step by conditioning directly on Ds via cross-attention, effectively replacing explicit fine-tuning with in-context inference. This design is practical and computationally efficient, and avoids the hyperparameter-sensitive fine-tuning trade-offs between fitting Ds and preserving prior knowledge (e.g., learning rate, number of epochs, and regularization) [25, 26]. 2

Figure 1: Overview of the ScreenShot architecture. ScreenShot processes drug screening data through a three-level hierarchy. Level 1: all drug + dose embeddings are combined via self-attention within each drug combination by the Drug Combination Encoder (DCE). Level 2: query combinations attend to context observations (augmented with observed viability) via cross-attention through the Response Encoder (RE). Level 3: perturbation-level embeddings are aggregated via self-attention across the sample by the Sample Encoder (SE), producing a final representation for viability prediction.

2.2

Model architecture

ScreenShot is a hierarchical transformer that leverages the compositional structure of drug screening data (Figure 1). The key observation is that measurements for a fixed drug combination across different dose levels naturally form a group (a dose-response curve) and that each combination is itself composed of individual drugs. Rather than representing the entire context as a single flat sequence of observations, ScreenShot organizes it into three nested levels: Level 1: drug-dose combination (perturbation), Level 2: response to the perturbation, Level 3: aggregation of all perturbations across the sample. An analogy in natural language processing is to first encode words into sentence representations and then attend across sentences in a document, instead of attending over all words in the document at once [27]. For a target query (d′ , δ ′ ), ScreenShot performs cross-attention between the query representation and the context at Level 2, enabling it to retrieve and aggregate evidence from dose-response curves of similar perturbations. All three encoders at the three levels use the same transformer configuration: 5 attention blocks, 8 heads, GeLU activations. The hierarchical architecture is motivated by both modeling and practical considerations. First, the hierarchy mirrors the data generating structure and yields representations at multiple granularities (individual drug, combination, and sample-level) that can be reused in downstream tasks. Second, it reduces the computational cost of attention. A naïve flat-attention model over all n context observations would require O(n2 ) attention computations. In contrast, the hierarchical design factorizes this cost into: (i) cross-attention from the query to context observations at Level 2, O(n), and (ii) self-attention across perturbations, O(p2 ), where p is the number of unique perturbations in the context. For a typical screen with n=300 observations comprising p=50 unique perturbations at 6 dose points each, the dominant attention cost decreases from 3002 =90,000 to 502 =2,500 attention entries. This shares the same computational motivation as efficient attention methods that mitigate the quadratic cost via local or block-sparse patterns [28, 29]; however, in our case the partition is induced by the assay structure rather than an arbitrary chunking of the input sequence. Drug, dose, and viability embeddings. Each drug identity di in the library is mapped to a learned embedding edi ∈ RD via an embedding table. Crucially, these representations are learned purely from function, namely how drugs affect viability across diverse samples, doses, and combination partners, rather than from chemical structure. This makes ScreenShot agnostic to drug modality (e.g., small molecules, natural products, antibodies) and more flexible than approaches based on 3

molecular descriptors, which may be incomplete or unavailable for certain compound classes. For novel compounds not present in the pretraining corpus, the model uses dedicated UNK embeddings that are learned jointly during pretraining and allow the model to rely on in-context observations to infer the drug’s behavior (see Section C). Doses and viabilities are encoded via learned Fourier features ϕ(·) that map continuous scalars to RD (details in Section A). We use D=256 throughout. Drug combination encoder (Level 1). The drug embedding and dose encoding are summed, hk = edk + ϕ(δk ), and the resulting sequence (h1 , . . . , hq ) is processed by a transformer encoder. Self-attention allows each drug token to attend to the other drugs in the combination, capturing interaction effects. The outputs are aggregated via masked average pooling into a single combination embedding c ∈ RD . Because the number of drugs q is handled through attention masking, the same architecture natively supports monotherapies, pairs, and higher-order combinations without any structural modification. This encoder is applied to each context perturbation (dj , δ j ), yielding a sequence of embeddings (c1 , . . . , cn ), and is likewise applied to the query (d′ , δ ′ ) to produce a query embedding c′ . Response encoder (Level 2). At this level, ScreenShot conditions the query embedding c′ on the sample-specific context using multi-head cross-attention. Each context observation is represented by augmenting its combination embedding with the measured viability, c̃j = cj + ϕy (yj ). The context is then grouped by unique perturbation (i.e., all dose points measured for the same drug combination). Cross-attention is applied separately within each group: the query c′ attends to the observations in perturbation group g, producing a group-conditioned query representation r′g . Repeating this over all groups produces (r′1 , . . . , r′p ), one representation per observed perturbation. When predicting multiple queries for the same sample, this procedure is applied independently to each query, so that predictions depend only on the shared context and the corresponding query. Sample encoder (Level 3). ScreenShot then aggregates information across the perturbations observed for the same sample. The sequence (r′1 , . . . , r′p ) is processed by a transformer encoder with multi-head self-attention, allowing evidence to propagate across perturbations (e.g., response patterns for one drug informing predictions for related drugs). The resulting query representation is mapped to a viability estimate via a linear prediction head followed by a sigmoid, producing ŷ ∈ [0, 1]. 2.3

Pretraining

ScreenShot is pretrained on a pan-cancer drug screening atlas [21] spanning both monotherapy and combination assays across diverse screening technologies and biological systems. Overall, the corpus contains approximately 30M viability measurements across about 4k drugs and 6k biological samples, including cancer cell lines as well as patient-derived models such as ex vivo cultures and organoids. Training follows an in-context learning objective that matches the downstream setting. Let Strain denote the set of biological samples available during pretraining, where each sample s ∈ Strain comes with a set of labeled observations Ds . At each training step, we sample a biological sample s ∼ Strain , then draw a context set D ⊂ Ds and a query set Q ⊂ Ds uniformly at random, with elements of the form (d, δ, y). We train ScreenShot to predict the query viabilities conditioned on the context, ŷ = fθ (d, δ), D for each (d, δ, y) ∈ Q. To handle technical noise (e.g. failed experiments) in the data, we optimize θ by minimizing the mean absolute error over the query set,  1 L(θ) = Es,D,Q  |Q|

 X



fθ (d, δ), D − y  ,

(d,δ,y)∈Q

which is more robust to outliers than the mean squared error. No molecular profiling features are used at any stage; the model is trained only from drug identity, dose, and observed viability in the context. Implementation details are provided in Sections A and B. 4

Algorithm 1 Multi-round active learning with ScreenShot Require: Unlabeled pool U, cold-start budget n0 , budget per round b, rounds T 1: Compute drug-dose embeddings ct for all t ∈ U ▷ Level 1 (DCE) 2: Ds ← k-medoids({ct }, n0 ); and obtain labels for Ds ▷ Cold-start 3: for r = 1, . . . , T do 4: Predict ŷt for all t ∈ U using ScreenShot conditioned on Ds 5: ∆t = ŷtarget,t − minc∈C ŷc,t for each t ∈ / Ds 6: wt = max(−∆t , 0) ▷ Prioritize predicted hits 7: Extract embeddings ht for all t ∈ U ▷ Level 3 (SE) 8: B ← k-means++({ht }t∈D / s , b, {wt }, init={ht }t∈Ds ); and obtain labels for B 9: Ds ← Ds ∪ B 10: end for 11: return Final predictions from ScreenShot conditioned on Ds

2.4

Few-shot inference

At inference time, ScreenShot is applied to a previously unseen sample s ∼ Stest , drawn from a heldout cohort. Given a small context set of labeled measurements Ds , the model is queried on untested drug-dose conditions. ScreenShot conditions on Ds through cross-attention and produces predictions ŷ for each query. No gradient updates or fine-tuning are performed: the model generalizes to new samples entirely through its pretrained attention mechanism, which learns to condition on the provided context. This is analogous to in-context learning in large language models, where a pretrained transformer adapts its predictions based on the input prompt without updating its weights [30, 24]. 2.5

Active learning pipeline

ScreenShot enables few-shot screening: given a small set of (drug, dose, viability) observations from a new sample, it predicts the remaining responses through in-context inference. The practical bottleneck is therefore deciding which experiments to measure. Because ScreenShot’s prediction accuracy depends on the context it receives, we seek a budgeted strategy for selecting context points that helps the model identify the most effective and selective treatments as quickly as possible. We use a multi-round design in which we select a batch of treatments to measure, append the new observations to the context, and re-run ScreenShot to update predictions and representations. Cold-start batch. The first batch must be chosen before any viability is observed for the target sample, which is the cold-start setting [31]. At this stage, we rely on representations that do not require labels. We compute Level 1 drug-dose embeddings for all candidate treatments and select an initial batch using k-medoids clustering [32]. This targets coverage in the pretrained treatment space, providing a diverse initial context that is informative on average across samples. Adaptive batches. After observing the initial measurements, ScreenShot produces contextconditioned representations for each candidate treatment. While these representations could be used with generic rules such as coverage (k-medoids) or uncertainty-based acquisition, we found it more effective to drive selection by the downstream objective: identifying selective hits. For each (sample) (control) unobserved treatment t, we compute predicted differential viability ∆t = ŷt − ŷt , where the control term is defined as in Section 4. Strongly negative ∆t indicates predicted selectivity. To select the next batch, we run weighted k-means++ seeding [22] on the context-conditioned treatment representations. Candidates are weighted by wt = max(−∆t , 0) to prioritize predicted hits. Treatments already selected in previous rounds are included as fixed initial centers, so that new selections are pushed away from already-observed regions of the treatment space. We compare this objective-driven policy to coverage-only and uncertainty-based alternatives in Section I; we find it recovers top hits more efficiently under the same budget.

3

Related work

Drug response prediction. Machine learning for drug response prediction has been extensively studied, with deep learning methods proposed for monotherapy sensitivity [33, 34, 18–20, 35] and 5

combination synergy [36–41]. A pervasive limitation is the reliance on genomic or transcriptomic features to represent biological samples, which restricts applicability to patient-derived samples where such profiling is often unavailable or inconsistent [21]. Transfer learning approaches [42–44] partially address the data scarcity problem by pretraining on cell line databases, but still require overlapping molecular features between source and target domains. ScreenShot removes this requirement entirely, operating only on drug-dose-viability measurements. Foundation models and in-context learning. Foundation models pretrained on large corpora and adapted through in-context learning, without fine-tuning on the target task, have achieved strong few-shot performance in natural language processing [30] and, more recently, on tabular data [24, 45, 46]. This paradigm replaces the fragile fine-tuning step, which is sensitive to learning rate, regularization, and dataset size [25, 26], with a single forward pass conditioned on a context set. ScreenShot adopts this paradigm for drug screening: it is pretrained on a pan-cancer atlas and performs in-context inference on new patients. Several concurrent works explore foundation models or in-context learning for drug response prediction [47–49, 21]. However, these approaches present significant limitations. Some rely on knowledge encoded in large language models, requiring prior literature on the sample, which is unavailable for patient-derived cells [48, 47]. Others predict binary synergy labels rather than continuous dose-response, a strictly less flexible setting since dose-response models can derive synergy but not the reverse [48, 49]. All process context observations through flat attention, scaling quadratically in context size. Most do not release pretrained weights [48, 49, 21], and Pichotta et al. [21] is limited to monotherapy. ScreenShot addresses all of these limitations. Active learning for drug screening. Active learning has shown promise for drug screening [50–55]. Existing methods for batch combination screening typically balance exploration and exploitation through uncertainty-based acquisition [56, 57] and retrain the predictive model after each batch. Cold-start selection of the initial batch using coverage-based methods has also been explored [31]. Building upon these works, we propose an adaptive selection strategy that performs the exploration-exploitation tradeoff through efficacy-weighted k-means++ seeding in ScreenShot’s learned embedding space, avoiding the computational overhead of uncertainty estimation due to posterior sampling or ensemble construction [58, 59].

4

Experiments

4.1

Experimental setup

Datasets. We pretrain ScreenShot on a curated collection of 40 drug screening datasets comprising approximately 30M viability measurements across ∼3,700 drugs and ∼6,000 biological samples (full list in Section B). Pretraining uses the Adam optimizer with learning rate 10−5 for ∼400K iterations on a single NVIDIA H100 GPU; further details are in Sections A and B. For evaluation, we hold out four datasets not seen during pretraining. Three are pairwise combination screens, which include observations for both drug combinations and monotherapies: NCI-ALMANAC [16] screens 104 drugs in ∼5,000 pairwise combinations across the NCI-60 cancer cell line panel; GDSC-SQ [17] screens 65 drugs in ∼1,300 combinations across 126 breast, colorectal, and pancreatic cancer cell lines; and BATCHIE [53] screens 207 drugs in ∼19,000 combinations across 16 cell lines (14 cancer plus 2 non-cancerous controls). For faster evaluation, we use 10 cell lines from NCI-ALMANAC and GDSC-SQ. The fourth, PDO-Breast [1], is a purely monotherapy ex vivo screen of 16 breast cancer patient-derived organoid models treated with 46 drugs (∼81K observations). Including PDO-Breast tests generalization to the monotherapy-only setting. For each sample in the evaluation datasets, we randomly select n ∈ {50, 100, 150, 200, 250, 300} observations as few-shot context and predict viability for all remaining held-out observations. Metrics. We evaluate predictions along two complementary axes. For prediction quality, we report Pearson correlation r between predicted and true viability values. For hit detection, the primary practical goal in drug screening, we measure the ability to identify selectively effective treatments: drug combinations that reduce viability in the target cancer sample more than in non-cancerous controls. Following Tosh et al. [53], we quantify selectivity via the therapeutic index of a drug combination d, defined as the minimum differential viability over its dose grid: h i TI(d, s) = min ys,(d,δ) − min yc,(d,δ) , (1) c∈C

δ

6

A

Monotherapy (PDO-Breast)

C

Combination (BATCHIE)

Ibrutinib

INK 128

Vemurafenib

0.8

0.6

0.6

0.2

200

250

300

Chance

10

Top-10% hits in top-20% (%)

100 80 60 40 20 10

50

100

150

200

Few-shot samples

250

50

TabPFN XGBoost

ScreenShot

B Top-10% hits in top-20% (%)

150

300

100

150

200

Few-shot samples

250

300

MLP (fine-tuned) MLP (target-only)

0.25

1.00 0.75 0.50 0.25 0.00 1.00

TabPFN

100

Few-shot samples

75

0.75 0.50 0.25 0.00

60

1.00

XGBoost

50

0.50 0.00

0.2 10

0.75

0.4

MLP (fine-tuned)

0.4

ScreenShot

0.8

Pearson r

Pearson r

1.00

45 30

0.75 0.50 0.25 0.00

10

50

100

150

200

Few-shot samples

250

-5

-3

-1

Log-Dose

1

-5

-3

-1

Log-Dose

1

-5

-3

-1

Log-Dose

1

300

Prediction

Data

Few-shot obs

Figure 2: Few-shot dose-response prediction on held-out datasets. (A) Pearson correlation as a function of the number of few-shot observations on the PDO-Breast screen (left) and BATCHIE screen (right). (B) Top-10% hit recall in the top-20% predictions (PDO-Breast, left; BATCHIE, right). (C) Example dose-response curves for three drugs on sample HCI-003 (PDO-Breast) at n=100. where s is the target sample, C is the set of control samples, and the outer minimum selects the dose at which the target is most sensitive relative to controls. Strongly negative TI indicates a selectively effective treatment. For PDO-Breast, a monotherapy screen, we instead rank drugs by the mean differential viability across doses (i.e., the difference in area under the dose-response curve between target and control), which is a standard measure of single-drug efficacy. For the BATCHIE dataset, C consists of two non-cancerous cell lines (RPE and BJ) included in the screen by design. For NCI-ALMANAC, GDSC-SQ, and PDO-Breast, which lack designated controls, we select the cell line with the highest average viability across all treatments as a proxy control, under the assumption that non-cancerous samples are on average more resistant to drug treatment, a pattern confirmed empirically in BATCHIE, where the two non-cancerous controls rank first and third in average viability. We define ground-truth hits as the 10% of treatments with the most negative true TI per sample, and report hit recall: the fraction of true top-10% hits recovered among the top-20% of treatments ranked by predicted TI, averaged across non-control samples. When computing predicted TI for evaluation, we use ground-truth viability values for the control samples. This benefits all methods equally and reduces evaluation noise; it is also realistic, as controls are shared across targets and would be measured exhaustively in practice. For the active learning acquisition strategy, we use model predictions for controls: using ground truth would selectively benefit adaptive strategies over random and cold-start, since only adaptive methods use the predicted delta for selection (details in Section D). Baselines. We compare ScreenShot against four baselines. XGBoost and TabPFN [24] both use 512-dimensional Morgan fingerprints [60] concatenated with dose as input features; XGBoost hyperparameters are selected via 5-fold cross-validation, while TabPFN performs in-context learning. MLP (target-only) is a multi-layer perceptron with learned drug and dose embeddings, trained from scratch on each target sample. MLP (fine-tuned) uses the same architecture, pretrained on the same 40-dataset corpus as ScreenShot and fine-tuned on the target sample (see Section E.2 for more details). These baselines span the main axes of methodological variation: no pretraining (XGBoost, MLP target-only), general-purpose pretraining (TabPFN), and domain-specific pretraining with fine-tuning (MLP fine-tuned, the closest comparator to ScreenShot). All baselines receive the same observations as ScreenShot. A systematic comparison with existing drug screening models from the literature (Section E) shows that none jointly handle combination screens, dose information, and omics-free 7

Table 1: Few-shot prediction across four held-out drug screening datasets. Values: mean±std across 3 to 5 repetitions. Bold: best per column within each dataset. Time: average wall-clock seconds per experiment. Bottom: average score normalized by ScreenShot (1.00 = ScreenShot level). Pearson r 10

50

100

200

300

10

50

100

200

PDO-B R .

XGBoost TabPFN MLP MLP-FT ScreenShot

.18±.07 .13±.04 .07±.02 .73±.02 .78±.01

.61±.01 .64±.01 .28±.03 .77±.01 .81±.01

.70±.01 .72±.01 .45±.03 .79±.01 .82±.00

.77±.01 .79±.01 .62±.02 .81±.01 .84±.00

.82±.00 .82±.00 .69±.01 .82±.00 .85±.00

40.8±6.3 46.4±5.3 50.7±6.1 79.5±2.8 78.7±2.5

57.1±4.8 62.4±4.0 49.3±4.1 81.6±1.7 81.9±2.2

70.1±3.7 70.7±3.4 57.3±7.6 86.4±1.7 87.7±2.4

81.9±4.0 83.7±4.6 76.8±4.9 91.5±3.5 93.6±1.7

89.9±3.3 192 90.7±2.7 127 84.0±3.4 1156 93.3±1.3 1180 96.0±1.6 8

NCI

XGBoost TabPFN MLP MLP-FT ScreenShot

.11±.03 .16±.03 .12±.01 .51±.01 .58±.02

.25±.02 .26±.01 .18±.01 .57±.01 .65±.01

.35±.02 .32±.01 .23±.01 .61±.01 .68±.00

.48±.00 .43±.01 .25±.05 .65±.01 .72±.01

.56±.01 .50±.01 .35±.02 .67±.01 .74±.00

24.0±1.5 24.6±1.8 24.8±2.9 34.6±0.8 44.5±3.9

28.5±1.7 30.1±0.9 30.0±1.7 38.2±0.8 51.0±2.3

33.0±4.2 33.0±4.3 32.2±1.7 40.6±1.1 54.8±1.1

42.6±1.5 41.1±2.8 36.4±1.8 48.5±1.5 61.1±2.2

50.0±0.5 47.8±1.9 40.6±1.9 49.5±2.8 63.0±0.6

118 524 710 726 68

GDSC-SQ

XGBoost TabPFN MLP MLP-FT ScreenShot

.19±.04 .28±.04 .25±.05 .51±.03 .60±.02

.47±.03 .44±.01 .39±.01 .63±.02 .71±.00

.59±.01 .54±.01 .48±.04 .68±.02 .73±.01

.70±.01 .68±.01 .58±.02 .72±.01 .76±.00

.75±.01 .75±.01 .66±.01 .76±.00 .78±.01

26.5±2.7 30.3±2.9 27.5±2.0 38.9±2.5 39.8±2.1

41.9±1.8 43.0±4.4 41.6±3.9 49.9±2.7 51.7±1.0

51.5±4.1 49.3±2.2 45.7±3.1 54.8±2.2 54.4±2.9

61.0±0.5 60.1±0.4 55.3±2.1 62.5±0.5 58.2±0.7

66.0±2.4 66.3±1.2 60.8±2.2 66.0±1.7 60.6±0.6

137 655 735 737 64

BATCHIE

Time

XGBoost TabPFN MLP MLP-FT ScreenShot

.12±.04 .16±.04 .15±.03 .62±.04 .75±.01

.42±.02 .38±.03 .30±.03 .72±.01 .82±.00

.54±.01 .50±.02 .45±.01 .75±.01 .83±.01

.67±.01 .64±.01 .59±.01 .78±.01 .86±.00

.73±.00 .69±.01 .66±.02 .80±.01 .87±.00

29.2±3.9 33.9±2.2 33.7±3.5 45.9±4.9 63.9±3.1

39.9±2.5 33.0±4.8 45.2±2.7 54.6±2.4 69.0±2.4

44.0±4.0 37.2±3.5 55.3±1.4 59.7±1.8 72.6±3.0

51.8±2.0 44.7±1.2 63.9±4.2 66.3±0.8 75.0±2.5

55.0±2.0 196 49.3±1.6 432 68.7±2.1 1152 68.7±2.1 1142 76.0±1.4 22

AVG

Top-hit recall (%) 300

XGBoost TabPFN MLP MLP-FT ScreenShot

0.23 0.28 0.23 0.87 1.00

0.58 0.57 0.39 0.90 1.00

0.71 0.67 0.52 0.92 1.00

0.82 0.79 0.64 0.94 1.00

0.88 0.85 0.72 0.95 1.00

0.54 0.61 0.60 0.87 1.00

0.66 0.67 0.66 0.88 1.00

0.74 0.71 0.71 0.89 1.00

0.83 0.80 0.80 0.93 1.00

0.89 0.86 0.86 0.94 1.00

(s)

9.48 13.59 56.23 56.98 1.00

inference, which precludes direct benchmarking. Code, pretrained models, and an interactive dashboard are available at https://github.com/tansey-lab/screenshot. 4.2

Few-shot prediction

We first evaluate all methods with randomly selected few-shot observations. Figure 2A and B show that ScreenShot outperforms all baselines on both the PDO-Breast monotherapy ex vivo screen and the BATCHIE combination screen, in both Pearson correlation and hit recall, across all budgets. The gap between ScreenShot and the second-best method (MLP fine-tuned) is larger on the combination screen, which is a more challenging setting due to the combinatorial treatment space. Figure 2C shows dose-response predictions for one PDO-Breast sample (HCI-003) at n=100. The three drugs illustrate different few-shot regimes: Vemurafenib has two context observations, INK 128 has one, and Ibrutinib has none. ScreenShot fits the ground truth more closely in all three cases. Table 1 extends the comparison to all four held-out datasets. ScreenShot achieves the highest Pearson correlation on every dataset and budget, and the highest hit recall on 16 out of 20 dataset/budget combinations. The advantage is largest at low budgets, where pretraining matters most: at n=10 on BATCHIE, ScreenShot reaches 63.9% hit recall compared to 45.9% for the next-best method, and on NCI-ALMANAC the gap over MLP fine-tuned exceeds 13 percentage points at n=300. ScreenShot is also 5–50× faster than all baselines. 4.3

Active learning for hit detection

We now compare different strategies for selecting the few-shot observations, all using ScreenShot as the underlying predictor. We consider four strategies: random selection (the baseline used in Section 4.2); cold-start selection via k-medoids on drug-dose embeddings; and two adaptive strategies that allocate 33% of the budget to a cold-start batch and the remainder to delta-guided adaptive rounds (Algorithm 1), with either one round (batch size = 67% of budget) or two rounds (two batches of 33%). 8

A

B

C

True hits recovered (%)

Top-10% hits in top-20% (%)

84 80 76 72 100

200

300

80

40

Random Cold-start Adaptive 1 Adaptive 2

20

0

Budget Random

97 97

GDSC-SQ

Random Cold-start Adaptive 1 Adaptive 2

60

0

Batchie

Random Cold-start Adaptive 1 Adaptive 2

100

20

40

60

80

100

142 157

NCI

0

Drug combos examined (%) Cold-start (K-medoids)

Adaptive (1 round)

198

Adaptive (2 rounds)

91 97 96

100

200

300 274

300

300 300

Budget Chance

Figure 3: Active learning for hit identification. (A) Hit recall (top-10% hits in top-20% predictions) as a function of total budget on BATCHIE. (B) Cumulative hit recall curves at budget 300 on BATCHIE, showing that the ranking is robust to the choice of prediction set size. (C) Budget required to match random selection at budget 300, across three datasets. Figure 3A shows that the adaptive approach yields a significant improvement on BATCHIE: at budget 300, adaptive selection reaches ∼85% hit recall compared to ∼76% for both random and cold-start selection, a 9 percentage-point gain. Cold-start selection alone does not significantly improve over random on this dataset. Figure 3B shows cumulative recall curves at budget 300: the adaptive variants recover a larger fraction of true hits at every prediction set size, confirming that the improvement is robust to the choice of top-k threshold. Figure 3C extends the analysis to three datasets via a budget equivalence comparison: for each method, we report the budget needed to match the hit recall of random selection at budget 300 (obtained by linear interpolation between evaluated budgets). Adaptive strategies require 2–3× less budget than random to reach the same recall. Cold-start selection helps on some datasets (notably NCI). The number of adaptive rounds has a modest effect; the dominant factors are the total budget and whether adaptive selection is used at all. This is encouraging for clinical applications, where sample availability naturally limits the number of experimental rounds.

5

Discussion and limitations

Drug coverage. ScreenShot is designed to assist in large-scale pharmacological screens for compounds that have experimental data in the literature. The pretrained library covers ∼3,700 unique drugs resolved through PubChem, providing at least 89% coverage on all four evaluation datasets (Section C). For novel compounds, the model uses pretrained UNK tokens that allow it to leverage few-shot context observations to infer the drug’s behavior; we evaluate the effect of UNK tokens compared to alternatives in Section C and show that they are beneficial. Compared to methods relying on Morgan fingerprints as drug representation in our benchmark, ScreenShot consistently performs better. As the corpus of public drug screening data grows, the pretrained library will naturally expand. Architecture. An ablation study (Section H) confirms that each level of the hierarchy improves prediction quality and that the hierarchical design is faster than flat attention. Removing the Level 3 self-attention reduces inference time with only a modest drop in hit recall, suggesting that future work could explore lighter alternatives to the sample-level self-attention while preserving accuracy. Accuracy vs. hit detection. The active learning ablation (Section I) reveals that global prediction accuracy and hit detection ability are not directly linked. Using MC dropout uncertainty as selection weights instead of predicted delta yields the best MAE and Pearson correlation but 6 percentage points lower hit recall on BATCHIE (78.6% vs. 84.8% at budget 300). This suggests that uncertainty-guided selection targets regions of model ignorance rather than regions of differential drug sensitivity. When the goal is to identify top hits, weighting by the objective of interest (therapeutic index) is more effective than reducing global uncertainty. 9

Acknowledgements WT is supported by the NIH/NCI (R37 CA271186, U54 CA274492, P30 CA008748), Break Through Cancer, the Fund for Innovation in Cancer Informatics, the Cancer AI Alliance, the Tow Center for Developmental Oncology, and the Maurice Campbell Initiative at Memorial Sloan Kettering Cancer Center.

References [1] Katrin P Guillen, Maihi Fujita, Andrew J Butterfield, Sandra D Scherer, Matthew H Bailey, Zhengtao Chu, Yoko S DeRose, Ling Zhao, Emilio Cortes-Sanchez, Chieh-Hsiang Yang, et al. A human breast cancer-derived xenograft and organoid platform for drug discovery and precision oncology. Nature cancer, 3(2):232–250, 2022. [2] Gadi Lalazar, David Requena, Lavoisier Ramos-Espiritu, Denise Ng, Patrick D Bhola, Ype P De Jong, Ruisi Wang, Nicole JC Narayan, Bassem Shebl, Solomon Levin, et al. Identification of novel therapeutic targets for fibrolamellar carcinoma using patient-derived xenografts and direct-from-patient screening. Cancer Discovery, 11(10):2544–2563, 2021. [3] Jin-Ku Lee, Zhaoqi Liu, Jason K. Sa, Sang Shin, Jiguang Wang, Mykola Bordyuh, Hee Jin Cho, Oliver Elliott, Timothy Chu, Seung Won Choi, et al. Pharmacogenomic landscape of patientderived tumor cells informs precision oncology therapy. Nature Genetics, 50(10):1399–1411, 2018. [4] Patrik Johansson, Cecilia Krona, Soumi Kundu, Milena Doroszko, Sathishkumar Baskaran, Linnéa Schmidt, Claire Vinel, Elin Almstedt, Ramy Elgendy, Ludmila Elfineh, et al. A patientderived cell atlas informs precision targeting of glioblastoma. Cell Reports, 32(2), 2020. [5] Hervé Tiriac, Pascal Belleau, Dannielle D. Engle, Dennis Plenker, Astrid Deschênes, Tim D. D. Somerville, Fieke E. M. Froeling, Richard A. Burkhart, Robert E. Denroche, Gun-Ho Jang, et al. Organoid profiling identifies common responders to chemotherapy in pancreatic cancer. Cancer Discovery, 8(9):1112–1129, 2018. [6] Else Driehuis, Arne van Hoeck, Kat Moore, Sigrid Kolders, Hayley E. Francies, M. Can Gulersonmez, Edwin C. A. Stigter, Boudewijn Burgering, Veerle Geurts, Ana Gracanin, et al. Pancreatic cancer organoids recapitulate disease and allow personalized drug screening. Proceedings of the National Academy of Sciences, 116(52):26580–26590, 2019. [7] Christian K. Hirt, Tijmen H. Booij, Linda Grob, Patrik Simmler, Nora C. Toussaint, David Keller, Doreen Taube, Vanessa Ludwig, Alexander Goryachkin, Chantal Pauli, et al. Drug screening and genome editing in human pancreatic cancer organoids identifies drug-gene interactions and candidates for off-label therapy. Cell Genomics, 2(2), 2022. [8] Shawn HR Lee, Wenjian Yang, Yoshihiro Gocho, August John, Lauren Rowland, Brandon Smart, Hannah Williams, Dylan Maxwell, Jeremy Hunt, Wentao Yang, et al. Pharmacotypes across the genomic landscape of pediatric acute lymphoblastic leukemia and impact on treatment response. Nature Medicine, 29(1):170–179, 2023. [9] Amy Burd, Ross L Levine, Amy S Ruppert, Alice S Mims, Uma Borate, Eytan M Stein, Prapti Patel, Maria R Baer, Wendy Stock, Michael Deininger, et al. Precision medicine treatment in acute myeloid leukemia using prospective genomic profiling: feasibility and preliminary efficacy of the beat aml master trial. Nature Medicine, 26(12):1852–1858, 2020. [10] Jason K. Sa, Jae Ryoung Hwang, Young-Jae Cho, Ji-Yoon Ryu, Jung-Joo Choi, Soo Young Jeong, Jihye Kim, Myeong Seon Kim, E. Sun Paik, Yoo-Young Lee, et al. Pharmacogenomic analysis of patient-derived tumor cells in gynecologic cancers. Genome Biology, 20(1), 2019. ISSN 1474-760X. doi: 10.1186/s13059-019-1848-3. [11] Filipe Correia Martins, Dominique-Laurent Couturier, Ines de Santiago, Carolin Margarethe Sauer, Maria Vias, Mihaela Angelova, Deborah Sanders, Anna Piskorz, James Hall, Karen Hosking, et al. Clonal somatic copy number altered driver events inform drug sensitivity in high-grade serous ovarian cancer. Nature Communications, 13(1), 2022. 10

[12] Astrid Murumägi, Daniela Ungureanu, Suleiman Khan, Mariliina Arjama, Katja Välimäki, Aleksandr Ianevski, Philipp Ianevski, Rebecka Bergström, Alice Dini, Anna Kanerva, et al. Drug response profiles in patient-derived cancer cells across histological subtypes of ovarian cancer: real-time therapy tailoring for a patient with low-grade serous carcinoma. British Journal of Cancer, 128(4):678–690, 2022. [13] Heike Peterziel, Nora Jamaladdin, Dina ElHarouni, Xenia F. Gerloff, Sonja Herter, Petra Fiesel, Yannick Berker, Mirjam Blattner-Johnson, Kathrin Schramm, Barbara C. Jones, et al. Drug sensitivity profiling of 3D tumor tissue cultures in the pediatric precision oncology program INFORM. NPJ Precision Oncology, 6(1), 2022. [14] Loretta M S Lau, Chelsea Mayoh, Jinhan Xie, Paulette Barahona, Karen L MacKenzie, Marie Wong, Alvin Kamili, Maria Tsoli, Tim W Failes, Amit Kumar, et al. In vitro and in vivo drug screens of tumor cells identify novel therapies for high-risk child cancer. EMBO Molecular Medicine, 14(4), 2021. [15] Jennifer O’Neil, Yair Benita, Igor Feldman, Melissa Chenard, Brian Roberts, Yaping Liu, Jing Li, Astrid Kral, Serguei Lejnine, Andrey Loboda, et al. An unbiased oncology compound screen to identify novel combination strategies. Molecular Cancer Therapeutics, 15(6):1155–1162, 2016. ISSN 1538-8514. doi: 10.1158/1535-7163.mct-15-0843. [16] Susan L. Holbeck, Richard Camalier, James A. Crowell, Jeevan Prasaad Govindharajulu, Melinda Hollingshead, Lawrence W. Anderson, Eric Polley, Larry Rubinstein, Apurva Srivastava, Deborah Wilsker, Jerry M. Collins, and James H. Doroshow. The National Cancer Institute ALMANAC: A comprehensive screening resource for the detection of anticancer drug pairs with enhanced therapeutic activity. Cancer Research, 77(13):3564–3576, 2017. ISSN 0008-5472. [17] Patricia Jaaks, Elizabeth A Coker, Daniel J Vis, Olivia Edwards, Emma F Carpenter, Simonetta M Leto, Lisa Dwane, Francesco Sassi, Howard Lightfoot, Syd Barthorpe, et al. Effective drug combinations in breast, colon and pancreatic cancer cells. Nature, 603(7899):166–173, 2022. [18] Brent M Kuenzi, Jisoo Park, Samson H Fong, Kyle S Sanchez, John Lee, Jason F Kreisberg, Jianzhu Ma, and Trey Ideker. Predicting drug response and synergy using a deep learning model of human cancer cells. Cancer cell, 38(5):672–684, 2020. [19] Qiao Liu, Zhiqiang Hu, Rui Jiang, and Mu Zhou. Deepcdr: a hybrid graph convolutional network for predicting cancer drug response. Bioinformatics, 36(Supplement_2):i911–i918, 2020. [20] Ingoo Jin and Hojung Nam. Hidra: Hierarchical network for drug response prediction with attention. Journal of Chemical Information and Modeling, 61(8):3858–3867, 2021. [21] Karl Pichotta, Jessica B White, Jeffrey F Quinn, Anneliese Markus, Christopher Tosh, Antoine De Mathelin, Erin Coyne, Feiyang Huang, and Wesley Tansey. A pan-cancer ex vivo drug screen atlas for functional precision oncology. bioRxiv, pages 2026–02, 2026. [22] David Arthur and Sergei Vassilvitskii. k-means++: The advantages of careful seeding. In Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 1027–1035, 2007. [23] Tianqi Chen and Carlos Guestrin. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 785–794, 2016. [24] Noah Hollmann, Samuel Müller, Lennart Purucker, Arjun Krishnakumar, Max Körfer, Shi Bin Hoo, Robin Tibor Schirrmeister, and Frank Hutter. Accurate predictions on small data with a tabular foundation model. Nature, 637(8045):319–326, 2025. [25] Jeremy Howard and Sebastian Ruder. Universal language model fine-tuning for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 328–339, 2018. 11

[26] Marius Mosbach, Maksym Andriushchenko, and Dietrich Klakow. On the stability of fine-tuning bert: Misconceptions, explanations, and strong baselines. In 9th International Conference on Learning Representations, 2021. [27] Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. Hierarchical attention networks for document classification. In Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pages 1480–1489, 2016. [28] Rewon Child, Scott Gray, Alec Radford, and Ilya Sutskever. Generating long sequences with sparse transformers. arXiv preprint arXiv:1904.10509, 2019. [29] Manzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, et al. Big bird: Transformers for longer sequences. Advances in neural information processing systems, 33: 17283–17297, 2020. [30] Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. In Advances in Neural Information Processing Systems, volume 33, pages 1877–1901, 2020. [31] Antoine de Mathelin, Christopher Tosh, and Wesley Tansey. Addressing the cold-start problem for personalized combination drug screening. In Machine Learning in Computational Biology, pages 230–239. PMLR, 2025. [32] Leonard Kaufman and Peter J. Rousseeuw. Finding Groups in Data: An Introduction to Cluster Analysis. John Wiley & Sons, 1990. [33] Theodore Sakellaropoulos, Konstantinos Vougas, Sonali Narang, Filippos Koinis, Athanassios Kotsinas, Alexander Polyzos, Tyler J Moss, Sarina Piha-Paul, Hua Zhou, Eleni Kardala, et al. A deep learning framework for predicting response to therapy in cancer. Cell reports, 29(11): 3367–3373, 2019. [34] Pengfei Liu, Hongjian Li, Shuai Li, and Kwong-Sak Leung. Improving prediction of phenotypic drug response on cancer cell lines using deep convolutional network. BMC Bioinformatics, 20 (1):408, 2019. [35] Tuan Nguyen, Giang TT Nguyen, Thin Nguyen, and Duc-Hau Le. Graph convolutional networks for drug response prediction. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 19(1):146–154, 2022. [36] Kristina Preuer, Richard PI Lewis, Sepp Hochreiter, Andreas Bender, Krishna C Bulusu, and Günter Klambauer. Deepsynergy: predicting anti-cancer drug synergy with deep learning. Bioinformatics, 34(9):1538–1546, 2018. [37] Jinxian Wang, Xuejun Liu, Siyuan Shen, Lei Deng, and Hui Liu. Deepdds: deep graph neural network with attention mechanism to predict synergistic drug combinations. Briefings in Bioinformatics, 23(1):bbab390, 2022. [38] Fatemeh Rafiei, Hojjat Zeraati, Karim Abbasi, Jahan B Ghasemi, Mahboubeh Parsaeian, and Ali Masoudi-Nejad. Deeptrasynergy: drug combinations using multimodal deep learning with transformers. Bioinformatics, 39(8):btad438, 2023. [39] Halil Ibrahim Kuru, Oznur Tastan, and A Ercument Cicek. Matchmaker: A deep learning framework for drug synergy prediction. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 19(4):2334–2344, 2022. [40] Mohamed Reda El Khili, Safyan Aman Memon, and Amin Emad. Marsy: a multitask deeplearning framework for prediction of drug combination synergy scores. Bioinformatics, 39(4): btad177, 2023. 12

[41] Heli Julkunen, Anna Cichońska, Prson Gautam, Sandor Szedmak, Jane Douat, Tapio Pahikkala, Tero Aittokallio, and Juho Rousu. Leveraging multi-way interactions for systematic prediction of pre-clinical drug combination effects. Nature Communications, 11(1):6136, 2020. [42] Jianzhu Ma, Samson H Fong, Yunan Luo, Christopher J Bakkenist, John Paul Shen, Soufiane Mourragui, Lodewyk FA Wessels, Marc Hafner, Roded Sharan, Jian Peng, et al. Few-shot learning creates predictive models of drug response that translate from high-throughput screens to individual patients. Nature Cancer, 2(2):233–244, 2021. [43] Casey Sederman, Tonya Di Sera, Yi Qiao, Xiaomeng Huang, Bryan E Welm, Alana L Welm, and Gabor Marth. Screendl: A transfer learning framework integrating tumor omics and functional drug screening for personalized clinical drug response prediction. Cancer Research, 84(6_Supplement):907–907, 2024. [44] Soufiane MC Mourragui, Marco Loog, Daniel J Vis, Kat Moore, Anna G Manjon, Mark A van de Wiel, Marcel JT Reinders, and Lodewyk FA Wessels. Predicting patient response with models trained on cell lines and patient-derived xenografts by nonlinear transfer learning. Proceedings of the National Academy of Sciences, 118(49):e2106682118, 2021. [45] Myung Jun Kim, Léo Grinsztajn, and Gaël Varoquaux. CARTE: Pretraining and transfer for tabular learning. In International Conference on Machine Learning, 2024. [46] Junwei Ma, Valentin Thomas, Rasa Hosseinzadeh, Alex Labach, Jesse C Cresswell, Keyvan Golestan, Guangwei Yu, Anthony L Caterini, and Maksims Volkovs. Tabdpt: Scaling tabular foundation models on real data. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025. [47] Tianyu Liu, Tinyi Chu, Xiao Luo, and Hongyu Zhao. Building a unified model for drug synergy analysis powered by large language models. Nature Communications, 16(1):4537, 2025. [48] Tianhao Li, Sandesh Shetty, Advaith Kamath, Ajay Jaiswal, Xiaoqian Jiang, Ying Ding, and Yejin Kim. Cancergpt for few shot drug pair synergy prediction using large pretrained language models. NPJ Digital Medicine, 7(1):40, 2024. [49] Carl Edwards, Aakanksha Naik, Tushar Khot, Martin D Burke, Heng Ji, and Tom Hope. Synergpt: In-context learning for personalized drug synergy prediction and drug design. In First Conference on Language Modeling, 2024. [50] Daniel Reker and Gisbert Schneider. Active-learning strategies in computer-assisted drug discovery. Drug discovery today, 20(4):458–465, 2015. [51] David E Graff, Eugene I Shakhnovich, and Connor W Coley. Accelerating high-throughput virtual screening through molecular pool-based active learning. Chemical science, 12(22): 7866–7881, 2021. [52] Ying Yang, Kun Yao, Matthew P Repasky, Karl Leswing, Robert Abel, Brian K Shoichet, and Steven V Jerome. Efficient exploration of chemical space with docking and deep learning. Journal of Chemical Theory and Computation, 17(11):7106–7119, 2021. [53] Christopher Tosh, Mauricio Tec, Jessica B White, Jeffrey F Quinn, Glorymar Ibanez Sanchez, Paul Calder, Andrew L Kung, Filemon S Dela Cruz, and Wesley Tansey. A bayesian active learning platform for scalable combination drug screens. Nature Communications, 16(1):156, 2025. [54] Paul Bertin, Jarrid Rector-Brooks, Deepak Sharma, Thomas Gaudelet, Andrew Anighoro, Torsten Gross, Francisco Martínez-Peña, Eileen L Tang, MS Suraj, Cristian Regep, et al. RECOVER identifies synergistic drug combinations in vitro through sequential model optimization. Cell Reports Methods, 3(10), 2023. [55] Shuhui Wang, Alexandre Allauzen, Philippe Nghe, and Vaitea Opuu. A guide for active learning in synergistic drug discovery. Scientific Reports, 15(1):3484, 2025. [56] David D Lewis. A sequential algorithm for training text classifiers: Corrigendum and additional data. In Acm Sigir Forum, volume 29, pages 13–19. ACM New York, NY, USA, 1995. 13

[57] Burr Settles. Active learning literature survey. 2009. [58] Yarin Gal and Zoubin Ghahramani. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In International Conference on Machine Learning, pages 1050–1059. PMLR, 2016. [59] Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. Simple and scalable predictive uncertainty estimation using deep ensembles. Advances in neural information processing systems, 30, 2017. [60] David Rogers and Mathew Hahn. Extended-connectivity fingerprints. Journal of chemical information and modeling, 50(5):742–754, 2010. [61] Daniel Bottomly, Nicola Long, Anna Reister Schultz, Stephen E. Kurtz, Cristina E. Tognon, Kara Johnson, Melissa Abel, Anupriya Agarwal, Sammantha Avaylon, Erik Benton, et al. Integrative analysis of drug response and clinical outcome in acute myeloid leukemia. Cancer Cell, 40(8):850–864, 2022. [62] Nishanth Ulhas Nair, Patricia Greninger, Xiaohu Zhang, Adam A. Friedman, Arnaud Amzallag, Eliane Cortez, Avinash Das Sahu, Joo Sang Lee, Anahita Dastur, Regina K. Egan, et al. A landscape of response to drug combinations in non-small cell lung cancer. Nature Communications, 14(1), 2023. [63] Johannes Betge, Niklas Rindtorff, Jan Sauer, Benedikt Rauscher, Clara Dingert, Haristi Gaitantzi, Frank Herweck, Kauthar Srour-Mhanna, Thilo Miersch, Erica Valentini, et al. The drug-induced phenotypic landscape of colorectal cancer organoids. Nature Communications, 13(1), 2022. [64] Alejandra Bruna, Oscar M. Rueda, Wendy Greenwood, Ankita Sati Batra, Maurizio Callari, Rajbir Nath Batra, Katherine Pogrebniak, Jose Sandoval, John W. Cassidy, Ana TufegdzicVidakovic, et al. A biobank of breast cancer explants with preserved intra-tumor heterogeneity to screen anticancer compounds. Cell, 167(1):260–274, 2016. [65] Jordi Barretina, Giordano Caponigro, Nicolas Stransky, Kavitha Venkatesan, Adam A. Margolin, Sungjoon Kim, Christopher J. Wilson, Joseph Lehár, Gregory V. Kryukov, Dmitriy Sonkin, et al. The Cancer Cell Line Encyclopedia enables predictive modelling of anticancer drug sensitivity. Nature, 483(7391):603–607, 2012. [66] Amrita Basu, Nicole E. Bodycombe, Jaime H. Cheah, Edmund V. Price, Ke Liu, Giannina I. Schaefer, Richard Y. Ebright, Michelle L. Stewart, Daisuke Ito, Stephanie Wang, et al. An interactive resource to identify cancer genetic and lineage dependencies targeted by small molecules. Cell, 154(5):1151–1161, 2013. [67] Brinton Seashore-Ludlow, Matthew G. Rees, Jaime H. Cheah, Murat Cokol, Edmund V. Price, Matthew E. Coletti, Victor Jones, Nicole E. Bodycombe, Christian K. Soule, Joshua Gould, et al. Harnessing connectivity in a large-scale small-molecule sensitivity dataset. Cancer Discovery, 5(11):1210–1223, 2015. [68] Chelsea Mayoh, Jie Mao, Jinhan Xie, Gábor Tax, Shu-Oi Chow, Roxanne Cadiz, Karina Pazaky, Paulette Barahona, Pamela Ajuyah, Peter Trebilcock, Angela Malquori, Kate Gunther, Anica Avila, Doo-Young Yun, Stephanie Alfred, Anjana Gopalakrishnan, Alvin Kamili, Marie Wong, Mark J. Cowley, Sophie Jessop, Loretta M S Lau, Toby N. Trahair, David S. Ziegler, Jamie I. Fletcher, Andrew J. Gifford, Maria Tsoli, Glenn M. Marshall, Michelle Haber, Vanessa Tyrrell, Tim W. Failes, Greg M Arndt, Richard B. Lock, Paul G. Ekert, and M Emmy M Dolman. High-throughput drug screening of primary tumor cells identifies therapeutic strategies for treating children with high-risk cancer. Cancer Research, 83:2716–2732, 2023. [69] Adam A. Friedman, Arnaud Amzallag, Iulian Pruteanu-Malinici, Subash Baniya, Zachary A. Cooper, Adriano Piris, Leeza Hargreaves, Vivien Igras, Dennie T. Frederick, Donald P. Lawrence, et al. Landscape of targeted anti-cancer drug synergies in melanoma identifies a novel BRAF-VEGFR/PDGFR combination treatment. PLOS ONE, 10(10):e0140310, 2015. 14

[70] Adam A. Friedman, Yun Xia, Lorenzo Trippa, Long Phi Le, Vivien Igras, Dennie T. Frederick, Jennifer A. Wargo, Kenneth K. Tanabe, Donald P. Lawrence, Donna S. Neuberg, et al. Feasibility of ultra-high-throughput functional screening of melanoma biopsies for discovery of novel cancer drug combinations. Clinical Cancer Research, 23(16):4680–4692, 2017. [71] Wanjuan Yang, Jorge Soares, Patricia Greninger, Elena J. Edelman, Howard Lightfoot, Simon Forbes, Nidhi Bindal, Dave Beare, James A. Smith, I. Richard Thompson, et al. Genomics of Drug Sensitivity in Cancer (GDSC): A resource for therapeutic biomarker discovery in cancer cells. Nucleic Acids Research, 41(D1):D955–D961, 2013. [72] Helen H.N. Yan, Hoi Cheong Siu, Simon Law, Siu Lun Ho, Sarah S.K. Yue, Wai Yin Tsui, Dessy Chan, April S. Chan, Stephanie Ma, Ka On Lam, et al. A comprehensive human gastric cancer organoid biobank captures tumor subtype heterogeneity and enables therapeutic screening. Cell Stem Cell, 23(6):882–897, 2018. [73] Nora Liebers, Peter-Martin Bruch, Tobias Terzer, Miguel Hernandez-Hernandez, Nagarajan Paramasivam, Donnacha Fitzgerald, Heidi Altmann, Tobias Roider, Carolin Kolb, Mareike Knoll, et al. Ex vivo drug response profiling for response and outcome prediction in hematologic malignancies: the prospective non-interventional SMARTrial. Nature Cancer, 4:1648–1659, 2023. [74] Ryan J. Ice, Michelle Chen, Max Sidorov, Tam Le Ho, Rinette W. L. Woo, Aida RodriguezBrotons, Tri Luu, Damon Jian, Kevin B. Kim, Stanley P. Leong, et al. Drug responses are conserved across patient-derived xenograft models of melanoma leading to identification of novel drug combination therapies. British Journal of Cancer, 122(5):648–657, 2019. [75] Gustave Ronteix, Jean Bouteiller, Anna-Rose Gryspeert, Alice Boileve, Cartry Jerome, Jacques RR Mathieu, Sabrina Bedja, Michel Pierre Ducreux, and Fanny Jaulin. Cohort-level patient-derived organoid assays and prediction of clinical trial outcomes in pdac, 2025. [76] Reid T. Powell, Abena Redwood, Xuan Liu, Lei Guo, Shirong Cai, Xinhui Zhou, Yizheng Tu, Xiaomei Zhang, Yuan Qi, Yan Jiang, et al. Pharmacologic profiling of patient-derived xenograft models of primary treatment-naïve triple-negative breast cancer. Scientific Reports, 10(1), 2020. [77] Disha Malani, Ashwini Kumar, Oscar Brück, Mika Kontro, Bhagwan Yadav, Monica Hellesøy, Heikki Kuusanmäki, Olli Dufva, Matti Kankainen, Samuli Eldfors, et al. Implementing a functional precision medicine tumor board for acute myeloid leukemia. Cancer Discovery, 12 (2):388–401, 2021. [78] Kohta Toshimitsu, Ai Takano, Masayuki Fujii, Kazuhiro Togasaki, Mami Matano, Sirirat Takahashi, Takanori Kanai, and Toshiro Sato. Organoid screening reveals epigenetic vulnerabilities in human colorectal cancer. Nature Chemical Biology, 18(6):605–614, 2022. [79] Ling Li, Hildur Knutsdottir, Ken Hui, Matthew J. Weiss, Jin He, Benjamin Philosophe, Andrew M. Cameron, Christopher L. Wolfgang, Timothy M. Pawlik, Gabriel Ghiaur, et al. Human primary liver cancer organoids reveal intratumor and interpatient drug response heterogeneity. JCI Insight, 4(2), 2019. [80] Suk Hyung Lee, Wenhuo Hu, Justin T. Matulay, Mark V. Silva, Tomasz B. Owczarek, Kwanghee Kim, Chee Wai Chua, LaMont J. Barlow, Cyriac Kandoth, Alanna B. Williams, et al. Tumor evolution and drug response in patient-derived organoid models of bladder cancer. Cell, 173(2): 515–528, 2018. [81] Ahmad Al Shihabi, Peyton J. Tebon, Huyen Thi Lam Nguyen, Jomjit Chantharasamee, Sara Sartini, Ardalan Davarifar, Alexandra Y Jensen, Miranda Diaz-Infante, Hannah Cox, Alfredo Gonzalez, et al. The landscape of drug sensitivity and resistance in sarcoma. Cell stem cell, 31 (10):1524–1542, 2024. [82] Ziyue Gu, Yanli Yao, Guizhu Yang, Guopei Zhu, Zhen Tian, Rui Wang, Qi Wu, Yujue Wang, Yaping Wu, Lan Chen, et al. Pharmacogenomic landscape of head and neck squamous cell carcinoma informs precision oncology therapy. Science Translational Medicine, 14(661): eabo5987, 2022. 15

[83] Eric Polley, Mark Kunkel, David Evans, Thomas Silvers, Rene Delosh, Julie Laudeman, Chad Ogle, Russell Reinhart, Michael Selby, John Connelly, et al. Small cell lung cancer screen of oncology drugs, investigational agents, and gene and microRNA expression. Journal of the National Cancer Institute, 108(10), 2016. [84] Tea Pemovska, Mika Kontro, Bhagwan Yadav, Henrik Edgren, Samuli Eldfors, Agnieszka Szwajda, Henrikki Almusa, Maxim M. Bespalov, Pekka Ellonen, Erkki Elonen, et al. Individualized systems medicine strategy to tailor treatments for patients with chemorefractory acute myeloid leukemia. Cancer Discovery, 3(12):1416–1429, 2013. [85] Antoine de Mathelin, Nicolas Enrique Cecchi, François Deheeger, Mathilde Mougeot, and Nicolas Vayatis. OneBatchPAM: A Fast and Frugal K-Medoids Algorithm. Proceedings of the AAAI Conference on Artificial Intelligence, 39(15):16172–16180, April 2025. [86] Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. Scikitlearn: Machine learning in python. the Journal of machine Learning research, 12:2825–2830, 2011. [87] Conghao Wang, Gaurav Asok Kumar, and Jagath C Rajapakse. Drug discovery and mechanism prediction with explainable graph neural networks. Scientific Reports, 15(1):179, 2025. [88] Leiv Rønneberg and Vidhi Lalchand. Scalable permutation invariant multi-output gaussian processes for cancer drug response. In NeurIPS 2024 Workshop on Bayesian Decision-making and Uncertainty, 2024. [89] Peng Zhang and Shikui Tu. Mgae-dc: Predicting the synergistic effects of drug combinations through multi-channel graph autoencoders. PLoS computational biology, 19(3):e1010951, 2023. [90] Shiyu Yan and Ding Zheng. A deep neural network for predicting synergistic drug combinations on cancer. Interdisciplinary Sciences: Computational Life Sciences, 16(1):218–230, 2024. [91] CA Hafsath and AS Jereesh. Perturbsynx: Deep learning framework for predicting drug combination synergy scores using drug induced gene perturbation data. Computational Biology and Chemistry, page 108736, 2025. [92] Antoine de Mathelin, François Deheeger, Mathilde Mougeot, and Nicolas Vayatis. Discrepancybased active learning for domain adaptation. In International Conference on Learning Representations, 2022.

16

A

Model architecture details

Figure 4 provides a layer-by-layer view of the ScreenShot architecture (∼7M parameters). All three encoders (Drug Combination Encoder, DCE; Response Encoder, RE; Sample Encoder, SE) share the same transformer block configuration: 5 layers, 8 attention heads (head dim 32), hidden dim 256, GeLU activations, residual connections and layer normalization. Given n context observations for a sample, we group them by perturbation: observations from the same drug combination are placed together. This yields p unique perturbations, each with up to m dose-level observations, where each perturbation involves up to q drugs. The context is stored as a padded tensor of shape (p, m, q); p, m, and q are the maximum values across the batch, and padding masks are applied at every level. In particular, q is padded because datasets often contain both monotherapy (q=1) and combination (q=2 or 3) observations. A learnable CLS token is appended to the perturbation sequence before the Sample Encoder; its output after self-attention is used as the pooled sample representation.

Query Drug Embedding

Drug Embedding

(q) → (q, 256)

(p, m, q) → (p, m, q, 256)

+

+

Dose Emb. (q) → (q, 256)

DCE

Context

Dose Emb. (p, m, q) → (p, m, q, 256)

LayerNorm

LayerNorm

(q, 256)

(p, m, q, 256)

Self-Attention × 5

Self-Attention × 5

(q, 256) → (q, 256)

(p, m, q, 256) → (p, m, q, 256)

Masked Average

Masked Average

(q, 256) → (256)

(p, m, q, 256) → (p, m, 256)

Viability Emb.

+

Q

Level 1

(p, m) → (p, m, 256) K, V

RE

SE

Cross-Attention × 5 Q: (p, 1, 256), K,V: (p, m, 256) → (p, 1, 256)

Self-Attention × 5 (p, 256) → (p, 256)

Level 2

Level 3

Pooling (p, 256) → (1, 256)

Linear + Sigmoid (256) → ŷ ∈ [0, 1]

Figure 4: Layer-by-layer architecture of ScreenShot (7.0M parameters). Query and context follow identical pipelines through Level 1 (dashed lines = shared weights). DCE = Drug Combination Encoder, RE = Response Encoder, SE = Sample Encoder. q: drugs per combination, p: unique perturbations, m: observations per perturbation. Dose and viability use trainable Fourier features. Drug embedding vocabulary: 3,779 entries (3,679 drugs + 100 UNK).

Fourier encoding. Continuous scalars (doses and viabilities) are encoded using learned Fourier features:   ϕ(x) = W sin(x · ω), cos(x · ω) + b, (2) where ω ∈ RF , W ∈ RD×2F , and b ∈ RD are learnable parameters (with independent parameters for doses and for viabilities). We use F =64 Fourier frequencies. 17

B

Pretraining

Pretraining corpus. Table 2 lists all datasets in the pretraining and evaluation corpus. The ex vivo datasets were obtained on request from Pichotta et al. [21], and we added publicly available cell line datasets for a total of 40 studies spanning both monotherapy and combination screens across diverse cancer types. Table 2: Pretraining corpus: 40 drug screening datasets. † Held out for evaluation. CL = cell line, EV = ex vivo (patient-derived). ∗ Number of unique consensus drug IDs after PubChem resolution. Dataset

Reference

Samples

Drugs

Obs.

Model

Type

Beat AML Nair et al. Betge et al. Martins et al. Bruna et al. CCLE Driehuis et al. CTRP1 CTRP2 Mayoh et al. Friedman et al. ’15 Friedman et al. ’17 GDSC1 GDSC2 Murumägi et al. Sa et al. Yan et al. SMarTrial Lau et al. Ice et al. Merck Lee et al. ’18 Johansson et al. Ronteix et al. Powell et al. Malani et al. Toshimitsu et al. Hirt et al. Li et al. Lee et al. ’18b Al Shihabi et al. Gu et al. Polley et al. Tiriac et al. Peterziel et al. Pemovska et al.

Bottomly et al. [61] Nair et al. [62] Betge et al. [63] Martins et al. [11] Bruna et al. [64] Barretina et al. [65] Driehuis et al. [6] Basu et al. [66] Seashore-Ludlow et al. [67] Mayoh et al. [68] Friedman et al. [69] Friedman et al. [70] Yang et al. [71] Yang et al. [71] Murumägi et al. [12] Sa et al. [10] Yan et al. [72] Liebers et al. [73] Lau et al. [14] Ice et al. [74] O’Neil et al. [15] Lee et al. [3] Johansson et al. [4] Ronteix et al. [75] Powell et al. [76] Malani et al. [77] Toshimitsu et al. [78] Hirt et al. [7] Li et al. [79] Lee et al. [80] Shihabi et al. [81] Gu et al. [82] Polley et al. [83] Tiriac et al. [5] Peterziel et al. [13] Pemovska et al. [84]

631 81 14 25 21 504 24 242 887 151 37 20 988 810 13 45 9 180 17 8 39 284 86 158 16 181 26 18 27 11 109 13 70 68 65 35

166 244 520 12 105 24 78 203 545 144 108 76 304 169 641 97 37 108 194 38 38 67 265 29 559 539 56 25 129 21 530 2,245 523 5 79 222

491K 3.6M 26K 6K 42K 93K 35K 257K 12.4M 35K 419K 105K 2.6M 1.4M 45K 42K 7K 66K 21K 5K 1.5M 234K 202K 35K 118K 369K 31K 3K 3K 5K 21K 34K 389K 14K 21K 31K

EV CL EV EV EV CL EV CL CL EV EV EV CL CL EV EV EV EV EV EV CL EV EV EV EV EV EV EV EV EV EV EV CL EV EV EV

Mono Combi Mono Mono Combi Mono Combi Mono Mono Mono Combi Combi Mono Mono Mono Mono Mono Combi Mono Mono Combi Mono Mono Mono Mono Mono Mono Mono Mono Mono Combi Mono Mono Mono Mono Mono

BATCHIE† GDSC-SQ† NCI-ALMANAC† PDO-Breast†

Tosh et al. [53] Jaaks et al. [17] Holbeck et al. [16] Guillen et al. [1]

16 126 60 16

207 65 102 46

148K 3.7M 3.4M 81K

CL CL CL EV

Combi Combi Combi Mono

6,135

3,679∗

32.1M

Total

Data preprocessing. All viability values are clipped to [0, 1]. Dose concentrations are expressed in micromolar (µM) and converted to log10 (µM) scale, clipped to [−6, 4] (corresponding to 10−6 – 104 µM), and linearly rescaled to [0, 1]. Drug names across datasets are resolved to consensus identifiers via PubChem lookup (matching by compound ID, substance ID, parent compound, or canonical SMILES). To remove noisy observations, we fit a monotone decreasing isotonic regression to each (sample, drug combination) dose-response curve and discard curves with MAE above 0.2, which removes approximately 5% of the data. Leave-one-out evaluation. For each evaluation dataset, we train a separate foundation model on all remaining datasets. The BATCHIE and PDO-Breast evaluations use the same pretrained model (trained on all datasets excluding BATCHIE and PDO-Breast). For GDSC-SQ and NCI-ALMANAC, we train on all datasets except the evaluation set itself. All models use identical hyperparameters (Section E.2). 18

Data sampling. At each training step, one dataset is sampled uniformly, and a batch is constructed by randomly selecting 1–16 biological samples, up to 100 unique drug combinations per sample, and up to 10 observations per combination. A query set of 32 observations per sample is drawn separately for supervision. Each dataset contributes 100 batches per epoch, yielding ∼4,000 batches per epoch and ∼400K iterations over 100 epochs. UNK token training. To prepare the model for unknown drugs at inference time, a random fraction α ∼ Uniform[0, 0.2] of unique drug identities per batch are replaced with one of the 100 trainable UNK tokens during pretraining. This teaches the model to produce reasonable predictions even when a drug has no specific embedding, by relying on the few-shot context observations to infer the drug’s behavior. Training curve. Figure 5 shows the training curve for the BATCHIE foundation model. Both train and held-out MAE decrease steadily throughout training with no sign of overfitting.

Train MAE MAE on BATCHIE (n = 100)

0.18

MAE

0.16 0.14 0.12 0.10 0.08 0

20

40

Epoch

60

80

100

Figure 5: Foundation model training curve (BATCHIE). Train MAE and held-out MAE on BATCHIE over 100 epochs, where the held-out evaluation uses n=100 few-shot context observations per sample, uniformly sampled.

C

Drug coverage

Table 3 reports the overlap between each pretrained drug library and the drugs in the corresponding evaluation dataset. Each model’s library contains ∼3,650–3,680 unique consensus drug IDs, resolved through PubChem to handle name aliases across studies. Drug names are mapped to PubChem compound IDs (CIDs) and substance IDs (SIDs); drugs sharing the same CID, SID, parent compound, or canonical SMILES are assigned a single consensus ID. Coverage ranges from 89.4% (BATCHIE) to 100% (GDSC-SQ), with most evaluation drugs already present in the pretrained vocabulary. The uncovered drugs are investigational compounds that appear in few studies (e.g., CYC065, LY3295668) and are therefore absent from the pretraining corpus. These drugs are assigned dedicated UNK embeddings. Figure 6 compares prediction error on treatments involving known drugs versus unknown (UNK) drugs on the BATCHIE dataset. UNK drugs account for approximately 17% of few-shot observations across all budgets. UNK predictions remain well below the mean-prediction baseline (0.308 MAE), though naturally less accurate than known drugs (0.152 vs. 0.090 at budget 300). To assess whether using a pretrained UNK token is useful, we compare it against assigning a random known drug token to each unknown drug. For each budget (100, 200, 300), we run ScreenShot inference on BATCHIE with randomly selected few-shot context and compute the absolute error on all remaining observations. We repeat with 5 random seeds, each with a different random UNK-to-known-drug assignment, and average the error across seeds. Random tokens perform worse than pretrained UNK embeddings (+0.017 MAE at budget 300), confirming that an incorrect drug identity is more 19

Table 3: Drug coverage. For each evaluation dataset, the number of unique drugs, the pretrained library size (consensus drug IDs), and the number of drugs resolved to a known embedding vs. assigned a UNK token. Dataset

Library size

Eval drugs

Known (%)

UNK

3,654 3,679 3,675 3,654

207 65 102 46

185 (89%) 65 (100%) 98 (96%) 44 (96%)

22 0 4 2

BATCHIE GDSC-SQ NCI-ALMANAC PDO-Breast

harmful than a non-specific placeholder, because a wrong identity may actively mislead the model’s dose-response expectations. n = 100 (avg 17/100 UNK per sample)

Absolute error

0.5

Known (MAE=0.107) UNK trained (MAE=0.170) UNK random (MAE=0.187) Mean baseline (0.309)

n = 200 (avg 34/200 UNK per sample) Known (MAE=0.096) UNK trained (MAE=0.158) UNK random (MAE=0.175) Mean baseline (0.309)

n = 300 (avg 51/300 UNK per sample) Known (MAE=0.090) UNK trained (MAE=0.152) UNK random (MAE=0.169) Mean baseline (0.308)

0.4 0.3 0.2 0.1 0.0 Known

UNK (trained)

UNK (random)

Known

UNK (trained)

UNK (random)

Known

UNK (trained)

UNK (random)

Figure 6: Prediction error for known vs. unknown drugs on BATCHIE. Each panel corresponds to a different few-shot budget (n ∈ {100, 200, 300}). Three conditions: treatments with known drugs (blue), treatments with UNK drugs using pretrained UNK embeddings (pink), and treatments with UNK drugs using random known drug tokens (yellow). Dashed line: MAE of predicting the mean few-shot viability.

D

Experimental setup details

D.1

Samples

Table 4 lists the biological samples used for evaluation in each dataset. BATCHIE and PDO-Breast use all available samples. For NCI-ALMANAC and GDSC-SQ, we randomly select 10 cell lines for faster evaluation. Table 4: Evaluation samples and control samples per dataset. Dataset

N

Control(s)

Sample IDs

BATCHIE

16

RPE, BJ

A673, Kelly, MDA-MB-231, MG-63, MSKEWS-33838, MSKEWS-66647, MSKOST-11890, MSKRMS-12808, SAOS-2, SJSA-1, SKNEP, TC-71, U2OS, Wit49

PDO-Breast

16

HCI-011

HCI-001, HCI-002, HCI-003, HCI-005, HCI-008, HCI-010, HCI-012, HCI-015, HCI-016, HCI-017, HCI-019, HCI-023, HCI-024, HCI-025, HCI-027

NCI-ALMANAC

10

UACC-257

786-0, CAKI-1, HCT-15, HL-60(TB), NCI-H522, OVCAR-4, SK-MEL-2, SK-OV-3, T-47D

GDSC-SQ

10

MDA-MB-157

CAL-148, DU-4475, HCC1395, HCC1599, HCC2218, HCC70, HDQ-P1, MCF7, T47D

Control samples. For BATCHIE, two non-cancerous cell lines (RPE and BJ) serve as controls; the control baseline is min(RPE, BJ) per treatment. For NCI-ALMANAC, GDSC-SQ, and PDO-Breast, 20

which lack designated controls, we use the cell line with the highest average viability across all treatments as a proxy control: UACC-257, MDA-MB-157, and HCI-011 respectively. This selection is based on the assumption that less drug-sensitive samples approximate non-cancerous controls. D.2

Few-shot protocol

For each sample, we randomly select n ∈ {10, 50, 100, 150, 200, 250, 300} observations as context and predict viability for all remaining observations. Few-shot experiments use 5 random seeds on BATCHIE and PDO-Breast, and 3 seeds on GDSC-SQ and NCI-ALMANAC. D.3

Active learning protocol

The adaptive strategy (Algorithm 1) proceeds in multiple rounds. Active learning experiments use 5 seeds on all three datasets. Observations are selected uniformly at random without replacement within each sample. A fraction of the total budget (33% in the main experiments) is allocated to a cold-start batch; the remainder is split equally across 1 or 2 adaptive rounds. Cold-start selection. The cold-start batch is selected by k-medoids clustering on the Level 1 drug-dose embeddings (output of the DCE, before any viability is observed). k-medoids selects k representatives from the candidate set by solving min

S⊂{1,...,N }, |S|=k

N X

wi min ∥hi − hj ∥2 ,

i=1

j∈S

(3)

where hi is the embedding of treatment i and wi is a per-treatment weight (uniform for cold start). We use the OneBatchPAM implementation [85]. For control samples, we always use k-medoids with uniform weights regardless of the strategy used for target samples, since the goal for controls is to maximize coverage rather than target specific hits. Adaptive selection. In adaptive rounds, we use k-means++ seeding on the Level 3 contextconditioned embeddings (output of the SE after observing the current context). k-means++ sequentially samples centers with probability proportional to the weighted squared distance to the nearest existing center: P (i) ∝ wi min ∥hi − hj ∥2 , j∈S

(4)

where S is the set of already-selected centers. We use a custom implementation built on top of scikit-learn [86], extended to support frozen centers and per-point weights. Treatments selected in previous rounds are included as fixed (frozen) initial centers, so new selections are pushed away from already-observed regions. The key difference between k-medoids and k-means++ is in their objective. k-medoids minimizes the total distance between every data point and its closest medoid, which promotes both diversity and representativity of the selection. k-means++ only considers distances between selected points, which emphasizes diversity over representativity: the selected set tends to be maximally spread out. When the goal is to find top hits rather than uniformly cover the treatment space, diversity is preferable because it avoids selecting redundant treatments in dense but uninteresting regions. Weighting strategies. We consider three weighting schemes for adaptive rounds: (i) Delta weight(target) (control) ing: wi = max(−∆i , 0), where ∆i = ŷi − ŷi is the predicted differential viability, so treatments predicted to be selectively effective receive higher weight. (ii) Uncertainty weighting: wi = σi , where σi is the MC dropout uncertainty [58] computed by enabling dropout (rate 0.1) on the Level 3 Sample Encoder and running 10 stochastic forward passes; the prediction is the mean and σi is the standard deviation across passes. (iii) Top-k: instead of weighted clustering, we greedily select the k treatments with the most negative ∆i (top-k delta) or highest σi (top-k uncertainty), without any diversity mechanism. 21

E

Baselines and hyperparameters

E.1

Comparison with related methods

Table 5 provides a systematic comparison of drug response prediction methods from the literature. Most existing methods require genomic or transcriptomic features to represent biological samples, which limits their applicability to patient-derived ex vivo models where such is often unavailable [21]. Monotherapy methods do not model drug interactions, and combination synergy methods typically predict a scalar synergy score rather than full dose-response surfaces. Transfer learning approaches partially bridge the domain gap between cell lines and patient samples, but still require overlapping molecular features. TabPFN [24], XGBoost, and MLPs all meet the requirements for our setting (no genomics, dose-aware, combination-capable) when paired with a general drug representation such as Morgan fingerprints or learned embeddings; we include them as baselines. TabPFN additionally shares the in-context learning paradigm with ScreenShot. ComboLTR and PIICM produce full dose-response predictions for combinations without genomic features, but they lack a pretraining mechanism and learn drug representations from scratch on each sample. This makes them effective when sufficient data is available per sample, but poorly suited to the few-shot regime where only a small number of observations are provided.

Table 5: Comparison of drug response prediction methods. We list methods cited in related work and indicate their requirements and capabilities. ✓ indicates a desirable property. Methods that are not genomics- or transcriptomics-free require molecular profiling, which limits applicability to patient-derived ex vivo models. Methods without pretraining must be trained from scratch on each new dataset. Method

Combinations

Dose info

Pretrained

Genomics-free

Transcriptomics-free

✗ ✗ ✗ ✗ ✗ ✗ ✗

✗ ✗ ✗ ✗ ✗ ✗ ✓

✓ ✗ ✗ ✗ ✓ ✗ ✓

✗ ✓ ✓ ✗ ✗ ✓ ✗

✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓

✗ ✓ ✓ ✗ ✗ ✗ ✗ ✗ ✗ ✓

✗ ✗ ✗ ✓ ✗ ✗ ✗ ✓ ✗ ✓

✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓

✗ ✓ ✓ ✗ ✗ ✗ ✗ ✗ ✗ ✗

✗ ✗ ✗

✗ ✗ ✗

✓ ✓ ✓

✓ ✗ ✓

✗ ✗ ✗

✗ ✓ ✓ ✓ ✓ ✓

✓ ✗ ✗ ✗ ✓ ✓

✗ ✓ ✗ ✗ ✓ ✓

✓ ✓ ✓ ✓ ✓ ✓

✓ ✓ ✓ ✓ ✓ ✓

Monotherapy response prediction DNN [33] tCNNs [34] DrugCell [18] DeepCDR [19] HiDRA [20] GraphDRP [35] XGDP [87]

✗ ✗ ✗ ✗ ✗ ✗ ✗

Combination synergy prediction DeepSynergy [36] ComboLTR [41] PIICM [88] MatchMaker [39] DeepDDS [37] MARSY [40] DeepTraSynergy [38] MGAE-DC [89] DconnC [90] PerturbSynX [91] Transfer learning TRANSACT [44] TCRP [42] ScreenDL [43] Foundation models PPC-FM [21] BAITSAO [47] CancerGPT [48] SynerGPT [49] TabPFN [24] ScreenShot (ours)

22

E.2

Baseline hyperparameters

Input features for XGBoost and TabPFN. Both XGBoost and TabPFN use 512-dimensional Morgan fingerprints [60] (radius 2) as drug representations. For each drug in the combination, the fingerprint is concatenated with the corresponding dose value, yielding a (512 + 1)-dimensional vector per drug slot. For combinations of q drugs, the per-drug feature vectors are concatenated, producing a 513q-dimensional input. Empty drug slots (monotherapy observations in a combination dataset) are filled with zero vectors. XGBoost. We use XGBoost with 100 estimators and squared error loss. Hyperparameters are selected independently for each sample via 5-fold cross-validation with grid search over: max depth ∈ {2, 4, 6}, learning rate ∈ {0.05, 0.1, 0.3}, subsample ratio ∈ {0.7, 0.9, 1.0}, min child weight ∈ {1, 5, 10}, and L2 regularization λ ∈ {0.1, 1.0, 10.0} (243 combinations). TabPFN. We use TabPFN [24] with default settings and the same Morgan fingerprint input features as XGBoost. TabPFN performs in-context learning: it conditions on the few-shot observations and predicts the held-out viability in a single forward pass, with no task-specific training. MLP architecture. Both MLP baselines share the same architecture, selected through extensive manual tuning on pretraining validation loss. The model uses learned embedding tables for drugs (vocabulary size matching the drug library) and samples, with embedding dimension D=64. Doses are encoded via a linear projection from R1 to R64 . For each observation, the drug embedding and dose embedding are multiplied element-wise for each drug in the combination, then averaged across the q drug slots to produce a single drug-dose representation in R64 . This is concatenated with the sample embedding to form a 128-dimensional input, which is passed through 3 fully connected layers (hidden dimension 128, ReLU activations, dropout 0.2) followed by a linear output layer and sigmoid activation. MLP (target-only). Trained from scratch on each target sample using Adam (lr = 10−3 , no weight decay), gradient clipping at 1.0, batch size 32, for up to 200 epochs. Each epoch consists of 100 iterations (sampling with replacement from the few-shot context). We use a 20% validation split for early stopping and select the checkpoint with the lowest validation loss. MLP (fine-tuned). Same architecture, pretrained on the same 40-dataset corpus as ScreenShot (excluding the held-out evaluation dataset) using Adam (lr = 10−3 , no weight decay), batch size 128, gradient clipping at 1.0, for 50 epochs over the full corpus (∼234K iterations per epoch, ∼11.7M total training steps). A 5% held-out split of (sample, drug) pairs is used for validation, and the checkpoint with the lowest validation loss is selected. The pretrained model uses the same drug library as ScreenShot for drug identity encoding. At evaluation time, a new sample embedding is initialized for the target sample, and the full model is fine-tuned on the few-shot context with a learning rate of 10−4 for up to 200 epochs with early stopping on a 20% validation split.

F

Few-shot additional results

Figure 7 shows the trade-off between top-hit recall and computation time for each method at a budget of 100 shots. ScreenShot achieves the highest accuracy on every dataset while being 5–50× faster than all baselines. MLP and MLP-FT require training on the few-shot context for each experiment, resulting in computation times of 10–20 minutes per experiment. XGBoost runs on CPU (8 cores) and takes 2–3 minutes. TabPFN is slower than ScreenShot despite also being inference-only, due to its larger model size and its use of self-attention across both context observations and input features. ScreenShot requires only a single forward pass through the pretrained model, completing in 8–68 seconds depending on dataset size.

23

PDO-Breast 90

BATCHIE

ScreenShot

Top-hit recall (%)

ScreenShot

MLP-FT

85

70

80

MLP-FT

60

75

TabPFN XGBoost

70 65 60

100

Time per experiment (s)

XGBoost

40

MLP

55 10

MLP

50

TabPFN

1000

10

100

Time per experiment (s)

GDSC-SQ

NCI-ALMANAC

58

Top-hit recall (%)

56

50

XGBoost

52 50

45

TabPFN

48

ScreenShot

55

MLP-FT

ScreenShot

54

46

MLP-FT

40 35

MLP

44

TabPFN

30

42

1000

100

Time per experiment (s)

XGBoost

MLP

100

1000

1000

Time per experiment (s)

Figure 7: Top-hit recall vs. computation time per experiment at 100-shot budget. ScreenShot (red) is consistently the fastest and most accurate method across all four datasets. All GPU methods ran on NVIDIA A100 80GB GPUs; XGBoost ran on 8 CPU cores.

G

Active learning additional results

G.1

Hit recall across datasets

Table 6 reports top-hit recall for the four experimental design strategies across three datasets: random selection, k-medoids cold start (100% budget), and two adaptive strategies with 33% cold start followed by 1 or 2 delta-weighted k-means++ rounds. Adaptive methods consistently outperform random selection and cold-start baselines. On BATCHIE, adaptive selection with two rounds reaches 84.8% at budget 300, compared to 75.8% for random, a gain of 9 percentage points. On GDSC-SQ and NCI-ALMANAC, adaptive methods improve by 4–7 points over random. Table 6: Active learning: hit recall (%). Mean±std across 5 seeds. Bold: best per column. Method Random Cold-start (k-medoids) Adaptive (1 round) Adaptive (2 rounds)

G.2

BATCHIE

GDSC-SQ

NCI-ALMANAC

100

200

300

100

200

300

100

200

300

71.6±1.6 72.9±1.4 77.3±1.4 77.5±0.9

74.4±1.7 75.1±1.1 81.2±0.8 83.0±2.6

75.8±1.3 76.1±0.7 84.0±0.7 84.8±1.9

56.3±2.0 60.4±1.7 61.1±0.6 59.9±1.4

60.6±1.8 63.0±1.4 65.5±0.8 65.3±0.7

63.0±1.2 65.2±1.1 67.0±1.6 67.4±1.0

49.4±2.0 60.3±0.8 57.6±2.9 58.2±2.0

54.0±0.6 60.8±1.4 62.3±0.9 61.5±0.9

56.6±0.6 61.2±1.5 62.9±1.0 63.6±1.1

Effect of cold-start proportion and number of rounds

Table 7 examines how the split between cold-start and adaptive budget affects performance on the BATCHIE combination screen. The 33% cold-start split achieves the best hit recall (84.8% at budget 300), while allocating more to cold start (50%) gives the best MAE and Pearson correlation. 24

This suggests a balance between initial coverage and adaptive exploitation. Two rounds consistently outperform one round, though the marginal gain is modest (∼0.5–1 percentage points). All adaptive strategies substantially outperform pure k-medoids cold start (76.1%) in hit recall. However, pure k-medoids achieves the best MAE, which is consistent with the known effectiveness of k-medoids for reducing global prediction error through its diversity-representativity tradeoff [92], but demonstrates that minimizing global error does not directly translate to better top-hit detection. Table 7: Effect of cold-start proportion and number of adaptive rounds on the BATCHIE combination screen. All adaptive methods use the proposed strategy (k-medoids cold start, kmeans++ with delta weighting on final embeddings). Bold indicates best per column. Method

Hit Recall (%)

k-medoids (100% cold start) Adaptive (50% CS, 1 round) Adaptive (50% CS, 2 rounds) Adaptive (33% CS, 1 round) Adaptive (33% CS, 2 rounds) Adaptive (20% CS, 1 round) Adaptive (20% CS, 2 rounds)

H

MAE

100

200

300

100

200

300

72.9±1.4 75.3±1.4 75.8±0.8 77.3±1.4 77.5±0.9 74.7±0.9 75.5±1.9

75.1±1.1 78.9±1.6 80.5±1.4 81.2±0.8 83.0±2.6 79.1±1.0 80.0±1.4

76.1±0.7 82.2±1.3 82.6±1.2 84.0±0.7 84.8±1.9 83.3±1.7 83.8±2.0

0.107±0.001 0.109±0.001 0.109±0.001 0.110±0.002 0.110±0.001 0.112±0.001 0.112±0.001

0.097±0.001 0.099±0.001 0.098±0.001 0.100±0.001 0.100±0.001 0.104±0.001 0.104±0.001

0.093±0.001 0.093±0.001 0.093±0.001 0.095±0.001 0.094±0.001 0.099±0.001 0.098±0.001

Architecture ablation

Table 8 compares the full ScreenShot architecture against three ablated variants on the BATCHIE and PDO-Breast datasets. No Level 3 removes the sample-level self-attention that aggregates across perturbations. Flat attention replaces the hierarchical encoder with a single self-attention layer over all flattened context observations followed by cross-attention. No Level 1 & 3 removes both the drug-combination encoder and the sample-level aggregation; drug and dose embeddings are combined via element-wise product and averaged across drugs in the combination (as in the MLP baseline), producing a single vector per observation that is passed directly to the cross-attention response encoder. The full architecture achieves the best hit recall on 9 out of 10 dataset/budget combinations. No Level 1 & 3, which reduces the model to the cross-attention level, drops significantly on BATCHIE (54.7% vs. 76.0% at budget 300) and saturates on PDO-Breast (∼78% regardless of budget), indicating that a single encoder level lacks the capacity to capture the structure of screening data. Flat attention and No Level 3 perform closer to the full model but consistently trail on BATCHIE, where the combinatorial treatment space is larger. Overall, each level contributes to prediction quality at the cost of a reasonable increase in computation (Figure 8). Table 8: Architecture ablation: top-hit recall (%) across few-shot budgets on BATCHIE and PDOBreast. Values: mean±std across 5 seeds. Bold: best per column. BATCHIE ScreenShot Flat attention No Level 3 No Level 1 & 3

PDO-B REAST

10

50

100

200

300

10

50

100

200

300

63.9±3.1 60.3±2.2 59.5±2.0 51.0±3.4

69.0±2.4 65.6±1.6 66.9±1.2 53.2±1.5

72.6±3.0 68.6±0.6 70.9±1.3 55.0±1.5

75.0±2.5 70.9±0.9 74.5±1.1 54.4±0.4

76.0±1.4 72.3±1.3 75.6±1.0 54.7±0.9

78.7±2.5 76.3±6.5 75.5±3.8 77.1±1.7

81.9±2.2 82.9±3.0 83.5±1.8 78.4±2.0

87.7±2.4 86.9±3.2 87.7±3.2 77.9±1.2

93.6±1.7 91.5±2.6 92.0±2.1 78.1±1.5

96.0±1.6 94.7±1.6 95.2±3.1 78.4±1.1

Figure 8 shows inference time as a function of context size on both PDO-Breast and BATCHIE. On PDO-Breast, ScreenShot scales from 3.9 s at 100 context observations to 5.0 s at 3,000, because the dominant self-attention at Level 3 operates over perturbations (p ≪ n) rather than individual observations. The flat attention variant exhibits quadratic scaling, reaching 28.6 s at 3,000 observations (5.7× slower). On BATCHIE, flat attention reaches 155 s at 500 context observations (2.7× slower than ScreenShot at the same budget). This confirms the computational motivation for the hierarchical design discussed in Section 2.2.

25

PDO-Breast (81K queries)

30

140

Inference time (s)

Inference time (s)

25 20 15 10 5 0

BATCHIE (148K queries)

160

120 100 80 60 40 20

100

500

1000

2000

3000

100

200

Few-shot context size ScreenShot

500

Few-shot context size No Level 3

Flat attention

No Level 1 & 3

Figure 8: Inference time vs. context size on PDO-Breast (left) and BATCHIE (right), measured on NVIDIA H100 GPU.

I

Active learning ablation

We ablate each component of the adaptive experimental design strategy described in Section 4. The proposed method uses k-medoids on drug-dose embeddings for cold start (33% of budget), followed by k-means++ on final model embeddings with delta weighting adaptive rounds. Each ablation modifies exactly one component. We evaluate on three datasets (BATCHIE, GDSC2, NCIALMANAC) with budgets of 100, 200, and 300 treatments per sample, averaged over 5 seeds. The “Uncertainty weighting” ablation uses MC dropout uncertainty instead of predicted delta as selection weights. Uncertainty is computed by enabling dropout (applied to the Level 3 Sample Encoder only) and running 10 stochastic forward passes. The prediction is the mean across passes; uncertainty is the standard deviation. Table 9 reports hit recall for each variant. Table 10 reports MAE and Pearson correlation, which measure overall prediction quality rather than hit detection. Table 9: Active learning ablation: Hit Recall@20%. The first row reports absolute hit recall (%); all other rows report the difference in percentage points relative to the proposed method. Each row removes or replaces one component. All methods use 33% cold start budget. Blue : significantly better than proposed; red : significantly worse (Wilcoxon signed-rank test). Shading intensity: light p < 0.05, medium p < 0.01, dark p < 0.001. Method

BATCHIE

GDSC2

NCI-ALMANAC

100

200

300

100

200

300

100

200

300

77.3±1.4 -4.3±1.0 -3.2±0.6 -2.8±0.7 -1.7±0.9 -0.4±0.9 -4.3±0.9 -5.8±0.8 -8.1±1.3

81.2±0.8 -4.9±0.9 -3.1±0.6 -0.4±0.5 +0.1±1.0 -0.0±0.9 -4.3±0.9 -3.4±0.5 -5.6±0.9

84.0±0.7 -5.8±1.3 -4.3±0.8 -1.3±0.6 +0.2±0.7 +0.0±1.0 -5.4±0.9 -3.4±0.6 -6.0±0.9

61.1±0.6 -4.0±1.0 +0.5±0.6 +0.1±0.9 -0.3±0.9 -1.4±0.8 -1.8±0.6 -10.0±0.9 -6.6±1.0

65.5±0.8 -4.3±0.6 -0.6±0.5 -0.8±0.7 -0.6±0.8 -1.2±0.9 -2.5±0.7 -8.1±0.8 -6.4±0.8

67.0±1.6 -3.0±0.6 -0.8±0.5 +0.2±0.6 +0.2±0.7 +0.0±0.7 -2.0±0.6 -7.0±0.5 -5.7±0.8

57.6±2.9 -0.7±0.8 +0.8±0.7 +1.3±0.7 -3.1±1.0 -4.1±1.0 +0.8±1.0 -7.4±1.1 -6.4±1.0

62.3±0.9 -2.0±0.8 -0.3±0.5 -0.9±0.5 -1.6±0.7 -4.7±1.1 -0.8±0.7 -7.7±1.4 -7.4±1.6

62.9±1.0 -1.8±0.5 +0.1±0.5 -0.1±0.4 +0.0±0.6 -1.7±0.7 -0.5±0.5 -11.8±1.4 -9.6±1.7

77.5±0.9 -5.2±1.0 -2.6±0.9 -3.9±1.0 -0.1±0.9 -0.4±0.7 -3.1±0.9 -6.1±1.2 -8.5±1.4

83.0±2.6 -7.0±1.2 -3.9±0.8 -3.1±0.9 -0.9±1.1 -1.2±0.9 -5.6±1.0 -5.6±0.8 -7.8±1.0

84.8±1.9 -5.7±1.2 -4.0±0.7 -1.8±0.7 -0.2±0.9 +0.4±1.0 -6.2±0.9 -4.6±0.8 -8.0±1.1

59.9±1.4 -2.9±0.8 +0.9±0.7 +2.3±0.9 -0.1±1.0 -1.5±1.2 -1.9±0.8 -6.1±1.1 -4.3±0.9

65.3±0.7 -4.4±0.6 -0.7±0.8 +0.9±0.7 -0.1±0.8 -0.8±0.8 -3.8±0.7 -6.7±0.8 -5.4±0.8

67.4±1.0 -3.2±0.7 -0.2±0.6 +0.7±0.6 -0.4±0.6 -0.7±0.4 -2.4±0.8 -6.0±0.8 -5.7±0.8

58.2±2.0 -3.0±0.8 -0.0±0.7 +0.4±0.6 -3.8±1.0 -3.8±1.0 -0.5±0.8 -6.6±0.8 -5.0±0.7

61.5±0.9 -1.1±0.7 -0.2±0.5 +0.1±0.6 -0.7±0.8 -1.7±0.8 -0.7±0.5 -7.3±1.6 -4.2±0.8

63.6±1.1 -2.4±0.5 -0.2±0.4 -0.1±0.5 -0.8±0.6 -1.5±0.6 -0.9±0.5 -10.9±1.9 -4.3±0.8

1 adaptive round Proposed No delta weighting No k-means++ No final embeddings k-means++ cold start Random cold start Uncertainty weighting Top-k delta Top-k uncertainty 2 adaptive rounds Proposed No delta weighting No k-means++ No final embeddings k-means++ cold start Random cold start Uncertainty weighting Top-k delta Top-k uncertainty

26

Table 10: Active learning ablation: MAE and Pearson correlation. Same ablation as Table 9. Bold indicates best per column (lowest MAE, highest Pearson). Method

BATCHIE

GDSC2

NCI-ALMANAC

100

200

300

100

200

300

100

200

300

0.110±0.002 0.111±0.001 0.112±0.001 0.113±0.001 0.113±0.001 0.113±0.002 0.108±0.000 0.124±0.001 0.121±0.001

0.100±0.001 0.100±0.001 0.102±0.001 0.102±0.001 0.102±0.001 0.105±0.001 0.097±0.000 0.111±0.001 0.108±0.001

0.095±0.001 0.095±0.001 0.096±0.000 0.097±0.000 0.097±0.000 0.100±0.001 0.092±0.001 0.104±0.001 0.102±0.000

0.132±0.001 0.132±0.001 0.131±0.001 0.133±0.001 0.133±0.002 0.135±0.001 0.131±0.001 0.144±0.003 0.141±0.003

0.126±0.001 0.126±0.001 0.127±0.000 0.130±0.001 0.128±0.001 0.130±0.001 0.125±0.001 0.138±0.001 0.133±0.002

0.125±0.001 0.123±0.001 0.126±0.001 0.128±0.001 0.125±0.001 0.126±0.001 0.122±0.001 0.137±0.000 0.129±0.001

0.144±0.003 0.147±0.003 0.144±0.002 0.142±0.002 0.145±0.002 0.146±0.001 0.142±0.001 0.165±0.005 0.157±0.002

0.134±0.001 0.137±0.001 0.136±0.002 0.136±0.001 0.137±0.001 0.138±0.001 0.132±0.001 0.152±0.004 0.148±0.003

0.131±0.001 0.132±0.001 0.132±0.001 0.132±0.001 0.132±0.001 0.133±0.001 0.128±0.001 0.156±0.003 0.146±0.002

0.100±0.001 0.100±0.001 0.101±0.001 0.101±0.001 0.102±0.001 0.104±0.001 0.097±0.000 0.110±0.001 0.107±0.001

0.094±0.001 0.095±0.001 0.096±0.001 0.096±0.000 0.096±0.001 0.099±0.001 0.091±0.000 0.103±0.001 0.100±0.001

0.132±0.002 0.132±0.001 0.130±0.001 0.132±0.001 0.133±0.002 0.136±0.002 0.131±0.000 0.141±0.002 0.136±0.001

0.126±0.001 0.127±0.001 0.126±0.001 0.127±0.001 0.128±0.001 0.130±0.001 0.125±0.001 0.136±0.002 0.129±0.001

0.124±0.001 0.123±0.001 0.124±0.000 0.127±0.001 0.126±0.001 0.126±0.002 0.122±0.000 0.136±0.000 0.126±0.001

0.143±0.002 0.149±0.001 0.144±0.002 0.142±0.001 0.146±0.002 0.145±0.002 0.143±0.001 0.164±0.005 0.153±0.002

0.135±0.001 0.138±0.001 0.136±0.001 0.136±0.001 0.137±0.002 0.137±0.001 0.133±0.001 0.153±0.005 0.145±0.001

0.130±0.002 0.133±0.001 0.132±0.002 0.131±0.001 0.132±0.001 0.133±0.001 0.128±0.001 0.155±0.006 0.139±0.002

0.866±0.003 0.867±0.002 0.861±0.003 0.861±0.003 0.861±0.003 0.858±0.003 0.873±0.001 0.844±0.001 0.852±0.002

0.875±0.002 0.878±0.002 0.872±0.002 0.872±0.001 0.872±0.001 0.866±0.003 0.884±0.001 0.858±0.001 0.867±0.002

0.700±0.003 0.686±0.006 0.701±0.002 0.696±0.004 0.696±0.008 0.682±0.008 0.698±0.003 0.654±0.005 0.667±0.006

0.723±0.004 0.712±0.005 0.722±0.003 0.715±0.003 0.717±0.006 0.709±0.004 0.723±0.002 0.689±0.004 0.700±0.005

0.730±0.002 0.725±0.003 0.727±0.003 0.725±0.002 0.728±0.002 0.721±0.004 0.734±0.001 0.698±0.002 0.713±0.004

0.673±0.015 0.662±0.010 0.676±0.014 0.676±0.011 0.669±0.011 0.665±0.010 0.681±0.004 0.598±0.013 0.628±0.006

0.714±0.005 0.703±0.004 0.710±0.006 0.711±0.006 0.706±0.004 0.695±0.010 0.720±0.002 0.654±0.003 0.661±0.012

0.727±0.006 0.721±0.003 0.725±0.006 0.725±0.006 0.721±0.006 0.718±0.009 0.734±0.004 0.666±0.006 0.675±0.012

0.867±0.003 0.866±0.002 0.864±0.003 0.863±0.003 0.862±0.003 0.859±0.004 0.873±0.001 0.848±0.003 0.854±0.002

0.877±0.002 0.878±0.003 0.873±0.002 0.872±0.002 0.874±0.003 0.867±0.003 0.887±0.001 0.860±0.002 0.870±0.001

0.701±0.006 0.691±0.006 0.705±0.002 0.701±0.004 0.697±0.005 0.682±0.009 0.697±0.003 0.666±0.003 0.678±0.008

0.724±0.003 0.710±0.002 0.724±0.001 0.722±0.003 0.717±0.005 0.708±0.004 0.721±0.005 0.695±0.004 0.709±0.005

0.732±0.001 0.727±0.003 0.731±0.002 0.729±0.003 0.728±0.004 0.723±0.004 0.733±0.003 0.701±0.002 0.718±0.002

0.679±0.012 0.653±0.008 0.677±0.008 0.683±0.012 0.668±0.011 0.670±0.011 0.679±0.005 0.606±0.016 0.643±0.008

0.714±0.004 0.698±0.007 0.715±0.004 0.711±0.005 0.707±0.006 0.702±0.009 0.716±0.005 0.657±0.003 0.674±0.006

0.731±0.009 0.720±0.005 0.729±0.006 0.729±0.007 0.725±0.005 0.720±0.008 0.737±0.004 0.672±0.012 0.699±0.007

MAE — 1 adaptive round Proposed No delta weighting No k-means++ No final embeddings k-means++ cold start Random cold start Uncertainty weighting Top-k delta Top-k uncertainty

MAE — 2 adaptive rounds Proposed No delta weighting No k-means++ No final embeddings k-means++ cold start Random cold start Uncertainty weighting Top-k delta Top-k uncertainty

0.110±0.001 0.112±0.000 0.111±0.001 0.113±0.001 0.112±0.001 0.112±0.001 0.108±0.000 0.122±0.001 0.121±0.002

Pearson — 1 adaptive round Proposed No delta weighting No k-means++ No final embeddings k-means++ cold start Random cold start Uncertainty weighting Top-k delta Top-k uncertainty

0.844±0.004 0.844±0.003 0.839±0.003 0.838±0.004 0.842±0.003 0.842±0.004 0.850±0.001 0.816±0.002 0.822±0.003

Pearson — 2 adaptive rounds Proposed No delta weighting No k-means++ No final embeddings k-means++ cold start Random cold start Uncertainty weighting Top-k delta Top-k uncertainty

0.848±0.004 0.843±0.002 0.841±0.004 0.839±0.005 0.844±0.005 0.845±0.004 0.851±0.001 0.821±0.003 0.823±0.004

Delta weighting is the most important component. Removing delta weighting (“No delta weighting”) consistently degrades hit recall across all datasets and budgets, with losses of 2–6 percentage points on BATCHIE and 2–3 on GDSC2. This confirms that prioritizing treatments with large predicted differential sensitivity is essential for hit detection. Diversity is essential. Pure exploitation strategies (Top-k delta, Top-k uncertainty) that select the most promising treatments without diversity constraints perform substantially worse than their diversity-aware counterparts across all metrics. On NCI-ALMANAC, Top-k delta achieves only 51.1% hit recall at budget 300, compared to 62.9% for the proposed method, a loss of nearly 12 points. This demonstrates that greedy selection leads to redundant observations that fail to improve the model’s global predictive accuracy. k-means++ outperforms k-medoids for adaptive selection. Replacing k-means++ with kmedoids in the adaptive rounds (“No k-means++”) reduces hit recall by up to 4 points on BATCHIE, though the difference is smaller on GDSC2 and NCI-ALMANAC. Uncertainty weighting improves prediction but not hit detection. Weighting by MC dropout uncertainty instead of predicted delta (“Uncertainty weighting”) achieves the best MAE and Pearson correlation on all three datasets, indicating that uncertainty-guided selection improves overall predictive accuracy. However, it underperforms delta weighting for hit recall by 4–6 points on BATCHIE, consistent with the observation that uncertainty targets regions of model ignorance rather than regions of differential drug sensitivity. Cold-start method matters less when followed by adaptive rounds. When only 33% of the budget is allocated to the initial batch and adaptive rounds follow, the cold-start method (k-medoids, 27

k-means++, or random) has limited impact on the final hit recall, as the adaptive rounds compensate for suboptimal initial coverage. However, when the full budget is allocated to the initial batch (i.e., no adaptive rounds), k-medoids on drug-dose embeddings substantially outperforms random selection (Table 6). Embedding choice for adaptive rounds. Using drug-dose embeddings instead of final model embeddings for adaptive selection (“No final embeddings”) yields mixed results: slightly worse on BATCHIE but comparable or better on GDSC-SQ and NCI-ALMANAC, suggesting that the benefit of response-conditioned embeddings is dataset-dependent.

28

Related documents

Record · ID 447924 · SHA-256 c07a564033fbafb9
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive