Accurate, Interdisciplinary and Transparent Structure-property Understanding with Deep Native Structural Reasoning Chen Tang1,2† , Yizhou Wang1,2† , Jianyu Wu1,3† , Lintao Wang1,5† , Shixiang Tang2,1 , Pengze Li1,4 , Encheng Su1,8 , Jun Yao1,8 , Jiabei Xiao1,2 , Yuqi Shi9,10 , Jielan Li1 , Hongxia Hao1 , Zhangyang Gao1 , Fang Wu11 , Ben Fei1,2 , Xiangyu Yue2 , Pan Tan1 , Bozitao Zhong3 , Jinouwen Zhang1 , Aoran Wang1 , Yan Lu2,1 , Jiaheng Liu6,1 , Xinzhu Ma1 , Liang Hong3 , Mingyue Zheng9,10 , Phil Torr7 , Bowen Zhou1 , Wanli Ouyang1,2 , Lei Bai1 1
Shanghai Artificial Intelligence Laboratory, China. The Chinese University of Hong Kong, Hong Kong. 3 Shanghai Jiao Tong University, China. 4 Fudan University, China. 5 University of Sydney, Australia. 6 Nanjing University, China. 7 University of Oxford, UK. 8 The University of Science and Technology of China, China. 9 Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, China. 10 University of Chinese Academy of Sciences, China. 11 Stanford University, USA.
arXiv:2607.07708v1 [cs.CL] 8 Jul 2026
2
Corresponding authors: [email protected]; [email protected]; [email protected]; † These authors contributed equally to this work.
SciReasoner.github.io Abstract Structure–property relationships are foundational to biology, chemistry and materials science, where function, reactivity and physical response emerge from spatial, chemical and periodic organization. Mechanistically explaining these relationships requires interpreting structural evidence through scientific principles and physical constraints, from stereochemistry and bonding to symmetry, energetics and periodic order. However, applying artificial intelligence to this process presents a joint challenge of representation and reasoning: models must preserve domain-native structural information while showing how specific evidence supports predictions under these constraints. Here we introduce SciReasoner, a multimodal scientific foundation model for native structural reasoning across proteins, small molecules and inorganic crystals. SciReasoner discretizes coordinates, topologies and periodic connectivities into a unified structure-aware vocabulary, treating structural tokens as addressable evidence units within autoregressive reasoning trajectories. We evaluate SciReasoner in settings where shortcut correlations are weakened and structure-grounded inference is essential. In homology-controlled Gene Ontology prediction, SciReasoner improves Cellular Component annotation for low-homology and orphan-like proteins, increasing Fmax from 0.42 to 0.55. In chemistry, it raises single-step retrosynthesis accuracy from 0.63 to 0.72 while generating fragment-level disconnection and precursor-verification traces. In materials science, its representations separate elemental and compound phases and resolve high- and low-band-gap regimes. Across 86 benchmarks, SciReasoner achieves state-of-the-art performance on 67 tasks. Double-blind expert evaluation rates its reasoning traces as preferred or at least comparable to those of a frontier large language model in 98% of cases. By making structure an inspectable substrate for reasoning under scientific constraints, SciReasoner connects accurate prediction with interpretable scientific inference.
1
1 Introduction Structure–property relationships [1–6] are foundational to the physical and biological sciences. Across proteins, small molecules and crystalline materials, observable functions and properties arise from the spatial, chemical and periodic organization of matter. In proteins, protein structures and conformations, long-range interactions and active-site geometry shape their biological functions [7, 8]; in chemicals, bonding, functional groups and stereochemistry contribute to their reactivity and molecular behaviour; and in materials, lattice symmetry, coordination motifs and periodic bonding networks dictate stability and electronic properties [9, 10]. Unraveling how these organizing principles connect structure to function, reactivity and physical response is therefore central to functional annotation, molecular design and materials discovery. Yet, explaining these relationships mechanistically is rarely a straightforward pattern-matching problem. Evidence for a function, reaction or material property is distributed across local motifs, non-local contacts, chemical environments, conformational geometry and long-range periodic order. When annotating a protein or planning a synthesis route [11, 12], human experts integrate heterogeneous cues, compare competing structural hypotheses and apply biochemical, chemical or crystallographic constraints [13, 14]. Artificial intelligence (AI) can accelerate this process by retrieving knowledge and screening large structural spaces, but it faces a deeper representational challenge: to support expert-like scientific reasoning, a model must represent biological, chemical and materials structures as native objects and use them as evidence in explicit, inspectable reasoning. Current scientific AI systems only partially meet this requirement because they often separate native structural representation from evidence-linked reasoning. Large language models provide a flexible interface to scientific knowledge, but when proteins, molecules and crystals are cast primarily as text, structural organization is compressed into strings or descriptions, making the resulting explanations depend largely on linguistic associations rather than directly addressable physical evidence [15–17]. Agentic systems extend such models through retrieval, tool use and workflow coordination [18–21], yet their scientific depth remains constrained by the structural competence of the foundation models they orchestrate. Domain-specific models, in contrast, often encode molecular graphs, protein structures or crystal lattices directly [9, 22, 23], but are usually optimized as task-specific predictors that output scores, labels or scalar properties without exposing the intermediate evidence behind their decisions. Thus, a critical gap remains: building a new reasoning paradigm that natively represents multidimensional scientific structures while producing reasoning traces that can be inspected against those structures. Here we propose native structural reasoning as a foundation-model paradigm for structure–property analysis across biology, chemistry and materials science. We instantiate this paradigm in SciReasoner, a multimodal scientific foundation model that represents proteins, small molecules and periodic crystals through a unified structure-aware vocabulary. By native structural reasoning, we mean that structural tokens are not auxiliary descriptors appended to language, but addressable evidence units that can be combined, cited and checked within a generated reasoning trajectory. To this end, SciReasoner discretizes coordinates, topologies and periodic connectivities into scientific tokens that preserve domain-native information, including local geometry, stereochemistry, residue-level structural motifs, lattice symmetry and crystallographic bonding patterns. These tokens are integrated with language instructions in a single autoregressive model, enabling trajectories that interleave explanatory text with specific residues, molecular fragments, conformational cues or crystal descriptors. This design changes the role of a scientific foundation model. Rather than predicting an answer after reading a structural prompt, SciReasoner generates an inspectable chain in which intermediate claims can be traced to explicit structural evidence. We test this capability in regimes where shortcut correlations are unreliable. In the Cellular Component aspect of protein Gene Ontology prediction, SciReasoner shows its largest gains in low-homology and orphan-like proteins, where evolutionary transfer provides weak evidence, improving Fmax from 0.42 to 0.55. Its attention is enriched at contact-defined DNA-binding residues and localizes to protein– DNA interfaces, suggesting that functional predictions are supported by residues that physically mediate the molecular interaction. In retrosynthesis, SciReasoner raises single-step accuracy from 0.63 to 0.72 while decomposing products into reaction-relevant fragments, identifying strategic bond disconnections and verifying chemically valid precursors. In crystalline materials, the reasoning trajectories of SciReasoner assign higher importance to symmetry-distinct sites, local coordination environments and periodic bonding motifs associated with stability and band-gap variation, suggesting that it links electronic and thermodynamic behaviour to the structural features that physically govern them. Across these examples, the common behaviour is that structural organization acts as the working substrate of inference rather than a peripheral input descriptor. Broad evaluation supports the generality of this structure-grounded modelling strategy. Across 86 benchmarks spanning proteins, DNA, RNA, small molecules, inorganic crystals, scientific question answering, property prediction and generation tasks, SciReasoner achieves state-of-the-art performance on 67 tasks. Double-blind expert evaluation further indicates that its reasoning traces are useful for scientific inspection, with experts preferring or tying SciReasoner over a frontier large language model in the overwhelming majority of comparisons. By representing structures as evidence-bearing units and linking them to inspectable conclusions, SciReasoner bridges accurate prediction and interpretable scientific inference, suggesting a route toward scientific AI systems that do not merely predict what property a structure has, but begin to explain why that structure gives rise to a particular function, reaction or material behaviour.
2
A
Protein sequence DNA sequence
MLP
Atom/bond topology • c Bond angles •
•
Nearest-neighborc • residue • Backbone fragments
Property
Design
</molecule_structure>
Qwen SciReasoner
DDDLVDAEGNLV…
</protein_structure>
+ x a DDO c OOO…
Protein
Train Freeze
Qwen3
Molecules
'C' '>c' 'cc'
Stage 2: Full-parameter Training
DNA / RNA
Protein
Crystals
Molecules
…
</material_structure>
Stage 1: Warm-up Training
SciReasoner tokenizer
Qwen tokenizer ['C', 'n', '1', 'c', '(<', '-', '1', '1', '5', '>c', '2', 'cc', 'ccc', '2', ')', 'cc', '2', 'c', '3', … (31 tokens, semantics distorted)
<material_structure>
Spatial symmetry Periodic connectivity
Pretraining:
Avg. Tokenizer Compression Ratio (Molecule) 1 0.7
…
D Continued
c
<think>Let’s break down the retrosynthetic analysis for the given product...</think> Final Answer. <SMILES>... </SMILES>
<protein_structure>
Angular features Distance descriptors
(Xiao et al.)
• •
<think> To determine the subcellular location of this eukaryotic protein… </think>
Example input: <molecule_structure> Cn1c(<115>c2ccccc2)cc 2c3no[n+]([O-])c3ccc12 </molecule_structure>
Nc1nc2cc(<129>…
Torsion angles Pseudo-chirality
(van Kempen et al.)
Atom types Bond topology
<think> To determine the formation energy for this material...</think> The final answer is -5.477.
C <molecule_structure>
SLICES • •
<think> I am looking for the compound that does not function as an antitussive... </think> The correct answer is D. Ambroxol.
Classification Final Answer: Nucleus Generation /
Foldseek
•
Stage 3: Annealing Training +
DNA / RNA Crystals
['Cn1c', '(', '<115>','c2ccccc2', ‘)‘,'cc2', 'c3no',… (14 tokens, semantics preserved)
+
+
+
Question: <rna>GAAGGTAGACCCGTTG…</rna>What ribosome loading potential is indicated by the sequence?
Text Corpus
QA
Answer: <think>To address the task of determining the ribosome loading potential for …</think> The ribosome loading potential indicated by is 0.78.
Embedding + Structure-aware Vocab
Embedding + Structure-aware Vocab
Embedding + Structure-aware Vocab
LLM Backbone
LLM Backbone
LLM Backbone
Stage 5: Cross-Domain Reasoning Consolidation
RL
SFT
Stage 4: Intra-Domain Structural Evidence Grounding Protein-Structure Expert RL SFT
Select <think>…</think>
SciReasoner
Prediction
...
• •
Crystal
Post-training:
Property
Language Instruction
(Xiong et al.)
Protein
QA
...
ConfSeq
Molecule
Scientific
Output Tokens
Add & Norm
...
Protein structure SFRIAAIPGDG IGLEVLPGI… + z o Na Na Na Crystal structure Na Na Na Bi … Cn1c<-115>c2 3D molecule Ccccc2cc2…
B
SciReasoner Decoder layers × N
Self-Attn
Small molecule
Structure-aware Tokens
Add & Norm
RNA sequence
SKGEELFTGV VPILVELDG… TTGATGCACT GAATTGTG… TTCACTGCG CAGCCTGG… CCl=CC(=C) CNC1CC1C)
Q.
Molecule-Structure Expert RL SFT
Q.
Material-Structure Expert RL SFT
…
SciReasoner Base
SciReasoner Base
Qwen Qwen
E
Material Science Chemistry Biology
3
Question Answer Struct. Def.
Fig. 1: Overview of SciReasoner, a unified multimodal foundation model for native structural reasoning across biomolecules, small molecules, and periodic crystals. (A) Structure-aware scientific reasoning interface. SciReasoner encodes heterogeneous scientific entities, including protein/DNA/RNA sequences, small molecules, protein structures, crystal structures, and 3D molecules, into structure-aware tokens. These tokens are combined with language instructions and processed by an LLM backbone to support structure-grounded scientific QA, property prediction, property classification, and generation/design tasks. (B) Structure-aware token construction. Domain-specific encoders convert scientific objects into structured textual representations: ConfSeq for molecules, Foldseek for proteins, and SLICES for crystals. These representations preserve chemically and physically meaningful information, including molecular topology, spatial geometry, local motifs, lattice features, symmetry, and space-group information. (C) Tokenizer compression and semantic preservation. Compared with the Qwen tokenizer, the SciReasoner tokenizer reduces token length for molecular inputs while preserving chemically meaningful substructures. This indivisible, structure-aware vocabulary mitigates semantic fragmentation caused by standard sub-word tokenization. (D) Continued Pretraining and post-training pipeline. SciReasoner is initialized from a Qwen model and trained through warm-up alignment, full-parameter multimodal training, and annealing tuning across scientific modalities. During post-training, intra-domain structural evidence grounding first trains task-specialized experts to use structural tokens as reasoning evidence within each domain. Cross-domain reasoning consolidation then integrates the expert-generated reasoning traces and expert capabilities into the final SciReasoner model. (E) Benchmark performance. SciReasoner is evaluated across diverse scientific QA, biology, chemistry, materials science, and generation/design benchmarks. The results demonstrate broad improvements over generalist language models and domain-specific baselines, highlighting SciReasoner’s ability to connect structural evidence with function, property, and design decisions.
2 Results 2.1 Overview of SciReasoner We present SciReasoner, a unified multimodal foundation model capable of explicit scientific sequence, structure, and textual reasoning within a single coherent output trajectory (Fig. 1A). SciReasoner serves as a unified reasoning engine that maps diverse scientific inputs, including proteins, DNA/RNA, small molecules, and periodic crystals, into a shared cross-modal latent space. Unlike conventional computational approaches in materials and biology, this architecture provides a unified, mechanism-aware framework. To integrate explicit 3D structural information into a linguistic token space, SciReasoner designs a structure-aware vocabulary designed to preserve physical and biochemical integrity (Fig. 1A). The model utilizes unified tokens representing local motifs, 3D geometry, atomic bond types, and crystal space groups (Fig. 1B). This resolves the severe limitations of conventional sub-word tokenization algorithms, which arbitrarily fragment molecular graphs and motifs, thereby destroying scientific semantics and corrupting the training process (Fig. 1C). To align this structural token space with natural language, we perform continued pretraining with a multi-stage training pipeline (Fig. 1D, Top). Stage 1 serves as a warm-up training phase that anchors the newly introduced structure-aware tokens to basic topological, geometric, and chemical semantics without destabilizing the pretrained language space. This establishes a stable structural–linguistic interface, which is further developed through Stage 2 full-parameter multimodal training and Stage 3 annealed training with an increased proportion of question–answer (QA)-style data, thereby supporting native structural reasoning. To enable robust multi-step reasoning, we developed a post-training framework named self-bootstrapped native structural reasoning (Fig. 1D, Bottom). The post-training procedure uses reinforcement learning to connect the core semantic meanings of the structural vocabulary with a chain-of-thought (CoT) strategy. This allows the model to explicitly decompose complex inputs into interpretable physical factors, such as composition, symmetry, and connectivity, before executing final property predictions or design decisions. This generative approach circumvents a major bottleneck in the field: the near-complete absence of ground-truth reasoning trajectories that simultaneously bridge sequence, structure, and text. Intra-domain structural evidence grounding first teaches domain-specific experts how structural tokens serve as evidence for reasoning. Cross-domain reasoning consolidation then integrates these domain-local evidence-use patterns into unified capabilities, reducing the trajectory collapse frequently observed in standard alignment techniques. The radar plot in Fig. 1E (left) compares SciReasoner with four contemporary generalist LLMs (Opus-4.7 [24], GPT-5.5 [25], DeepSeek-V4-Pro [26] and Kimi-K2.6 [27]) across five capability sectors and four scientific modalities (proteins, DNA/RNA, small molecules and crystals). The suite spans numerical property prediction, sequence- and structure-level classification, generation and design, modality translation and scientific QA. SciReasoner expands the polygon further than every generalist baseline in every sector, with the largest margins on tasks that demand explicit structural reasoning, where text-only LLMs collapse to near-trivial scores. We next compared SciReasoner with the published specialist that defines the prior state of the art on each benchmark (Fig. 1E, right). Unlike these specialists, each of which is restricted to a fixed numerical or categorical output, SciReasoner produces free-form natural language alongside its predictions, yet still matches or exceeds them on the majority of tasks across the three task panels on the right: SciReasoner reaches a mean Fmax = 4
0.59 on DeepFRI-GO (averaged over the three aspects), surpassing SaProt [28] (0.52); attains 0.88 accuracy on subcellular localization, exceeding the ESM2 [29] (0.84); is on par with or above the specialist on DNA promoter and transcription-factor detection; and substantially outperforms RNA-function specialists, raising Isoform R2 from 0.59 to 0.86 and RNA protein interaction MCC from 0.74 to 0.81. On the DUD-E virtual-screening suite, SciReasoner matches the previously reported best AUC of 0.76 and improves the 5.0% enrichment factor from 7.12 to 7.70. Beyond closed-set predictions, the same model handles open-ended scientific language tasks that lie entirely outside the specialists’ output space, scoring 0.85 BertScore on biomedical QA and 0.77 ROUGE-L on protein general function description, and supplies an interpretable natural-language rationale for each predicted label. High benchmark scores can be obtained by exploiting homology, scaffold or template-level shortcuts, and do not by themselves demonstrate that a model has captured the underlying science. Sections 2.2.1–2.2.4 therefore probe four structural behaviours of SciReasoner beyond average accuracy. On protein GO prediction (§2.2.1), SciReasoner shows its largest gain in the low-homology regime , improving Cellular Component Fmax at ≤ 30% identity, by +0.21 over BLAST [30] and by +0.13 over ESM2, while maintaining stable reasoning quality across similarity bins, arguing against homology memorization. On retrosynthesis (§2.2.2), the chain-of-thought interleaves language with SMILES sub-fragments along a canonical analysis → disconnection → verification → feasibility workflow, recovering literature reactants in 5/5 representative Retrosynthesis USPTO-50K cases versus 2/5 for RSGPT [31]. On 3D molecular similarity (§2.2.3), the per-molecule embedding clusters DUD-E [32] actives by binding-pocket geometry rather than 2D scaffold. On inorganic crystals (§2.2.4), the latent space separates C, Si and SiC into disjoint compositional clusters and, within each, orders polymorphs along smooth band-gap gradients. The accompanying reasoning traces explicitly invoke coordination changes, bonding topology and symmetry constraints as mechanistic evidence for linking crystal structure to properties. Consistent with this physically aligned representation, the formation-energy parity plot (Fig. 4C) reaches R2 = 0.895, well above competing models even where their absolute MAE is comparable, showing that SciReasoner captures the stability ranking rather than the marginal label distribution. Across scientific tasks spanning proteins, DNA, RNA, small molecules and inorganic crystals, SciReasoner outperforms previous state-of-the-art methods on 67 tasks, and matches or exceeds published domain specialists on 26 benchmarks wherever such a baseline exists. To further exclude reliance on sequence, scaffold or compositionlevel shortcuts, we ablated structural inputs in representative protein, small-molecule and materials tasks and observed a consistent drop in performance, with the largest effects in problems governed by folded geometry, binding-site organization, molecular shape or crystal topology (Fig. 5). The same perturbation changed the reasoning traces: without structure, the reasoning process relied mainly on sequence motifs or chemical composition, whereas structural tokens led SciReasoner to use binding pockets, coordination environments and periodic connectivity as evidence for its predictions. To our knowledge, this is the first foundation model to enable sequence, structure and natural-language reasoning across all four scientific modalities within a single autoregressive trajectory, delivering specialist-level accuracy, interpretable structure-grounded chains of thought, and open-ended scientific language generation that no prior specialist or generalist model can provide.
2.2 Benchmarking SciReasoner across proteomic, molecular, and materials tasks 2.2.1 SciReasoner precisely predicts protein GO term and learns biologically meaningful structure Assigning Gene Ontology (GO) terms [33, 34] to protein sequences is central to computational biology, translating rapidly growing sequence and structure databases [8] into interpretable functional annotations [35]. Since only a small fraction of proteins have experimentally verified functions [36, 37], accurate prediction across Molecular Function (MF), Biological Process (BP), and Cellular Component (CC) remains critical for protein characterization, pathway analysis, disease-gene interpretation, and therapeutic-target discovery [38, 39]. We evaluated GO-term prediction on DeepFRI-GO [39] and, to prevent label leakage, excluded from continued pretraining all proteins with >30% sequence identity to the DeepFRI-GO test set. As shown in Fig. 2A, SciReasoner attains an overall (Fmax = 0.59), outperforming sequence-based BLAST transfer (0.55) [30], structure-based Foldseek 3Di alignment (0.54) [40], fine-tuned protein language models including ESM2 (0.53) [29] and SaProt 650M AF2 (0.52) [28], and general-purpose reasoning LLMs, DeepSeek-V4-Pro (0.35) and GPT-5.5 (0.31). The gain is strongest for CC, where SciReasoner reaches 0.58 versus BLAST (0.49), and remains positive for BP (0.52 versus 0.51). MF is near saturation, with SciReasoner at 0.66, comparable to SaProt (0.67). Overall, SciReasoner is the only method that leads or matches the best baseline across all branches, indicating that it integrates evidence beyond any single baseline family. To determine whether these gains reflect genuine functional inference rather than memorized homology-based transfer, we stratified the test proteins by maximum BLAST percent identity to the training set (e ≤ 10−3 , query coverage ≥ 50%, self-hits removed). The advantage of SciReasoner is largest precisely where sequence similarity becomes unreliable. In the CC (0, 30]% identity bin, SciReasoner improves over BLAST by +0.21 absolute Fmax (0.55 versus 0.34 in Fig. 2A), and outperforms ESM2 by +0.13 absolute Fmax (0.55 versus 0.42). This
5
A
C
B
D
Overall
Biological Plausibility
Reasoning Coherence
Input Fidelity
Functional Hypothesis
E
F What are the Gene Ontology terms (biological process) for this protein? <protein>MKRAV…RKLKD</protein> <protein_structure> D F W K F … G D D D D </protein_structure> Only the biological process (BP) aspect. <think> First, I examine the overall structural architecture encoded in the 3Di string … There are significant runs of residues encoding alpha-helical conformations, such as the segment <protein_structure> VVVV </protein_structure>, which appears multiple times. According to the 3Di rules, runs of V and L correspond to alpha-helices … Conversely, I see segments like <protein_structure> DDLPPVDDP </protein_structure>, which suggest beta-strand or turn-rich regions. The alternation between these helical (V/L) and strand/loop (D/P/A) elements indicates an alpha/beta protein fold, which is characteristic of enzymatic domains, particularly those involved in metabolism … The presence of glycine-rich regions is often associated with nucleotide or acyl-CoA binding, which is common in biosynthetic pathways ...
VVVV
Therefore, the biological processes should reflect lipid metabolism, specifically the biosynthesis and modification of fatty acids and their derivatives … </think>
DDLPPVDDP
Fig. 2: SciReasoner predicts protein Gene Ontology terms through structure-grounded reasoning. (A) Performance on the CAFA-3 Gene Ontology benchmark for Molecular Function, Biological Process and Cellular Component annotations, stratified by maximum BLAST sequence identity to the training set. SciReasoner shows the largest gains in low-homology regimes, particularly for Cellular Component prediction. (B) Attention analysis for DNA-binding Gene Ontology prediction. Residues receiving high attention are enriched at contact-defined DNA-binding sites and localize to protein–DNA interfaces in representative complexes. (C) Reinforcement-learning trajectories for the three ontology aspects. Rewards increase after an initial exploration phase and converge to stable plateaus, indicating consistent optimization across molecular-function, biologicalprocess and cellular-component annotations. (D) LLM-as-judge evaluation of reasoning traces on held-out Biological Process proteins. Reinforcement learning improves input fidelity, biological plausibility, reasoning coherence and functional-hypothesis quality relative to the coldstart checkpoint and DeepSeek-V4-Pro. (E) Reasoning-quality scores stratified by BLAST similarity for Biological Process prediction. Mean GPT-5.5 judge scores are reported on five rubric axes across seven similarity bins relative to the training set (n = 20 proteins per bin; error bars, s.e.m.). SciReasoner-RL achieves the highest scores across axes and remains stable across similarity bins, suggesting that its reasoning generalizes beyond memorized homologues. (F) Structure-token visualization of the reasoning trace for E. coli β -ketoacyl-ACP synthase I (FabB; 2bz4 A, UniProt P0A953). Load-bearing claims and cited 3Di-token fragments are highlighted in the trace and mapped onto PyMOL-rendered structures. The VVVV fragment maps to canonical α-helices, whereas DDLPPVDDP maps to an extended-strand/turn region, supporting the inferred α/β fold and the resulting fatty-acid biosynthesis annotation.
6
low-homology advantage aligns with the design of SciReasoner: whereas BLAST relies on local sequence similarity, ESM2 encodes evolutionary and sequence-context patterns without explicit structural grounding, SciReasoner predicts GO terms through reasoning traces that integrate domain composition, localized motifs, structural environments, and reference proteins. Such local functional cues can remain conserved even when global sequence identity is weak. We next tested whether SciReasoner grounds GO predictions in functionally relevant protein regions rather than superficial sequence patterns. Using DNA-binding proteins, where protein–DNA contacts provide structural ground truth, we extracted attention from the generated DNA-binding GO token (GO:0003677) to residue-level structure and sequence tracks and combined them into a per-residue profile. These profiles strongly align with DNA-binding sites (Fig. 2B): catabolite control protein A (UniProt: P25144) reaches AUROC (=0.91) and top-20% fold enrichment (= 4.2×), histone H2B type 1-A (UniProt: P70696) reaches AUROC (=0.83) and enrichment (= 3.6×), and DesT (UniProt: Q9HUS3) reaches AUROC (=0.78) and enrichment (= 3.1×). In all cases, the most attended residues fall within or immediately adjacent to annotated binding regions, and structural projections confirm that these residues cluster near bound DNA in three-dimensional space. Thus, SciReasoner does not merely assign the correct GO term. It concentrates its evidence on residues that are physically responsible for the corresponding molecular function. Reinforcement learning further improves GO prediction across all three ontology aspects (Fig. 2C). After a brief exploration phase during the first ∼ 5% of training, in which the science reward temporarily decreases under noisy advantages, all three trajectories rise and converge to stable plateaus. MF reaches the highest reward (∼ 0.92), while BP and CC converge at comparable values (∼ 0.89). The simultaneous improvement across all aspects indicates that RL does not merely exploit aspect-specific shortcuts, but instead strengthens a shared proteinfunction representation that supports functional, process, and localization annotations. Because Fmax captures only final GO-term overlap, we also evaluated the reasoning traces underlying those predictions. To assess grounded biological inference beyond surface fluency, we used GPT-5.5 to score held-out BP traces on Overall Quality, Input Fidelity, Biological Plausibility, Reasoning Coherence, and Functional Hypothesis Quality. SciReasoner scores highest on every axis, with an Overall score of 8.33 versus 7.77 for SciReasoner-ColdStart and 6.96 for DeepSeek-V4-Pro [26] (Fig. 2D). Relative to the pre-RL coldstart model, the largest improvement is in Biological Plausibility (8.68 vs. 7.83), indicating that RL sharpens not only the fluency of the trace but also the biological relevance of the inferred function. The gap to DeepSeek-V4-Pro is concentrated on the biology-specific axes—Biological Plausibility (8.68 vs. 6.63) and Functional Hypothesis Quality (8.45 vs. 6.77)—and is far wider there than on Input Fidelity (8.27 vs. 8.04). Although DeepSeek-V4-Pro is a substantially larger general-purpose model, this pattern shows that domain-tuned scientific reasoning, rather than raw model scale alone, drives the improvement. We stratified reasoning quality by BLAST similarity to test whether SciReasoner relies mainly on close homologues (Fig. 2E). Across seven similarity bins, SciReasoner maintains higher judge scores than both the coldstart checkpoint and DeepSeek-V4-Pro, including in low-similarity regimes where direct homology transfer is least reliable. This helps explain the low-homology gains in Fig. 2A. Rather than copying annotations from close neighbours, SciReasoner can combine weaker but conserved cues, such as local structural motifs, short sequence fragments, fold-level patterns, and biochemical context. These results suggest that its improved performance on low-similarity proteins arises from structure-grounded functional reasoning rather than memorization of homologous sequences. Finally, Fig. 2F illustrates how the model’s reasoning can be audited at the level of structure tokens. For E. coli β -ketoacyl-ACP synthase I (UniProt: P0A953), SciReasoner identifies repeated VVVV fragments as canonical α-helical regions and the DDLPPVDDP fragment as an extended strand/turn-rich segment. The trace then links this fold architecture, together with glycine-rich and catalytic-context cues, to fatty-acid biosynthesis and related lipid-metabolic processes. This example demonstrates that the reasoning trace is not an isolated natural-language explanation: its claims can be connected back to explicit structural substrings and spatial regions of the protein. Together, these results show that SciReasoner advances GO-term prediction in three ways: it improves accuracy most in low-homology regimes, grounds predictions in localized sequence and structural evidence, and uses reinforcement learning to enhance both annotations and reasoning quality. Thus, SciReasoner serves not only as a more accurate GO predictor, but also as a mechanism-aware annotation framework that explains molecular function, biological process, and cellular localization assignments.
2.2.2 SciReasoner formulates chemically viable retrosynthetic routes with high precision Retrosynthesis (the recursive disconnection of a target molecule into commercially available precursors) is the cognitive backbone of organic-synthesis route planning. Reliable retrosynthetic models accelerate hit-to-lead optimization, and an interpretable reasoning trace lets human chemists verify and reuse the suggested routes. We evaluate on the standard Retrosynthesis USPTO-50K [41] split: the model is given a single target SMILES and must output the set of reactant SMILES that produces it. We sample 16 stochastic completions per query (T =0.6, top-p=0.95) and rank the answers by sample frequency. A prediction is correct only when its canonical SMILES exactly matches the ground-truth reactant set, and we report Exact Match as the standard metric. Fig. 3A places SciReasoner against 18 published baselines spanning template-based [42–46], semi-template-based [47–52] and template-free [24, 31, 53–57] families: SciReasoner reaches 0.72 (Exact Match), exceeding the previous best
7
ADA17
A
D
AUC
5.0% EF
ADA17
PGH2
PGH2
ADA17
PGH2
B
E
ADA17
2 Retrosynthetic Disconnection
1 Analysis of the Product Structure
PGH2
ADA17
PGH2
a
query
A 2-(pyrimidin-2-ylamino)ethoxy group: This consists of …
Product
A benzhydryl-like core: This is a … A carboxylic acid functional group: … is part of an ester linkage to a carbonyl group, …
4 Reaction Feasibility
The reaction is the esterification of the alcohol and the acid. This … (like H2SO4) or … (like DCC). … eliminating water to form the ester bond.
Reactants 2-cyclohexyl2-hydroxy2-phenylacetic acid
2-(pyrimidin2-ylamino) ethanol
The most strategic disconnection is at the ester linkage (the C-O bond …). This is a … 1. 2.
query
The alcohol component: … The acid component: …
query
query
3 Verification of Reactants Phenyl ring Let's verify if these fragments match provided SMILES: Reactant 1 (The Alcohol): … Reactant 2 (The Acid): …
Cyclohexyl ring
c
active 1
b
query
query active 1
Carboxylic acid group
active 1
CAH2 CAH2 CAH2
Hydroxyl group
query
active 1
query
Alphahydroxyl carbon
Ethanolamine backbone
CAH2 CAH2 active 1
active 2
CAH2 active 2
Amino linkage
Pyrimidine ring
active 1
active 1
active 2
active 1
C
query
active 2
active 1
active 2
query
query query
query
active 1
active active 1 1
active 1
active 3
active 2
active 2 active 2
active 2
active 3
3 activeactive 3
active 3 active 2
active 2
active 2 active 2
Product
Ground Truth
Rank-1
Rank-2
Rank-3
Rank-1
Rank-2
RSGPT
SciReasoner
Rank-3
Rank-1
Rank-2
Opus-4.7
Rank-3
Fig. 3: SciReasoner formulates chemically viable retrosynthetic routes (A–C) and captures plausible 3D molecular structure for similarity representation (D, E). (A) Retrosynthesis USPTO-50K performance. Across template-based, semi-template-based and template-free methods, SciReasoner reaches 0.72, exceeding the prior best RSGPT by +0.09 points, while Opus-4.7 five-shot scores only 0.48. (B) Chain-of-thought trace for a representative product. SciReasoner proceeds in four interpretable stages—Analysis, Disconnection, Verification and Feasibility, and recovers the two ground-truth reactants by severing the strategic ester C–O bond. Every intermediate claim is itself a SMILES fragment, making the trace auditable atom-by-atom. (C) Cross-model Top-3 reactant predictions on Retrosynthesis USPTO-50K. Five products with their ground-truth reactants and the Top-3 predictions of SciReasoner, RSGPT and Opus-4.7. Molecules in pink match the gold canonical SMILES. SciReasoner recovers a correct candidate for 5/5 products versus 2/5 for RSGPT and 2/5 for Opus-4.7, generalising across mechanistically distinct reaction families, rather than fitting a single template. (D) Per-target distributions on 3D molecule structure (DUD-E). AUC and 5.0% EF box plots over 102 DUD-E targets for nine published baselines, an Opus-4.7 reference, and SciReasoner. SciReasoner matches the previously reported best AUC and establishes a new best 5.0% EF. (E) 3D ligand-target geometry for three DUD-E targets. UMAP of the per-molecule SciReasoner embedding, coloured points are the 400 closest actives for each target, labelled by DUD-E target identifiers—ADA17 (blue), CAH2 (orange), and PGH2 (green); open stars mark the reference queries. Side panels show each query and three representative actives docked into the receptor, then redrawn as 2D structures: chemically distinct scaffolds that nevertheless converge to the same 3D pharmacophore.
template-free method RSGPT [31] (0.63) by +0.09 points, while Opus-4.7 five-shot scores only 0.48. To prevent direct test leakage, we removed from the pretraining corpus all reactions whose product SMILES matched any product in the Retrosynthesis USPTO-50K test set. Unlike generic chat models that emit a free-form natural-language explanation followed by a single SMILES guess, SciReasoner is a scientific reasoning model that interleaves natural-language steps with structural tokens (SMILES fragments) inside its chain-of-thought, e.g. the ester C–O bond, the phenyl ring c1ccccc1. Because the intermediate steps are themselves chemical structures, the trace can be checked atom-by-atom and the final reactant assembly is grounded in concrete sub-fragments. Fig. 3B illustrates this on a hydroxy-substituted benzhydryl ester. SciReasoner severs the strategic ester C–O bond, independently verifies the expected functional groups on each precursor, and recognises the inverse reaction as an acid-catalysed esterification. Six of the seven sub-fragments emitted in the trace are strictly smaller than
8
either reactant, yet their union exactly reconstructs the gold answer, indicating bottom-up reasoning over chemical groups rather than template recall. Fig. 3C extends this to five further Retrosynthesis USPTO-50K products, contrasting SciReasoner against the specialised retrosynthesis model RSGPT and the general-purpose large language model Opus-4.7. SciReasoner contains the gold reactant set in its Top-3 for 5/5 rows; RSGPT recovers it in 2/5, and Opus-4.7 in 2/5. On the N -tert-butyl pyridine-carboxamide aldehyde, SciReasoner recovers the literature Vilsmeier formylation route (DMF/Br precursor pair) with a single canonical answer across all 16 samples; RSGPT proposes a hydroxymethyl + bromopyridine pair, while Opus-4.7 commits all three ranks to oxidation of a benzyl alcohol and never proposes the C–N disconnection (Fig. 3C, Row 1). On a 1,4-disubstituted 1,2,3-triazole-fused phenylbenzofuranone, the gold cut is a copper-catalysed azide–alkyne [3+2] cycloaddition (CuAAC) of trimethylsilyl azide with the terminal aryl-alkyne; only SciReasoner’s rank-1 recovers this pair, while RSGPT keeps the triazole intact and disconnects elsewhere and Opus-4.7 mis-treats the cycloaddition as an azide-plus-nitrile coupling (Fig. 3C, Row 2). On a chloro-arylsulfanyl tetrahydrofuro-pyridine N -Boc carbamate, the strategic cut is m-CPBA oxidation of the thioether to the sulfoxide; only SciReasoner’s rank-1 identifies it, while RSGPT and Opus-4.7 instead attempt to cleave the Boc carbamate or the tetrahydrofuran (Fig. 3C, Row 3). On a polycyclic indole-based amide, SciReasoner and Opus-4.7’s rank-1 both propose the correct amide coupling between the bicycloalkyl carboxylic acid and the parent aniline; the remaining baselines fragment the indole or the trifluoromethyl chain (Fig. 3C, Row 4). On a thiophene–phenyl biaryl bearing a Boc-aminothiophene and a spirolactone-piperazine amide, the strategic cut is a Suzuki–Miyaura coupling of the 5-bromo Boc-aminothiophene with benzyl 4-boronate-benzoate; SciReasoner returns this pair across all 16 samples and Opus-4.7’s rank-1/rank-2 both match, while RSGPT recovers the gold pair only at rank-3 (Fig. 3C, Row 5). Taken together, the structural-token chain-of-thought makes SciReasoner’s predictions both more accurate and easier to audit: the trace states inside itself why each bond is the strategic cut, rather than answering in one step.
2.2.3 SciReasoner captures plausible 3D molecular structure for similarity representation Identifying compounds that share a binding-pocket geometry but not a 2D scaffold is the central problem of virtual screening and ligand-based drug discovery. A representation that groups molecules by binding-pocket compatibility, rather than by simple substructure overlap, would directly enable hit expansion and scaffold hopping. We probe whether SciReasoner itself already provides such a representation. From a single-molecule prompt, we extract the last layer hidden state of SciReasoner and average it over the 10 tokens generated immediately after the prompt to obtain a molecular embedding. Following the standard DUD-E protocol [32], we ask how well Euclidean distance in this embedding space ranks actives versus decoys for a given target query, reporting AUC and the 5.0% EF, and the embedding’s qualitative structure is visualised via 2D UMAP projection. SciReasoner natively consumes structural tokens : a dedicated ConfSeq [58] tokenizer converts each 3D conformer into a sequence of geometry-aware tokens drawn from a separate vocabulary backed by a separate learned embedding table, held disjoint from the natural-language embedding. Because structural tokens are a parallel modality, geometric features are separated from those used for IUPAC names or descriptive language, so the hidden states above structural-token positions carry an uncontaminated geometric signal. Fig. 3D quantifies this representation against nine published virtual-screening methods on 102 DUD-E targets, spanning alignment-free descriptors and alignment-based shape-overlay methods [58–66], plus an Opus-4.7 [24] reference. Used as a drop-in similarity feature, SciReasoner’s per-molecule embedding matches ConfSeq’s prior best AUC of 0.76 and improves the best 5.0% EF from 7.12 to 7.70, obtained without docking, scoring functions, or task-specific fine-tuning. Fig. 3E demonstrates the qualitative structure of the same embedding on three pharmacologically distinct DUDE targets spanning unrelated protein families: ADAM17 (a zinc metalloprotease), carbonic anhydrase II (a zinc hydrolase) and cyclooxygenase-2 / PGHS-2 (a heme-containing dioxygenase). Each target’s top-400 closest actives form a clearly separated cluster around its query ligand (⋆) on the 2D UMAP, and the three clusters occupy distinct regions of the plane despite the proteins being sequence-unrelated, and the decoys (light grey) do not infiltrate any cluster, indicating that the embedding captures family-specific chemistry rather than gross descriptors. The boxed side panels visualise the per-target binding mode in 3D. For ADAM17, the cyclic-thiol sulfonamide query is matched by closest actives that swap the thiopyrrolidine zinc-binder for a hydroxamate amide or extend the alkyne tail into a propargyl amine while keeping the diaryl sulfonyl core; their Morgan-fingerprint Tanimoto similarities to the query are only 0.30–0.32, yet USRCAT 3D-shape similarities remain greater than 0.22 and Open3DALIGN scores reach 120–140, meaning all three ligands drape over the same TACE active site. For PGHS2, the celecoxib-like diaryl-pyrazole sulfonamide query is matched by an indanone-acetic-acid analog (Tanimoto 0.11) and a chloro-aryl-thiazole-sulfonamide (Tanimoto 0.31), chemically divergent COX-2 chemotypes that adopt the same 3D pharmacophore. Carbonic anhydrase II is the most striking case: the query reduces to the minimal NH2 -SO2 -CF3 warhead, and its three closest actives—a cyclohexyl sulfamate, a pyridyl-thiadiazole sulfonamide and a thiopheno-thiazinone, spanning very different fused-ring topologies yet all expose the canonical zinc-binding sulfonamide that defines CA-II inhibition. Taken together, both qualitative and quantitative results indicate that SciReasoner has implicitly learned to cluster DUD-E actives by binding-pocket geometry rather than scaffold similarity.
9
A
C
B
Graphite MP-568286 Moissanite-6H MP-570985
D D
Diamond MP-569567
High Bandgap Region
Low Bandgap Region
High Bandgap Region
Low Bandgap Region
E Look at the chemical formula and structure information of the given crystalline material and predict its property. Is the following material (TiGaCo2) stable?
<think>To determine the stability of the crystalline material with formula TiGaCo2, I need to analyze the provide structure …The token sequence <material_structure>+ t a ODD a DOD b OOO c OOO d OOO e OOO o</material_structure> maps directly to the space group Fm-3m, a high-symmetry system often associated with stable intermetallic compounds … Next, I parse the atom list to verify the stoichiometry… Then, I investigate the bonding network to understand the local coordination environment. The bond <material_structure>0 12 --o</material_structure> connects a titanium atom to a cobalt atom across a unit cell boundary … <material_structure>0 6 ooo</material_structure> shows a titanium-gallium bond within the same cell … The density of these edges, such as <material_structure>1 11 o-</material_structure> …<material_structure>4 9 ---</material_structure> … This heteroatomic bonding topology is crucial for stabilizing the structure through electronic interactions … The combination of the Fm-3m space group, the 1:1:2 stoichiometry, and the fully connected bonding network is characteristic of the L2_1 Heusler structure type. Therefore, the structural evidence points strongly towards a stable material configuration. </think>
+ t a ODD a DOD b OOO c OOO d OOO e OOO o
Fm-3m cubic, facecentered
0 12 --o
1 11 o--
0 6 ooo
4 9 ---
Ti-Co periodic Ti-Ga intra-cell Ti-Co periodic Ga-Co periodic edge edge edge edge
Fig. 4: Evaluation of material predictive performance and visualization of the learned structure-property latent space. (A) Performance comparison across 10 material property prediction sub-tasks, both regression (MAE as the metric) and classifications (AUC as the metric) tasks are reported. (B) UMAP of the high-dimensional representations extracted by the model on three materials (C, Si and SiC). The latent space inherently clusters materials by chemical space and spontaneously distinguishes distinct structural polymorphs. (C) Parity plots comparing model-predicted formation energies per atom and bandgap against ground-truth values. The strong correlations (R2 = 0.895 and 0.785) demonstrate the model’s ability to capture physically meaningful materials-property information. (D) Local UMAP embeddings for the Si and SiC subsets, color-coded by their corresponding band gaps. The continuous transition and distinct grouping of high- and low-bandgap regions indicate that the learned representations effectively capture underlying structure-property relationships. (E) Structure-grounded reasoning trace for a representative stability prediction on TiGaCo2 . The model’s reasoning explicitly identifies the SLICES symmetry substring, which decodes to the Fm3̄m space group, and cites edge substrings. These substrings are mapped back to the corresponding CIF structure, where they visualize the global cubic symmetry framework and local periodic connectivities. 10
2.2.4 SciReasoner learns structure- and property-aware representations for materials tasks We evaluated SciReasoner on ten downstream materials sub-tasks from five complementary databases: Materials Project1 , JARVIS-DFT2 , SNUMAT3 , hMOF4 , and QMOF5 . These sub-tasks cover inorganic crystals, semiconductors and metal organic frameworks, and include thermodynamic stability, formation and total energies, electronic band gaps, spin orbit coupling, CO2 uptake and pore geometry. For these sub-tasks, SciReasoner was compared with CGCNN [9], LLM-Prop [67] and Opus-4.7, using Mean Absolute Error (MAE) for regression tasks and Area Under the Curve (AUC) for classification tasks. As shown in Fig. 4A, SciReasoner outperforms CGCNN across all ten tasks and exceeds LLM-Prop on most numerical properties. These results indicate that its representations capture both general energetic trends and more specialized relationships involving electronic structure, relativistic effects, adsorption behaviour and pore geometry. We next examined the latent space learned by SciReasoner. UMAP projections show clear separation among C, Si and SiC structures, indicating that the embeddings encode global chemical identity (Fig. 4B). Within each compositional domain, structures do not collapse into a single cluster. Instead, they form extended subspaces that distinguish polymorphs and polytypes with the same composition, suggesting sensitivity to local geometry and bonding topology. At the quantitative level, SciReasoner produces DFT-consistent predictions for both formation energy and band gap, with parity plots showing close agreement with ground-truth values and residuals concentrated around zero (Fig. 4C). This predictive accuracy is reflected in the learned representation space: local UMAP projections for Si and SiC separate low- and high-band-gap structures while preserving continuous property gradients within each compositional manifold (Fig. 4D). Together, these results show that SciReasoner organizes structurally related materials along physically meaningful electronic-property manifolds, rather than encoding composition alone. A representative TiGaCo2 stability prediction illustrates how SciReasoner grounds its reasoning in explicit structural tokens rather than relying only on the chemical formula (Fig. 4E). The model identifies the structure substring corresponding to the Fm3̄m space group and links local edge substrings to periodic Ti–Co, Ti–Ga and Ga–Co connectivities in the reconstructed CIF structure, providing a traceable connection between token-level evidence and crystallographic features.
2.3 Structural evidence drives native scientific reasoning To test whether native scientific reasoning depends on explicit structural evidence, we performed structure-ablation experiments across materials, proteins and small molecules (Fig. 5A). Removing structural information consistently weakened performance, whereas providing structural inputs improved prediction across all three domains. The gains were especially pronounced for protein tasks, where function depends on folded geometry, binding-site organization and spatial residue interactions, but were also evident in materials and molecular-similarity tasks, where periodic topology and three-dimensional shape provide information that cannot be recovered from composition, sequence or two-dimensional descriptors alone. Thus, the ablation shows that structural evidence is not merely an additional input channel, but a necessary substrate for the model’s native scientific reasoning. The embedding analysis further shows that SciReasoner learns a distinct representational space for structural evidence (Fig. 5B). In the Qwen embedding space, paired protein sequence and structure inputs remain partially intermixed, suggesting that structural descriptions are treated largely as another form of text. By contrast, SciReasoner forms more clearly separated sequence and structure clusters, indicating that structural tokens occupy a distinct representational subspace while preserving within-modality consistency. This modality separation suggests that the model can distinguish sequence-level evidence from structure-level evidence, a prerequisite for reasoning tasks that require explicit modelling of sequence–structure relationships. Case studies show that structural evidence changes the reasoning path, not merely the final output. For QMOF pore-limiting-diameter prediction, the structure-free model relies on compositional and stoichiometric priors and overestimates the pore size by nearly an order of magnitude (Fig. 5C). With structural tokens, SciReasoner instead cites monoclinic symmetry, cobalt coordination to nitrogen and oxygen atoms, edge connectivity and periodic offsets, producing a prediction close to the ground truth. Similarly, for biological-process GO prediction, sequenceonly reasoning is diverted by cationic and histidine-rich motifs towards DNA recombination and stress-response terms, whereas structure-aware reasoning integrates secondary-structure context and binding-pocket evidence to recover protein-modification annotations (Fig. 5D). These examples indicate that structural evidence redirects the model from superficial sequence or composition cues towards physically and biologically meaningful explanations. Quantitative analyses support the same conclusion. For materials prediction, structural input reduces absolute errors for bandgap, largest-cavity-diameter and pore-limiting-diameter prediction (Fig. 5E), showing that crystal geometry improves both electronic-structure and pore-geometry inference. For GO molecular-function prediction, residue-level attention maps show that structure-aware reasoning concentrates high attention around the functional 1
https://materialsproject.org/ https://jarvis.nist.gov/jarvisdft https://www.snumat.com/ 4 https://mof.tech.northwestern.edu/ 5 https://contribs.materialsproject.org/projects/qmof 2 3
11
binding site, whereas sequence-only reasoning attends to non-binding regions and yields lower accuracy (Fig. 5F). Together, the ablations, representation analysis, reasoning cases and attention maps support the claim that structural evidence drives native scientific reasoning in SciReasoner, enabling the model to ground its conclusions in biologically and physically meaningful structural features rather than superficial sequence, composition or textual correlations.
2.4 Intra-domain grounding and cross-domain consolidation stimulate self-bootstrapped native structural reasoning While broad scientific pre-training provides diverse molecular, biomolecular, and materials representations, it does not establish a unified reasoning protocol across scientific tasks. We therefore adopt a self-bootstrapped post-training framework, which first grounds structural evidence within each scientific domain (i.e., intra-domain structural evidence grounding) and then integrates these domain-local reasoning patterns into a single scientific reasoner (i.e., cross-domain reasoning consolidation) (Fig. 6A). Sketch traces provide only a coldstart prior, after which domain-structure experts generate higher-quality on-policy traces that are pooled for final training. Together, this two-stage procedure turns pre-trained structural priors into explicit scientific reasoning, first eliciting domainnative evidence use and then consolidating it into a unified structure-grounded reasoner. The reward and performance dynamics in Fig.6B support the self-bootstrapped strategy. Intra-domain structural evidence grounding yields consistent reward gains across task families, indicating that a small set of sketch traces can seed trainable reasoning behaviours. After expert-generated traces are pooled, cross-domain reasoning consolidation enables the unified SciReasoner to outperform the coldstart baseline across both structure-intensive and non-structure tasks. This suggests that expert-generated traces better align with the model’s representation space, enabling model-native reasoning trajectories to emerge. Fig. 6C shows that the post-training procedure improves both first-sample accuracy and sampling efficiency across tasks. For pass@10, we used task-specific aggregation: the mean Fmax@10 across BP, MF and CC for GO annotation, an oracle best-of-10 prediction selected by minimum absolute error for QMOF regression, a label-independent 10-sample score ensemble followed by 5.0% EF evaluation for 3D molecule structure (DUD-E), and top-10 reactantset accuracy for retrosynthesis. In GO term prediction, intra-domain structural evidence grounding raises pass@1 from 0.48 to 0.52 and reduces the pass@10–pass@1 gap from 0.13 to 0.11, while cross-domain reasoning consolidation further achieves the highest pass@1 of 0.59 with a smaller gap than its coldstart precursor. In QMOF prediction, pass@1 increases from 2.71 to 4.76 after intra-domain structural evidence grounding and from 6.80 to 8.61 after cross-domain reasoning consolidation, with the gap reduced from 11.29 to 4.07 and from 13.82 to 5.57, respectively. 3D molecule structure (DUD-E) prediction shows the same trend: pass@1 improves from 4.65 to 6.31 after intra-domain structural evidence grounding and from 7.29 to 7.70 after cross-domain reasoning consolidation. Retrosynthesis shows the largest absolute gain, with pass@1 rising from 0.41 to 0.49 after intra-domain structural evidence grounding and to 0.72 after cross-domain reasoning consolidation, accompanied by gap reductions from 0.36 to 0.26 and from 0.22 to 0.09. These consistent gap reductions indicate that the procedure does not merely improve best-of-N performance, but concentrates probability mass on correct first responses, making SciReasoner more reliable under single-sample scientific prediction. Fig. 6D further evaluates reasoning quality beyond final-answer accuracy using LLM-judge score distributions over 100 records per task. Self-bootstrapped native structural reasoning consistently shifts the distributions toward higher scores, with the largest worst-to-best mean improvement on 3D molecule structure (DUD-E) (∆mean = +3.10), followed by GO protein-function annotation (+1.79), QMOF property prediction (+1.61), and Retrosynthesis USPTO-50K (+0.48). The larger gains on DUD-E, GO and QMOF suggest that the selfbootstrapped procedure is especially effective when reasoning must be grounded in molecular topology, protein structural evidence or crystal-property relationships. By contrast, retrosynthesis starts from an already high reasoning-quality distribution, leaving less room for improvement. Its smaller but positive shift therefore indicates slower saturation rather than failure of the post-training procedure. Overall, these distribution-level gains show that the procedure improves not only answer correctness, but also the coherence and evidence grounding of the scientific reasoning process. Fig. 6 shows that self-bootstrapped native structural reasoning progressively transforms domain-structure experts into a unified scientific reasoner. Intra-domain structural evidence grounding strengthens domain-specific reasoning, while cross-domain reasoning consolidation transfers these capabilities into a single cross-domain model. Improvements in reward, pass@1 performance, and reasoning quality demonstrate more accurate and stable evidence-grounded reasoning.
2.5 Human Expert Evaluation The automated metrics and LLM judges establish that SciReasoner produces accurate answers, but they cannot establish whether its reasoning traces are genuinely useful to domain experts. We therefore conducted a doubleblinded human evaluation pilot in which domain experts compared SciReasoner and DeepSeek-V4-Pro reasoning traces on cases spanning three tasks — GO protein-function annotation, crystalline-material property prediction, and single-step retrosynthesis on Retrosynthesis USPTO-50K. Evaluators were double-blinded to model identity
12
B
A
C Look at the chemical formula and structure information of the given crystalline material and predict its property: Pore Limiting Diameter (PLD).
Look at the chemical formula of the given crystalline material and predict its property: Pore Limiting Diameter (PLD).
Ground Truth: 1.27075 … The space group encoding <material_structure>+ y c OOD o</material_structure> indicates a monoclinic symmetry, specifically matching the P2_1/c setting. … I analyze the edge list for bonding patterns. I observe connections such as <material_structure>0 120 ooo</material_structure> and <material_structure>0 126 ooo</material_structure>, which link the cobalt atom at index 0 to nitrogen atoms. … Edges like <material_structure>0 128 ooo</material_structure> and <material_structure>0 143 ooo</material_structure> show bonds to oxygen atoms, indicating a mixed N/O ligand environment. The presence of offsets like <material_structure>16 84 oo</material_structure> and <material_structure>17 85 o+o</material_structure> reveals how the structure extends across unit cell boundaries. … Final Answer: 1.14197
…Without explicit structural coordinates in the input, I must rely on the established correlation between this specific stoichiometry and its known crystallographic phase. … The high carbon content relative to the cobalt centers implies bulky linkers that create significant spacing between the metal nodes. … A Pore Limiting Diameter of approximately 11 angstroms is physically reasonable for a framework of this composition. If the value were significantly smaller, it would imply a collapsed structure inconsistent with the hydrogen count suggesting rigid linkers. … Final Answer: 11.10694
D Determine the GO annotations for the protein with sequence <protein> MSTLRL …</protein> and structural features <protein_structure> D D L E A … </protein_structure>. Only the biological process (BP) aspect.
Determine the GO annotations for the protein with sequence <protein> MSTLRL … </protein>.Only the biological process (BP) aspect.
Ground Truth: protein modification process; peptidyl-amino acid modification; macromolecule modification; protein maturation; peptidyl-lysine modification … Runs of V and L ... signify alpha-helical segments ... <protein_structure> L L L L L V V V L </protein_structure> ... indicates a stable helix ... runs of D, P, A ... correspond to beta-strand or turn regions. The alternation ... suggests an alpha/beta mixed protein ... characteristic of many enzymes that bind nucleotides or cofactors ...
… Stretches like <protein> RRSSGGG </protein> and <protein> DKKKLAA </protein> ... cationic clusters ... associated with membrane association or interaction with ... phosphate backbones of nucleic acids ... narrows my scope to DNA repair, replication, or recombination…
… the motif <protein> GDRKVSGSAYRETKDRGFHHGT </protein> suggests a binding pocket ... likely involving ATP or a similar phosphate donor ... a rigid active site necessary for catalysis.
… <protein> GFHHGT </protein> ... contains a histidine-histidine pair ... critical for metal ion coordination ... cofactors for nucleases and polymerases. ... the profile strongly resembles a recombinase or a resolvase . These enzymes are responsible cutting and rejoining DNA strands.
Final answer: protein modification process; peptidyl-amino acid modification; macromolecule modification; protein maturation; peptidyl-lysine modification
Final answer: DNA recombination; DNA metabolic process; response to stress; DNA damage response
E
F
Fig. 5: Structural information empowers native scientific reasoning. (A) Structure-ablation benchmark. Performance with and without structural inputs across materials, proteins and small molecules. Structural cues consistently improve prediction beyond sequence- or text-only inputs. (B) Modality-separated representations. PCA of Qwen and SciReasoner embeddings for paired protein sequence and structure inputs. SciReasoner more clearly separates the two modalities, indicating stronger structure-aware encoding. (C) Structure-grounded materials reasoning. Chain-of-thought comparison for QMOF pore-limiting-diameter prediction. Without structure, the model relies on compositional priors and overestimates pore size; with structural tokens, it uses symmetry and bonding connectivity to recover a value closer to the ground truth. (D) Structure-grounded GO reasoning. Chain-of-thought comparison for biological-process GO prediction. Sequence-only reasoning predicts DNA-related processes, whereas structure-aware reasoning integrates secondary-structure and binding-site evidence to recover protein-modification annotations. (E) Materials prediction with structure. Absolute-error distributions for bandgap, largest-cavity-diameter and pore-limiting-diameter prediction. Structural input reduces errors across all three properties. (F) Structure-guided GO attention. Residue-level attention maps for GO molecular-function prediction. Structure-aware reasoning focuses on the functional binding site, whereas sequence-only reasoning attends to non-binding regions, consistent with its lower accuracy. 13
A
Intra-Domain Structural Evidence Grounding
Cross-Domain Reasoning Consolidation SciReasoner Base
Qwen
Protein-Structure Expert SFT
Self-Bootstrapping
RL
<think>...</think>
- secondary structure - residue interaction
Structure
Text
- fold topology -…
- active-site geometry -…
Molecule-Structure Expert
SciReasoner Base
B
SFT
Model
Data
Training
Rollout
Selected Reasoning
Rejected Reasoning
All Tasks Dynamics
Q.
RL
- scaffold topology
- bond-disconnection
- ring system -…
- stereochemical cue -…
Q.
Q. Q.
- defect site
- unit cell -…
- coordination motif -…
…
SFT
RL
SciReasoner ColdStart
SciReasoner
Q.
Material-Structure Expert SFT RL - crystal lattice
Select
Q.
{
Reasoning Trace
{
Question Answer Struct. Def.
Domain-Structure Expert
Structure Tasks Dynamics
Other Task Dynamics
C
D
GO Term Prediction
QMOF Prediction
3D Molecule Structure (DUD-E)
Retrosynthesis USPTO-50K
E
Fig. 6: Self-bootstrapped native structural reasoning unifies scientific reasoning. (A) Intra-domain structural evidence grounding and cross-domain reasoning consolidation. Sketch reasoning traces coldstart task-specific experts, which are optimized independently by reinforcement learning (RL) to ground structural evidence within each domain. Expert-generated traces are then pooled to coldstart and reinforce a unified SciReasoner across all tasks to consolidate cross-domain reasoning patterns. (B) Reward dynamics. RL rewards rise during training, with the unified SciReasoner matching or exceeding expert variants on structure-intensive and other scientific tasks. (C) Improved accuracy and sampling efficiency. Pass@1 and pass@10 are compared across four training stages for GO term prediction, QMOF prediction, 3D molecule structure (DUD-E) and Retrosynthesis USPTO-50K. Lighter hatched bars indicate pass@1 and solid bars pass@10; ∆ = pass@10 − pass@1. The post-training procedure consistently increases pass@1 and reduces ∆, indicating more reliable first-sample predictions. (D) Improved reasoning quality across tasks. Kernel density estimates show LLM-judged reasoning scores for four model variants on GO term prediction, QMOF prediction, 3D molecular similarity (DUD-E), and Retrosynthesis USPTO-50K. Triangles denote means and red brackets indicate the worst-to-best mean difference. Self-bootstrapped native structural reasoning shifts score distributions towards higher quality, and unified SciReasoner generally outperforms domain-structure experts. (E) Double-blinded human-expert evaluation. Domain experts compared SciReasoner and DeepSeek-V4-Pro on GO annotation, materials-property prediction and retrosynthesis. Left, pairwise preferences overall and by task; right, score distributions for individual scoring-axis. SciReasoner was rated tie-or-better in 98% of comparisons and scored higher on every axis. 14
and rated every trace against a five-axis, 1–10 rubric (Q1 evidence grounding, Q2 domain plausibility, Q3 targetregime alignment, Q4 reasoning coherence, Q5 anti-hallucination) together with a five-point pairwise preference (Q8, strongly prefer SciReasoner → strongly prefer DeepSeek-V4-Pro). The two panels of Fig. 6E summarize the resulting N = 177 6 reliable case-judgments: the head-to-head preference distribution and the per-axis score distributions. In the head-to-head comparison, experts rated SciReasoner tie-or-exceed than DeepSeek-V4-Pro in 98% of casejudgements, with 73% strongly preferring SciReasoner, 21% preferring it, and 4% ties. Only a small residual fraction favoured DeepSeek-V4-Pro (Fig. 6E, pairwise preference). The preference is consistent across all three tasks — 100% tie-or-exceed on GO protein function, 95% on crystalline-material property prediction, and 98% on retrosynthesis. It demonstrates that SciReasoner’s advantage is not carried by any single domain but holds across heterogeneous scientific-reasoning settings. The per-axis scores show that this preference reflects a broad, consistent quality gap rather than a single dominant dimension. SciReasoner averages 8.7/10 overall versus 4.3/10 for DeepSeek-V4-Pro, with per-axis means of 8.8 vs 4.5 on evidence grounding, 8.5 vs 4.4 on domain plausibility, 8.9 vs 4.3 on target-regime alignment, 8.7 vs 3.9 on reasoning coherence, and 8.8 vs 4.6 on anti-hallucination. Every per-axis difference is significant shown by Wilcoxon signed-rank on paired per-case differences, P < 0.001 in Fig. 6E, per-axis scores. SciReasoner’s distributions are concentrated near the top of the scale on all five axes, whereas DeepSeek-V4-Pro receives more variable scores, especially on target-regime alignment and reasoning coherence. This indicates that the most reliable separation is not that DeepSeek-V4-Pro uniformly fails, but that SciReasoner is more consistently grounded, task-aligned, and coherent across cases. Together, these results show that SciReasoner’s advantage on automated metrics also holds under direct expert scrutiny: across three heterogeneous tasks, human experts prefer or tie SciReasoner reasoning in the overwhelming majority of cases, and rate it markedly higher on every quality axis, reflecting faithful, verifiable scientific reasoning.
3 Discussion In this work, we introduced SciReasoner, a multimodal scientific foundation model for native structural reasoning across proteins, small molecules and inorganic crystals. The central premise is that structure–property relationships cannot be fully addressed by treating scientific entities as text strings, low-dimensional descriptors or black-box inputs to property predictors. SciReasoner instead represents structures as primary objects of inference through a unified structure-aware vocabulary that discretizes three-dimensional coordinates, molecular topologies and crystallographic lattices into domain-native tokens, and integrates them with language instructions in a single autoregressive model. This design allows residues, molecular fragments, conformational cues and crystal descriptors to function as addressable evidence units within generated reasoning trajectories, rather than as peripheral annotations appended to text. Our results support native structural reasoning as a model-level capability for scientific AI. Rather than using structure only as an input format or auxiliary descriptor, SciReasoner makes residues, molecular fragments, conformational cues and crystal descriptors available as evidence within generated reasoning trajectories. This shift is important because structure–property analysis requires not only accurate outputs, but intermediate claims that can be inspected against the physical object being studied. The strongest evidence for this capability comes from regimes in which superficial similarity is insufficient. For Cellular Component annotation of low-homology and orphan-like proteins, SciReasoner improved Fmax from 0.42 to 0.55, with its attention enriched at contact-defined DNA-binding residues and protein–DNA interfaces. In retrosynthesis, it increased single-step accuracy from 0.63 to 0.72 while identifying reaction-relevant fragments, strategic bond disconnections and chemically valid precursors. In crystalline materials, its reasoning trajectories invoked symmetry-distinct sites, coordination environments and periodic bonding motifs when linking structure to electronic and thermodynamic behaviour. These behaviours indicate that structural organization functions as the working substrate of inference, not merely as a representation used to produce a final score. This distinction clarifies the contribution of SciReasoner relative to existing scientific AI systems. A Foldseekderived structural fragment can ground a fold- or function-level hypothesis; a molecular substructure can justify a retrosynthetic disconnection; a conformational cue can support a pharmacophore-level similarity judgement; and a crystal-connectivity token can support an inference about stability or electronic response. Because such intermediate claims are expressed in the reasoning trajectory, they can be checked against the input structure rather than accepted as opaque post hoc rationales. This helps bridge two previously separated capabilities: domain-native structural representation and explicit scientific reasoning. The double-blind expert evaluation, in which experts preferred or tied SciReasoner over a frontier large language model in 98% of cases, further suggests that this inspectability is practically useful for scientific assessment. Overall, SciReasoner demonstrates that a single autoregressive foundation model can unify sequence, structure, and natural-language reasoning across major scientific modalities while achieving specialist-level accuracy and interpretable scientific explanation. This provides a route toward scientific AI systems that move beyond prediction toward reasoning over the physical structures from which functions, properties, and mechanisms emerge. 6
We are collecting more human judgments.
15
4 Method 4.1 Data Source and Processing 4.1.1 Protein Data We constructed the protein component of the pretraining corpus by following established protein-language data construction protocols. To incorporate textual and functional protein knowledge, we used SIFTS-based PDB–UniProt mappings as indexing anchors [35, 68, 69], protein sequences were associated with protein names, PubMed/PMC literature [70, 71] and curated UniProtKB/Swiss-Prot annotations, including functional descriptions, domain and subunit information, post-translational modifications, disease associations, induction information and tissue specificity when available. For large-scale UniProt protein sequences, we retrieved the corresponding AlphaFold-predicted structures from AlphaFoldDB whenever available [72]. Following the SaProt pretraining setting [28, 73], each protein structure was converted into residue-level Foldseek 3Di tokens [40], which describe local structural environments and are aligned one-to-one with the amino-acid sequence. The amino-acid tokens and 3Di tokens were then separated into amino acid (AA) sequences (wrapped by <protein></protein> tag) and structural sequences (warped by <protein_structure></protein_structure> tag) in one input, allowing the model to learn from both primary sequence and predicted three-dimensional structure. Structurally unreliable regions (pLDDT<70) were masked or replaced by a special structural token to reduce noise from uncertain coordinates. To prevent the leakage of labels in the benchmark data within the interleaved protein–text data, we excluded from continued pretraining all text-linked protein records with >30% MMseq2 [74, 75] sequence identity to any protein in the held-out test sets of the downstream benchmarks.
4.1.2 Small-molecule Data We constructed the small-molecule component by integrating chemical text, molecular representations, structured property datasets and three-dimensional molecular conformations. The textual component was collected with US Chemistry Olympiad problems, Europe PMC full-text articles and abstracts, ChemRxiv, bioRxiv, medRxiv and arXiv submissions filtered for chemistry, medicinal chemistry and physical chemistry. These sources provide foundational chemical concepts, textbook-style explanations, research-level chemical knowledge, experimental context, safety descriptions and domain-specific terminology. We further converted public molecular property datasets into language-interfaced templates, pairing molecular entities with curated descriptions of properties, assays, labels and task contexts. These sources include MoleculeNet [76], Therapeutics Data Commons and ADMET-style datasets [77], ChEBI, PubChem BioAssay, Tox21, hERG and CYP bioactivity datasets, CHEMDNER and other biomedical named-entity recognition corpora, and curated datasets covering ADMET, physicochemical properties, molecular toxicity and safety-related endpoints. Together, these resources use natural language to align standardized molecular representations with property labels, bioactivity assays, toxicity endpoints, pharmacokinetic profiles and biomedical chemical terminology. We also incorporated reaction, biochemical and spectral resources, including Open Reaction Database (ORD), USPTOderived reactions, Buchwald–Hartwig datasets, Rhea/UniProt reaction annotations, MOSES [78], MoNA and spectrum-reasoning datasets, to support learning of reactant–product mappings, reaction procedures, enzymatic transformations, molecular understanding and spectroscopy-based reasoning. To incorporate explicit three-dimensional molecular information, we additionally constructed a conformation-aware molecular corpus following the representation learning dataset of ConfSeq [58]. Molecules collected from ChEMBL and BindingDB were converted into three-dimensional conformers using RDKit-based conformer generation. The resulting conformations were represented in a sequence-compatible format that combines molecular connectivity with internal-coordinate information and is wrapped by <molecule_structure></molecule_structure> tag, linking with natural language to allow the model to learn geometric features such as molecular shape, bond geometry and conformational variation within a language-modeling framework. To avoid label leakage, we canonicalized molecular identifiers and excluded pretraining examples whose molecule–label or reaction product entries overlapped with the held-out test sets of the corresponding downstream benchmarks.
4.1.3 Materials Data We constructed the materials component by collecting crystal compositions, crystal information files, structurederived textual descriptions and tabular materials properties from public materials databases. The primary sources include Materials Project, JARVIS-DFT, SNUMAT, hMOF, QMOF, OQMD7 , OMDB8 , JARVISQETB9 , GNoME10 , and Cantor HEA11 These sources cover a broad range of inorganic crystals, semiconductors, metal–organic frameworks, organic materials, high-entropy alloys and computationally discovered stable materials. 7
https://www.oqmd.org/ https://omdb.mathub.io/ 9 https://jarvis.nist.gov/jarvisqetb 10 https://github.com/google-deepmind/materials discovery/blob/main/DATASET.md 11 https://doi.org/10.5281/zenodo.10854500 8
16
For each material, we retained complementary representations such as chemical formula, elemental composition, periodic crystal structure in CIF format and natural-language structural descriptions generated from crystallographic information. We then used natural language templates to link these representations to form the training samples, enabling the model to learn composition-level, geometry-level and text-level representations of periodic systems. For data processing, we used an 80/10/10 random split at the material-sample level, where each sample contains one material together with all associated property labels. To prevent leakage, all validation and test material samples, including their structural representations and property records, were removed from the continued-pretraining corpus before training.
4.1.4 DNA/RNA Data We constructed the RNA component from RNAcentral, retaining sequences in FASTA format and wrapping them with <rna></rna> tags. Available metadata, such as RNA family information, was incorporated to provide functional and contextual cues. For DNA, genomic sequences were retrieved from NCBI, sampled into 1,000-bp organism-level fragments, represented in FASTA format and wrapped with <dna></dna> tags. Organism names and genomic coordinates were retained to anchor each sequence within its genomic context.
4.1.5 General Text and Instruction Following Data To complement the scientific corpora with general-domain text and instruction-following supervision, we draw from three publicly released sources. For general web text, we sample from Nemotron-CC v2 [79], a multi-trillion-token, quality-filtered Common Crawl derivative. For reasoning-formatted instruction data, we use the mathematics and instruction-following splits of Dolci-Think-SFT-32B [80], in which every response carries an explicit <think>delimited deliberation trace covering multi-step symbolic reasoning and constraint-driven instruction following. For scientific instruction adherence, we additionally include the training split of SciIF [81], whose prompts impose verifiable constraints over scientific contexts.
4.2 Model Architecture The overall architecture of SciReasoner is designed to operate as a unified causal language model capable of processing interleaved structural and textual modalities. The system consists of three primary components: modality-specific offline structural compressors, a structure-aware vocabulary embedding layer (acting as a discrete cross-modal projection), and a unified large language model (LLM) backbone, denoted as fϕ . The LLM backbone is initialized with the weights of Qwen3-14B [82].
4.2.1 Offline Structure Encoder A critical limitation of applying generalist LLMs directly to scientific data is the reliance on text-based sub-word tokenizers, such as Byte-Pair Encoding [83, 84], which arbitrarily fragment physical topologies. To prevent this, we employ a modality-specific offline compression strategy. Let S ∈ {Sprot , Schem , Scryst } represent the raw structure input data for proteins, small molecules, and crystals, respectively. As shown in Fig. 1B, we utilize domain-specific discrete encoders to encode S into the structural information sequence Xv . Crucially, this offline process guarantees that fundamental physical semantics (such as local chemical motifs, three-dimensional geometry, and lattice symmetries) are preserved as distinct, holistic tokens prior to interacting with the language model. Specifically, we adopt: (i) Foldseek [40] for encoding the 3D structure of protein, (ii) SLICES [85] for crystal, and (iii) ConfSeq [58] for 3D molecular structures. The encoded structural information sequences are tagged with corresponding structure tag, i.e., <material structure></material structure>, <molecule structure></molecule structure>, and <protein structure></protein structure>.
4.2.2 Structure-Aware Vocabulary Embedding Unlike traditional multimodal frameworks that rely on heavy continuous encoders (e.g., Graph Neural Networks) during the forward pass, SciReasoner treats the discrete structural sequence Xv identically to linguistic scientific tokens. We introduce a dedicated structure-aware vocabulary, which functions as a discrete cross-modal projection layer. Let Wv ∈ R|Vv |×dLLM be the learnable embedding matrix for the structural vocabulary, where |Vv | is the vocabulary size of all structural motifs and features, and dLLM is the hidden dimension of the LLM. The structural sequence Xv is directly projected into the dense continuous space via a discrete embedding lookup:
Hv = Embedding(Xv , Wv ) ∈ RLv ×dLLM
(1)
This discrete projection elegantly bypasses the computational bottleneck of continuous spatial encoders, seamlessly aligning structural inputs with the LLM’s native semantic space.
17
4.2.3 Unified Autoregressive Generation Simultaneously, the language instruction Xq is tokenized and embedded by the LLM’s native embedding layer to produce the language representation Hq ∈ RLq ×dLLM . The projected structural embeddings and language embeddings are concatenated along the sequence dimension to form the unified input prompt Hprompt = [Hv ; Hq ]. The LLM backbone fϕ takes Hprompt as input and generates the response sequence Xa in an autoregressive manner, ensuring the generation is strictly conditioned on both the structural evidence and the textual instruction.
4.3 Pretraining 4.3.1 Optimization Objective and Multi-Stage Pretraining The entire multi-stage pretraining pipeline is optimized using a single, unified autoregressive causal language modeling objective (Next Token Prediction). Given a structural input Hv and a language instruction Hq , the model generates a target response sequence Xa = {xa,1 , xa,2 , ..., xa,T }. The training objective minimizes the negative log-likelihood of the target tokens conditioned on the preceding context: T X LN T P = − log Pϕ (xa,t | xa,<t , Hv , Hq ) (2) t=1
where ϕ represents the trainable parameters of the system at any given stage. To effectively align the distinct physical structural space with the natural language space without catastrophic forgetting, we implement a three-stage curriculum learning strategy, distinguished exclusively by parameter freezing configurations, data mixture, and learning rate dynamics. Let Θ = {θvocab , θemb , θhead , θbackbone } denote the complete parameter set, corresponding to the structure-aware vocabulary layer (Wv ), LLM textual token embeddings, LLM prediction head, and the core LLM transformer backbone, respectively.
Stage 1: Warm-up Training The initial stage focuses on mapping the newly introduced structural tokens into the linguistic semantic space. To prevent the untrained structure-aware vocabulary layer from corrupting the pre-trained reasoning capabilities of the LLM, we strictly freeze the core transformer backbone. In this stage, the trainable parameter subset is ϕ = {θvocab , θemb , θhead }, while θbackbone remains frozen. The model is trained on fundamental structure-to-text reconstruction tasks. By restricting gradient updates to the peripheral layers, this stage establishes a stable foundation in the embedding space before deeper integration. To ensure localized and stable optimization for these newly initialized parameters, Stage 1 maintains an independent optimizer state and employs its own standalone learning rate schedule. Stage 2: Full-parameter Training Once the structural tokens are stably anchored in the embedding space, we proceed to align the modalities across the deep layers of the network. In this stage, all parameters are unfrozen (ϕ = Θ). For the continuous optimization dynamics spanning Stage 2 and Stage 3, we initialize a new shared optimizer state and a unified Warmup-Stable-Decay (WSD) learning rate scheduler. Formally, let t denote the training step across the combined duration of Stage 2 and Stage 3. The shared WSD scheduler is defined by the durations of the warmup (Tw ), stable (Ts ), and decay (Td ) phases, with total steps Ttotal = Tw + Ts + Td . The learning rate η (t) is formulated as: t ηmax · Tw η (t) = ηmax fdecay (t)
if 0 ≤ t < Tw if Tw ≤ t < Tw + Ts if Tw + Ts ≤ t ≤ Ttotal
(3)
where ηmax is the peak learning rate and fdecay (t) represents a monotonically decreasing annealing function (e.g., cosine decay). Stage 2 spans the interval 0 ≤ t < Tstage2 , where Tw < Tstage2 < Tw + Ts . This indicates that Stage 2 strictly encompasses the entire warmup phase and the initial segment of the stable phase. During this period, the model is trained on diverse, broadly-sourced paired structure-text datasets, allowing the full network to assimilate domainspecific structural knowledge at a high, constant learning rate.
Stage 3: Annealing Training In the final stage, we maintain the full-parameter optimization setting (ϕ = Θ) and seamlessly inherit both the optimizer state and the active WSD scheduler from Stage 2. Stage 3 covers the remainder of the training timeline (Tstage2 ≤ t ≤ Ttotal ). Thus, it begins by continuing the constant learning rate ηmax from the stable phase and eventually triggers the decay phase (t ≥ Tw + Ts ) in its later period. In this training stage, we increase the proportion of question–answer (QA)-style data to achieve annealed training. 18
4.4 Post-training The pretraining curriculum endows SciReasoner with broad cross-modal scientific knowledge, yet the resulting checkpoint M0 behaves as a next-token continuator rather than an instruction-following reasoner. Post-training instantiates self-bootstrapped native structural reasoning through a coldstart supervised stage followed by reinforcement learning (RL). Pooling the chain-of-thought (CoT) supervision of all tasks into a single pass is, however, ill-suited here: the reasoning patterns of heterogeneous scientific tasks are divergent enough that joint training induces destructive interference, and the seed CoT traces, borrowed from external teachers, are distributionally misaligned with SciReasoner. We therefore organize post-training around two stages: intra-domain structural evidence grounding followed by cross-domain reasoning consolidation. In the first stage, we partition the task universe by task prior and specialize M0 into a family of per-group experts that learn how structural tokens serve as domain-specific reasoning evidence. In the second stage, these experts regenerate rational CoT traces that replace the external supervision; pooled across all tasks and augmented with non-thinking data, they drive a single unified coldstart and RL pass yielding the final model.
4.4.1 Supervised finetuning for reasoning pattern coldstart The coldstart phase seeks to activate the capabilities accumulated during pretraining: we elicit instruction following and, most critically, an explicit CoT reasoning behaviour in which the model deliberates before committing to an answer. Because SciReasoner is initialized from Qwen3 [82], which natively supports a switchable thinking interface, we frame this stage as the re-establishment of a structured generation protocol that the backbone has already been exposed to, requiring only a lightweight intervention rather than a wholesale re-training.
Reasoning-formatted data construction We curate a compact supervised corpus in which every target response adheres to an explicit deliberation template demarcated by dedicated <think> delimiters. We construct two complementary response modes to preserve the dual-mode behavior of the backbone. In the thinking mode, the model is prompted with an instruction and produces an interleaved trace of the form Xa = <think> \n c \n </think> \n\n y,
(4)
where c denotes the latent chain-of-thought rationale and y the final answer conditioned on c. In the non-thinking mode, the instruction is appended with a /no think control token and the deliberation span is collapsed to an empty placeholder, Xa = <think> \n\n </think> \n\n y, (5) yielding a direct-answer response. Exposing the model to both formats within a single corpus re-anchors the semantics of the <think> delimiters and the /no think switch, enabling the controllable allocation of test-time computation between explicit reasoning and direct response.
Supervised optimization objective The coldstart stage retains the autoregressive next-token-prediction objective used throughout pretraining, but departs from it in the supervision mask. Rather than computing the loss over the entire sequence, we adopt a supervised-finetuning (SFT) formulation in which gradients are propagated solely through the response tokens, while the instruction and structural context serve purely as conditioning. Concretely, let the full sequence be partitioned into the prompt context (Hv , Hq ) and the target response Xa = {xa,1 , . . . , xa,T }, where Xa encompasses both the deliberation span and the final answer. The coldstart objective minimizes the negative log-likelihood restricted to the response positions: LSF T = −
T X
mt log Pϕ xa,t | xa,<t , Hv , Hq ,
(6)
t=1
where the binary mask mt ∈ {0, 1} activates supervision only on the response segment (mt = 1 for tokens in Xa ) and suppresses the loss contribution of the prompt tokens (mt = 0). This response-only masking ensures that the optimization sharpens the conditional mapping from instruction to reasoned answer, instead of expending capacity on modelling the marginal distribution of the inputs.
Coldstart In the first stage, a coarse task prior partitions the task universe T into J disjoint groups {G1 , . . . , GJ }, each aggregating similar tasks with CoT corpus Cj whose rationale c is teacher-supplied. We coldstart M0 independently on each Cj under LSF T , yielding specialized checkpoints {Mjcs }Jj=1 so that each internalizes a coherent reasoning style rather than reconciling conflicting ones. In the second stage, after the experts {Mjexpert } are obtained by the 19
intra-domain structural evidence grounding stage below, we replace the external supervision with SciReasonergenerated traces: each Mjexpert rolls out on its group’s prompts, and verification-passing traces c̃ replace the external c in Cj , giving a new corpus C˜j . Augmenting each C˜j with /no think direct-answer data and pooling across groups, SJ C˜ = j=1 C˜j , we perform a single unified coldstart from M0 under the same LSF T . As the targets now lie on the model’s own manifold, this furnishes a well-matched initialization for the cross-domain reasoning consolidation pass.
4.4.2 Reinforcement learning For each sub-task, we curate RL data with an empirical solve-rate filter that selects medium-difficulty instances. Let Dktrain denote the training set for the k -th sub-task. For each example x ∈ Dktrain : 1. Stochastic rollouts. We generate N = 8 independent rollouts from M0 on x with stochastic decoding and set do sample=True. To balance response diversity and format fidelity, we use an adaptive temperature T , tuned once for each sub-task before collection. Starting from T = 0.9, we increase T when the eight samples show insufficient diversity, such as low uniqueness among normalized responses or highly repetitive content. If the outputs become too diffuse and frequently violate the required format or fail to parse, we decrease T . For the final eight rollouts for each x, we keep T fixed and vary only the random seed, while holding all other decoding parameters constant. 2. Empirical solve rate. For rollout i, we compute a correctness indicator fi (x) ∈ {0, 1} using the sub-task’s canonical metric, such as exact match or a thresholded score, and aggregate 8
1X p̂(x) = fi (x). 8 i=1
(7)
3. Mid-difficulty filtering. We retain examples with partial success:
Sk =
x ∈ Dktrain 0.125 < p̂(x) < 0.875 .
(8)
The retained examples are neither trivially solved nor consistently failed, and thus provide more informative RL learning signals than cases with p̂(x) ≈ 1 or p̂(x) ≈ 0. 4. Difficulty-centred sampling. We construct the RL subset Tk by ranking candidate examples according to their distance from intermediate success,
d(x) = |p̂(x) − 0.5| .
(9)
We then select K = 2000 examples without replacement, first from Sk in ascending order of d(x):
Tk =
arg topK, x∈S −d(x) , k Sk ∪ arg top
|Sk | ≥ K,
train \S K−|Sk |, x∈Dk k
−d(x) , |Sk | < K.
(10)
Here, arg topm, x∈A f (x) denotes the m examples in a candidate set A with the largest values of f (x). Since f (x) = −d(x), this operator selects examples with the smallest distance to p̂(x) = 0.5. Thus, the procedure starts from examples closest to intermediate success and gradually expands to examples with success rates farther from 0.5 until K = 2000 examples are collected. The resulting 2,000-example set serves as the RL training pool for that sub-task. Focusing RL on neither-trivial-nor-impossible instances yields stronger and more stable improvement: items with p̂ ∈ (0.125, 0.875) (i) expose the policy to cases where exploration can flip outcomes, (ii) avoid vanishing advantages on saturated positives, and (iii) reduce uninformative gradients from uniformly failed cases. Model training is performed with DAPO [86], which optimizes the policy with RL across heterogeneous scientific tasks. Given a prompt, we first sample G candidates from the old policy πθold . The corresponding within-group standardized advantages are computed as
ri,t (θ) =
πθ (oi,t | q, oi,<t ) , πθold (oi,t | q, oi,<t )
Âi,t =
20
Ri − mean({Ri }G i=1 ) . std({Ri }G ) i=1
(11)
We then optimize the following PPO-style clipped objective:
JDAPO (θ) = E(q,a)∼D,{oi }G i=1 ∼πθold (·|q) # " |oi | G X X 1 min ri,t (θ)Âi,t , clip ri,t (θ), 1 − εlow , 1 + εhigh Âi,t PG i=1 |oi | i=1 t=1 s.t.
(12)
0 < {oi | is equivalent(a, oi )} < G,
The asymmetric Clip-Higher schedule is used to preserve exploration. We also apply Dynamic Sampling to remove degenerate groups whose rewards are identical, and use a token-level policy-gradient reduction. The original DAPO reward is rule-based and binary, whereas many of our tasks, including free-form semantic judgment, information extraction, and numeric regression, cannot be evaluated by a single exact-match criterion. We therefore substitute the binary reward with a reward softening scheme, which converts grouped task metrics to a shared [0, 1] scale: Risoft = g mi (q, oi , A(q )) (13) Here, g (·) is a monotone calibration function that keeps reward magnitudes comparable across tasks, and mi denotes the group-specific quality metric. Under this grouping scheme, scientific prediction tasks use distancebased rewards, retrieval and extraction tasks use matching-based rewards, and tool-verified rewards are computed with professional scientific software.
Intra-domain structural evidence grounding and cross-domain reasoning consolidation The procedure above is first run independently per group as intra-domain structural evidence grounding: starting from Mjcs , the solve-rate filtering and DAPO objective of Eqs. (11)–(13) are applied on the data of Gj alone, producing the experts {Mjexpert }Jj=1 that supply the on-policy traces for the unified coldstart. It is then run once more over the merged all-task pool as cross-domain reasoning consolidation, starting from the unified coldstart checkpoint. Because the policy is now initialized on expert-generated on-policy supervision from every group, this final pass consolidates the experts’ specialized competences without the interference of a naive joint optimization, yielding the final unified model Mfinal .
21
Appendix A
Detailed experimental results
We report task-level evaluation results for all benchmark tasks with available model measurements. SciReasoner is compared with four frontier general-purpose models: Opus-4.7, GPT-5.5, Kimi-K2.6 and DeepSeek-V4-Pro. The result tables are organized by discipline: Chemistry, Material Science, and Biology. Within each table, rows are further grouped by task type: Scientific QA, Property Prediction, Property Classification, or Generation and Design. Best and second-best results are highlighted in bold and underlined, respectively. Metrics marked with ↑ are better when larger, whereas metrics marked with ↓ are better when smaller.
A.1
Task and metric descriptions
The descriptions below follow the task organization used in the result tables and clarify both the expected model behavior and the metric used for evaluation.
Chemistry tasks. Scientific QA. • Chemical entity recognition (F1): identifies chemical mentions in scientific or biomedical text and evaluates span/entity recovery with a precision–recall balanced score. • Chemical protein interaction extraction (F1): extracts chemical–protein relation statements from text, requiring the model to identify the paired entities and the asserted interaction. • Chemical disease interaction extraction (F1): extracts chemical–disease relation statements from scientific text. • Multiple choice question (ACC): selects the correct answer option for scientific multiple-choice questions, testing factual knowledge and reasoning. • True or false question (ACC): judges whether a scientific statement is correct, incorrect, or unsupported under the task format. • Open question (BertScore): generates free-form answers for scientific questions and compares semantic similarity with reference answers. • Name conversion-s2i (Split Match): converts a SMILES string into an IUPAC-style molecular name and checks component-level string agreement. • Name conversion-s2f (Element Match): converts a SMILES string into a molecular formula and checks whether element composition is preserved. • Name conversion-i2s (Exact Match): converts an IUPAC-style name into a SMILES string and requires exact agreement with the reference. • Name conversion-i2f (Element Match): converts an IUPAC-style name into a molecular formula and evaluates element-level formula correctness. • Molecular description generation (ROUGE-L): generates a molecule description and compares it with the reference text. • Molecule captioning (MENTOR): produces molecule-level captions that capture chemical semantics and is evaluated with a molecule-captioning metric. Property Prediction. • Estimated solubility (ESOL) prediction (RMSE): predicts aqueous solubility from molecular representation; lower root mean squared error indicates better numeric prediction. • 3D molecule structure (DUD-E) (5.0% EF): ranks compounds in a DUD-E-style virtual-screening setting and evaluates early enrichment among the top 5.0% candidates. • Lipophilicity (LIPO) prediction (RMSE): predicts lipophilicity-related continuous values from molecular structure. • Physicochemical prediction (MAE): predicts continuous physicochemical endpoints from molecular structure and reports average absolute error. Property Classification. • Blood-brain barrier permeability (BBBP) prediction (ACC): classifies whether a molecule can pass the blood–brain barrier. • Clinical toxicity (ClinTox) prediction (ACC): classifies molecular clinical toxicity labels. • HIV Prediction (ACC): classifies whether a molecule is active against HIV replication. • Side Effect Resource (SIDER) Prediction (ACC): classifies side-effect associations for a molecule. Generation and Design.
22
• Forward synthesis (Exact Match): generates the expected product or outcome for a synthesis prompt and checks exact string agreement. • Forward reaction prediction (Exact Match): predicts products from specified reactants and reagents. • Reagent prediction (Exact Match): predicts the reagent, catalyst, solvent, or auxiliary component needed for a reaction. • Retrosynthesis mol (Exact Match): proposes precursor reactants for a target molecule in a MolInstructions-style retrosynthesis setting. • Retrosynthesis USPTO-50K (Exact Match): proposes reactants for target products in the USPTO-50K retrosynthesis setting. • Retrosynthesis smol (Exact Match): generates plausible precursor molecules for a target product in the SMol-style retrosynthesis setting. • Molecule generation (Exact Match): generates a molecular string that satisfies a given property or constraint prompt. • Description guided molecule design (Exact Match): designs a molecule from a natural-language requirement and checks exact agreement with the target answer. Material science tasks. Property Prediction. For database-level benchmarks that aggregate multiple heterogeneous properties, we follow domain LLM-Prop [67] and report the normalized score MAD MAE , where larger values indicate lower error relative to target dispersion. • MP regression ( MAD MAE ): predicts continuous Materials Project properties, such as band gap, density, volume, formation energy, and stability-related quantities. • SNUMAT regression ( MAD MAE ): predicts SNUMAT material properties, including band-gap and spin-orbitrelated targets. • JARVIS-DFT ( MAD MAE ): predicts DFT-derived material properties covering structural, electronic, elastic, dielectric, and thermodynamic quantities. • JARVIS-QETB ( MAD MAE ): predicts quantum-electronic tight-binding properties such as energy and bandgap-related values. • GNoME ( MAD MAE ): predicts large-scale inorganic material properties, including energy, density, volume, and band-gap-related targets. • hMOF ( MAD MAE ): predicts porous-material properties such as CO2 adsorption, pore diameter, void fraction, and surface area. • Cantor HEA ( MAD MAE ): predicts high-entropy alloy properties, including formation energy, energy above hull, volume per atom, and energy per atom. • QMOF ( MAD MAE ): predicts quantum metal–organic framework properties such as total energy, band gap, cavity diameter, and pore-limiting diameter. • OQMD ( MAD MAE ): predicts Open Quantum Materials Database properties such as band gap and formation energy. • OMDB ( MAD MAE ): predicts organic-material database properties, mainly band-gap-related targets. Property Classification. • MP classification (AUC): classifies discrete Materials Project attributes such as direct-gap status or thermodynamic stability. • SNUMAT classification (AUC): classifies SNUMAT material attributes such as direct or indirect band-gap status. Generation and Design. • Composition material (SMACT): generates material compositions under elemental constraints and checks chemical validity. • Bulk modulus material (SMACT): generates material compositions conditioned on a target bulk modulus and evaluates chemical plausibility. Biology tasks. Scientific QA. • Function (ROUGE-L): generates protein-function text from biological context and compares it with the reference description. • General function (ROUGE-L): produces broader functional descriptions or annotations for biological sequences.
23
Property Prediction. • Fluorescence (Spearman): predicts protein mutant fluorescence and evaluates whether predicted rankings match reference rankings. • Stability (Spearman): predicts protein stability values and evaluates rank correlation with reference stability. • Enhancer activity (HK-PCC): predicts DNA enhancer activity and reports Pearson correlation for the housekeeping channel. • Isoform (R2): predicts alternative polyadenylation isoform usage from RNA sequence. • Mean ribosome loading (R2): predicts ribosome loading efficiency from RNA sequence. • Programmable RNA switches (R2): predicts ON, OFF, and ON/OFF behavior of programmable RNA switches. • CRISPR on target (Spearman): predicts on-target knockout efficacy for CRISPR guide RNAs. • siRNA efficiency (Mixed-score): predicts siRNA gene-silencing efficiency using both continuous accuracy and range-level agreement. • Structural similarity (MAE): predicts a numeric structural-similarity target and evaluates average absolute deviation. • TM-score (Spearman): predicts or ranks structure-similarity scores and evaluates ordering consistency. Property Classification. • Solubility (ACC): classifies whether a protein sequence is soluble. • gSymbol2Tissue (F1): maps a gene symbol to tissue-expression labels. • gName2Cancer (F1): maps a gene name to associated cancer types. • gSymbol2Cancer (F1): maps a gene symbol to associated cancer types. • Antibody antigen (MCC): predicts whether an antibody and antigen sequence pair interact. • RNA protein interaction (MCC): predicts whether an RNA sequence and a protein sequence interact. • Epigenetic marks prediction (MCC): predicts epigenetic mark presence from DNA sequence. • TF-m (MCC): predicts mouse transcription-factor binding from DNA sequence. • Enhancer-promoter interaction (MCC): classifies whether enhancer and promoter regions interact. • PD-prom 300 all (MCC): detects promoter regions in a 300-bp setting over all examples. • PD-prom 300 notata (MCC): detects 300-bp promoters without TATA motifs. • PD-prom 300 tata (MCC): detects 300-bp promoters with TATA motifs. • CPD-prom core all (MCC): detects core promoter regions over all examples. • CPD-prom core notata (MCC): detects core promoters without TATA motifs. • CPD-prom core tata (MCC): detects core promoters with TATA motifs. • TF-h (MCC): predicts human transcription-factor binding from DNA sequence. • Yeast PPI (ACC): predicts yeast protein–protein interactions. • Human PPI (ACC): predicts human protein–protein interactions. • Protein function (ROUGE-L): predicts protein function annotations or descriptions from sequence. • Domain motif (ROUGE-L): predicts domain or motif descriptions for protein sequences. • Non-coding RNA family (ACC): classifies non-coding RNA sequences into functional families. • Modification (ACC): predicts RNA modification labels. • Fold type (ACC): classifies protein structural fold type. • Subcellular localization (ACC): predicts the cellular localization label of a protein. • EC number (Fmax): predicts enzyme commission annotations for protein sequences. • Keywords (F1): predicts UniProt-style functional keywords. • Metal ion binding (ACC): predicts whether a protein binds metal ions. • GO-BP (Fmax): predicts Gene Ontology biological-process terms. • GO-CC (Fmax): predicts Gene Ontology cellular-component terms. • GO-MF (Fmax): predicts Gene Ontology molecular-function terms. Generation and Design. • Function-guided protein design (Normalized SW): generates a protein sequence from a functional prompt and evaluates sequence similarity to reference proteins. • Catalytic activity (ROUGE-L): describes the enzyme-catalyzed reaction implied by a protein sequence and compares it with the reference text. Metric definitions. • ACC (↑): fraction of samples whose predicted label exactly matches the reference label.
24
• AUC (↑): area under the ROC curve; higher values indicate stronger ranking of positive examples above negatives. • F1 (↑): harmonic mean of precision and recall, used when both false positives and false negatives matter. • Fmax (↑): maximum F1 over candidate thresholds, commonly used for multi-label functional annotation. • MCC (↑): Matthews correlation coefficient for binary classification; it remains informative when classes are imbalanced. • RMSE (↓): root mean squared error for regression, with larger errors penalized more strongly. • MAE (↓): mean absolute error between predicted and reference numeric values. • MAD MAE (↑): ratio between target dispersion and model error; larger values indicate better prediction relative to a mean baseline. • Spearman (↑): rank correlation between predicted and reference values. • HK-PCC (↑): Pearson correlation coefficient for the housekeeping enhancer-activity output. • R2 (↑): coefficient of determination, measuring explained variance in regression targets. • Mixed-score (↑): composite siRNA score combining numeric error and activity-range agreement. • BertScore (↑): semantic similarity between generated and reference text using contextual embeddings. • ROUGE-L (↑): longest-common-subsequence overlap between generated text and reference text. • MENTOR (↑): molecule-captioning metric for comparing generated molecular descriptions with references. • Split Match (↑): component-level match for molecular name conversion outputs. • Element Match (↑): element-composition match for molecular formula generation. • Exact Match (↑): strict string or structured-answer equality with the reference output. • 5.0% EF (↑): enrichment factor in the top 5.0% of a virtual-screening ranking. • SMACT (↑): validity rate under charge-balance and chemical-plausibility checks for generated material compositions. • Normalized SW (↑): maximum normalized Smith–Waterman alignment score between generated and reference protein sequences.
A.2
Detailed results
Table A1 summarizes the comparison with specialist baselines. Tables A2–A4 provide the complete task-level comparison with frontier general-purpose models across Chemistry, Material Science, and Biology. Within each discipline, tasks are organized as Scientific QA, Property Prediction, Property Classification, or Generation and Design. Across the full benchmark suite, SciReasoner leads on 67 of 86 tasks. The appendix separates these comparisons for clarity. On the 33 tasks with specialist baselines, SciReasoner matches or surpasses the specialist in 26 comparisons A1. Against LLM baselines across all 86 tasks, SciReasoner is the best-performing model on 75 of 86 tasks (22 of 28 Chemistry tasks, 13 of 14 Material Science tasks, and 40 of 44 Biology tasks). The few non-leading results are concentrated in molecule captioning, selected chemistry QA and classification tasks, bulk modulus material, and a small number of protein-interaction or modification benchmarks, where competing general-purpose models remain strong. At the discipline level, the Chemistry results indicate broad gains in chemical information extraction, name conversion, molecular description generation, reaction prediction, retrosynthesis, and molecule design (Table A2). In Material Science, SciReasoner achieves consistently strong regression and classification performance, with pronounced margins on JARVIS-QETB, GNoME, QMOF and OQMD (Table A3). In Biology, the model performs robustly across sequence-to-function generation, biological property prediction, promoter and interaction classification and RNA/protein tasks (Table A4). Together, these results indicate that the performance gains are not restricted to a single metric or task format, but extend across structured prediction, text generation, classification, and design-oriented settings.
25
Task
Metric
Specialist method Specialist SciReasoner
Generation & Design Retrosynthesis USPTO-50K Exact Match↑ RSGPT [31] Prediction Fluorescence Spearman↑ SaprotHub [28] Isoform R2↑ APARENT [87] TM-score Spearman↑ SaprotHub [28] ESOL RMSE↓ MolCLR [88] MAD GNoME ↑ LLM-Prop [67] MAE MAD QMOF ↑ LLM-Prop [67] MAE MAD MP regression ↑ LLM-Prop [67] MAE MAD JARVIS-DFT LLM-Prop [67] MAE ↑ MAD SNUMAT regression LLM-Prop [67] MAE ↑ MAD hMOF LLM-Prop [67] MAE ↑ MAD OQMD ↑ LLM-Prop [67] MAE MAD ↑ LLM-Prop [67] OMDB MAE DUD-E 5.0% EF↑ ConfSeq [58] MAD Cantor HEA LLM-Prop [67] MAE ↑ LIPO RMSE↓ MolCLR [88] Classification BBBP ACC↑ MolCLR [88] ClinTox ACC↑ MolCLR [88] HIV Prediction ACC↑ MolCLR [88] SIDER ACC↑ MolCLR [88] MP classification AUC↑ LLM-Prop [67] TF-m MCC↑ NT [89] PD-prom 300 all MCC↑ NT [89] CPD-prom core all MCC↑ NT [89] RNA protein interaction MCC↑ RPI-Pred [90] Non-coding RNA family ACC↑ RNA-MSM [91] GO-BP Fmax↑ SaprotHub [28] GO-CC Fmax↑ SaprotHub [28] GO-MF Fmax↑ SaprotHub [28] Human PPI ACC↑ ESM2 [29] Subcellular localization ACC↑ ESM2 [29] Metal ion binding ACC↑ ESM2 [29] Solubility ACC↑ DeepLoc [92]
0.63
0.72
0.70 0.59 0.83 1.11 15.60 1.96 4.39 2.91 1.51 1.48 6.02 1.51 7.12 8.40 0.65
0.77 0.86 0.83 1.03 21.91 8.61 5.83 5.67 2.26 1.67 7.22 1.50 7.70 7.79 0.80
0.74 0.93 0.81 0.68 0.72 0.57 0.91 0.67 0.74 0.89 0.49 0.48 0.67 0.77 0.84 0.73 0.77
0.84 0.95 0.92 0.74 0.73 0.64 0.89 0.68 0.81 0.90 0.52 0.58 0.66 0.73 0.88 0.74 0.72
Table A1: Per-task comparison of SciReasoner against specialist baselines. Bold indicates the best performance, and underline indicates the second best.
26
Task
Metric
Opus-4.7 GPT-5.5 Kimi-K2.6 DeepSeek-V4-Pro SciReasoner
Scientific QA Chemical entity recognition F1↑ Chemical protein interaction extraction F1↑ Chemical disease interaction extraction F1↑ Multiple choice question ACC↑ True or false question ACC↑ Open question BertScore↑ Name conversion-s2i Split Match↑ Name conversion-s2f Element Match↑ Name conversion-i2s Exact Match↑ Name conversion-i2f Element Match↑ Molecular description generation ROUGE-L↑ Molecule captioning MENTOR↑
0.84 0.35 0.41 0.90 0.63 0.77 0.34 0.85 0.69 0.90 0.46 0.46
0.69 0.05 0.31 0.91 0.60 0.82 0.07 0.84 0.58 0.91 0.08 0.30
0.72 0.18 0.34 0.87 0.58 0.82 0.02 0.04 0.19 0.40 0.09 0.14
0.63 0.03 0.27 0.89 0.63 0.82 0.01 0.28 0.35 0.64 0.31 0.16
0.88 0.36 0.54 0.88 0.55 0.85 0.50 0.96 0.87 0.93 0.75 0.45
RMSE↓ 5.0% EF↑ RMSE↓ MAE↓
0.89 3.77 0.97 19.52
8.72 4.98 1.48 25.79
137.05 1.85 16.25 2158.02
5.24 1.28 3.29 73.24
1.03 7.70 0.80 4.58
ACC↑ ACC↑ ACC↑ ACC↑
0.73 0.88 0.94 0.70
0.81 0.41 0.61 0.84
0.54 0.57 0.91 0.69
0.69 0.77 0.90 0.71
0.84 0.95 0.92 0.74
Exact Match↑ Exact Match↑ Exact Match↑ Exact Match↑ Exact Match↑ Exact Match↑ Exact Match↑ Exact Match↑
0.56 0.84 0.07 0.43 0.48 0.23 0.44 0.10
0.56 0.82 0.05 0.29 0.31 0.13 0.43 0.10
0.35 0.90 0.04 0.43 0.10 0.03 0.15 0.08
0.25 0.80 0.04 0.26 0.15 0.03 0.30 0.08
0.73 0.98 0.12 0.67 0.72 0.39 0.50 0.12
Property Prediction ESOL DUD-E LIPO Physicochemical prediction Property Classification BBBP ClinTox HIV Prediction SIDER Generation and Design Forward synthesis Forward reaction prediction Reagent prediction Retrosynthesis mol Retrosynthesis USPTO-50K Retrosynthesis smol Molecule generation Description guided molecule design
Table A2: Evaluation results on Chemistry tasks grouped by task type. Bold indicates the best performance, and underline indicates the second best.
Task
Metric Opus-4.7 GPT-5.5 Kimi-K2.6 DeepSeek-V4-Pro SciReasoner
Property Prediction MAD MAE ↑ MAD MAE ↑ MAD MAE ↑ MAD MAE ↑ MAD MAE ↑ MAD MAE ↑ MAD MAE ↑ MAD MAE ↑ MAD MAE ↑ MAD MAE ↑
2.11 1.51 1.48 0.73 1.94 1.08 1.40 1.66 1.97 1.26
2.67 1.67 1.78 0.84 5.39 0.99 2.72 3.12 1.84 1.43
1.76 1.41 1.31 0.88 1.56 1.00 1.44 1.56 1.03 1.07
1.58 1.46 1.38 0.86 1.22 0.92 1.29 1.35 1.46 1.10
5.83 2.26 5.67 108.98 21.91 1.67 7.79 8.61 7.22 1.50
MP classification AUC↑ SNUMAT classification AUC↑
0.61 0.58
0.65 0.59
0.66 0.56
0.59 0.60
0.73 0.68
0.89 0.99
0.90 0.99
0.35 0.17
0.24 0.11
0.90 0.88
MP regression SNUMAT regression JARVIS-DFT JARVIS-QETB GNoME hMOF Cantor HEA QMOF OQMD OMDB Property Classification
Generation and Design Composition material SMACT↑ Bulk modulus material SMACT↑
Table A3: Evaluation results on Material Science tasks grouped by task type. Bold indicates the best performance, and underline indicates the second best.
27
Task
Metric
Opus-4.7 GPT-5.5 Kimi-K2.6 DeepSeek-V4-Pro SciReasoner
Scientific QA Function General function
ROUGE-L↑ ROUGE-L↑
0.30 0.52
0.10 0.10
0.01 0.18
0.03 0.15
0.80 0.77
Spearman↑ Spearman↑ HK-PCC↑ R2↑ R2↑ R2↑ Spearman↑ Mixed-score↑ MAE↓ Spearman↑
0.44 0.36 0.07 0.09 0.03 0.04 0.14 0.00 0.18 -0.06
0.50 0.13 -0.06 0.01 0.10 0.02 0.28 0.33 0.27 0.15
0.10 0.06 -0.05 0.05 0.01 0.02 0.05 0.07 0.47 -0.15
0.04 -0.02 0.13 0.01 0.00 0.01 0.40 0.22 0.56 -0.12
0.77 0.61 0.64 0.86 0.60 0.46 0.12 0.61 0.05 0.83
ACC↑ F1↑ F1↑ F1↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ MCC↑ ACC↑ ACC↑ ROUGE-L↑ ROUGE-L↑ ACC↑ ACC↑ ACC↑ ACC↑ Fmax↑ F1↑ ACC↑ Fmax↑ Fmax↑ Fmax↑
0.58 0.43 0.06 0.16 0.08 -0.44 -0.02 0.28 0.07 0.30 0.23 0.30 0.35 0.34 0.40 0.21 0.42 0.70 0.43 0.42 0.21 0.52 0.00 0.48 0.09 0.58 0.74 0.43 0.33 0.47
0.54 0.44 0.12 0.12 0.12 -0.13 0.12 0.22 -0.03 -0.10 -0.08 0.00 0.05 0.21 0.09 0.22 0.56 0.82 0.10 0.06 0.24 0.55 0.00 0.65 0.12 0.36 0.70 0.29 0.40 0.24
0.53 0.23 0.00 0.00 0.02 0.05 -0.04 0.06 0.00 0.23 -0.04 0.05 0.02 0.05 0.06 0.14 0.48 0.50 0.14 0.24 0.16 0.52 0.00 0.11 0.15 0.03 0.43 0.27 0.28 0.16
0.58 0.34 0.01 0.00 0.06 -0.38 -0.13 0.04 0.00 -0.07 0.13 0.22 -0.13 -0.14 0.02 -0.02 0.48 0.55 0.14 0.15 0.12 0.53 0.00 0.13 0.13 0.08 0.60 0.31 0.35 0.40
0.72 0.53 0.73 0.71 0.28 0.81 0.18 0.64 0.24 0.89 0.93 0.55 0.68 0.68 0.67 0.52 0.54 0.73 0.51 0.55 0.90 0.51 0.49 0.88 0.78 0.83 0.74 0.52 0.58 0.66
0.74 0.60
0.67 0.14
0.73 0.17
0.73 0.19
0.94 0.70
Property Prediction Fluorescence Stability Enhancer activity Isoform Mean ribosome loading Programmable RNA switches CRISPR on target siRNA efficiency Structural similarity TM-score Property Classification Solubility gSymbol2Tissue gName2Cancer gSymbol2Cancer Antibody antigen RNA protein interaction Epigenetic marks prediction TF-m Enhancer-promoter interaction PD-prom 300 all PD-prom 300 notata PD-prom 300 tata CPD-prom core all CPD-prom core notata CPD-prom core tata TF-h Yeast PPI Human PPI Protein function Domain motif Non-coding RNA family Modification Fold type Subcellular localization EC number Keywords Metal ion binding GO-BP GO-CC GO-MF Generation and Design Function-guided protein design Normalized SW↑ Catalytic activity ROUGE-L↑
Table A4: Evaluation results on Biology tasks grouped by task type. Bold indicates the best performance, and underline indicates the second best.
28
Appendix B
Human Evaluation Form
This appendix shows representative questionnaire items used for double-blinded human evaluation. One sample is selected from each task category: crystal-material property prediction, Gene Ontology prediction, and retrosynthesis. For each item, evaluators read the input prompt, two anonymized model reasoning traces (named Model A and Model B correspondingly) and final outputs, and a read-only ground-truth fact sheet. They then score each model on five trace-quality axes and complete the overall comparison questions.
B.1
General Evaluation Instructions
Evaluators should assess the quality of the reasoning trace, not only whether the final answer is numerically or symbolically close to the ground truth. The main criteria are evidence grounding, domain plausibility, alignment with the ground-truth regime or reaction/function region, reasoning coherence, and hallucination risk.
Verdict label
Meaning
Correct
The claim is supported by the provided input, the ground truth, the read-only Part A fact sheet, or standard domain knowledge used only for verification. A local or peripheral defect. The relevant entity or direction is mostly correct, and the defect does not materially change the quality of that scoring axis. A substantive axis-level defect, such as an input misread treated as fact, a domain inference contradicting the ground truth or standard knowledge, a wrong target region or reaction family, or a broken evidence-to-conclusion chain. Independent major defects on the same axis are counted separately. Fabrication: the trace names a concrete entity, index, reference, topology, structure, GO term, reaction, reagent, or mechanism that is absent from the input/ground truth and cannot be verified from standard sources. Real-but-misapplied entities are not Critical; they are routed to Q2 or Q3.
Minor Major
Critical
Axis
Focus
Q1
Evidence grounding in the provided input
Q2
Q3
Q4
Q5
Scoring rule
Check whether entities, tokens, sequence positions, atom-map indices, product groups, or cited input facts actually appear in the task input. Score in {1, . . . , 10} or N.A. using the count-to-score table. Domain plausibility relative to Check whether the trace’s scientific inferences are ground truth plausible given the ground truth, and standard domain knowledge. Score in {1, . . . , 10} or N.A. using the count-to-score table. Target alignment Judge whether the committed conclusion falls in the correct materials regime, GO region, or retrosynthesis reaction class/formed bond. Score in {1, . . . , 10} or N.A. using the count-to-score table. Reasoning coherence Check whether the trace builds a relevant evidence-toconclusion chain without unresolved contradiction, circularity, padding, or unused observations. Score in {1, . . . , 10} or N.A. using the count-to-score table. Unsupported overclaiming or Check for fabricated or over-specific unsupported hallucination claims. Score in {1, . . . , 10} or N.A. using the count-to-score table.
Verdict counts on Q1/Q2/Q3/Q4/Q5
Score
Critical ≥ 2, or the core conclusion depends on a fabricated entity Critical = 1, M ajor ≥ 1 Critical = 1, M ajor = 0 Critical = 0, M ajor ≥ 4 Critical = 0, M ajor = 3 Critical = 0, M ajor = 2 Critical = 0, M ajor = 1 Critical = 0, M ajor = 0, M inor ≥ 4 Critical = 0, M ajor = 0, M inor = 3
1 2 3 2 3 4 5 6 7
29
Critical = 0, M ajor = 0, M inor = 2 Critical = 0, M ajor = 0, M inor = 1 Critical = 0, M ajor = 0, M inor = 0, and at least one claim is verified Correct No checkable claim on the axis
N.A.
Axis
Materials
Q1
Evidence grounding in Evidence grounding in Evidence grounding in formula, SLICES-PLUS amino-acid sequence length, product SMILES, product space-group tokens, atom residue positions, motifs, functional groups, lists, edge lists, periodic and the Foldseek 3Di atom-map indices, product offsets, and coordination structural alphabet. connectivity, and cited counts. atom-map sets. Materials plausibility Biological plausibility Disconnection and reactant relative to crystal chemistry, relative to the ground-truth plausibility relative to the property constraints, and protein identity, family, gold route, atom-map the ground-truth property motifs, domains, and GO balance, regime. region. oxidation/protection state, and chemical feasibility. Property-regime alignment, GO-space alignment within Reaction-class alignment: including boundary the evaluated branch, gold reaction family plus handling for values near including correct, adjacent, gold formed bond scores regime edges. wrong-region, highest; neighbouring wrong-super-class, and families sharing the formed no-commit cases. bond are borderline; different valid disconnections are lower. Coherence from decoded Coherence from sequence, Coherence from product structure and target-specific 3Di, motif, domain, or parsing to retrosynthetic mechanism to the family evidence to the disconnection and reactant committed property call. committed GO-function proposal. hypothesis. Unsupported materials Unsupported biological Unsupported chemical overclaiming, such as overclaiming, such as overclaiming, such as invented topology, SBU, invented residues, motifs, invented product groups, phase transition, atom domains, GO terms, protein atom-map indices, reagents, index, or citation. identity, or citation. named reactions, mechanisms, or citations.
Q2
Q3
Q4
Q5
Gene Ontology
8 9 10
Retrosynthesis
The questionnaire also contains four overall fields. Q6 asks how Model A compares with expert expectation, Q7 asks the same for Model B, Q8 asks for a direct Model A versus Model B comparison, and Q9 records evaluator confidence on a 1–10 scale with a free-text note.
B.2
Blank Scoring Sheet Used for Each Sample
Axis
Model A score
Model B score
Evidence, claim verdicts, and notes
Q1 Q2 Q3 Q4 Q5 Sum Mean
Overall question
Allowed response
Q6. Model A versus expert expectation
Significantly falls short / Falls short / Comparable / Exceeds / Significantly exceeds. 30
Q7. Model B versus expert expectation Q8. Direct comparison Q9. Evaluator confidence
B.3
Significantly falls short / Falls short / Comparable / Exceeds / Significantly exceeds. A much better / A slightly better / Tie / B slightly better / B much better. Integer confidence score from 1 to 10, plus a free-text confidence note.
Materials: Ag2HgI4, shear modulus
Field
Value
Dataset / task Sample ID Chemical formula Target property Property description
JARVIS-DFT / Gv . 1169. Ag2HgI4. shear modulus gv. Shear modulus: resistance to shear deformation; related to directional bonding, framework rigidity, and elastic anisotropy. 5.77 GPa. {shear modulus gv: 5.62}. {shear modulus gv: 8.00}.
Ground truth Model A final output Model B final output
Input prompt. You are a material scientist. Look at the chemical formula and structure information of the given crystalline material and predict its property. The output must be in a JSON format. For example: {property_name: predicted_property_value}. Answer as precise as possible and in as few words as possible. chemical formula: Ag2HgI4 structure information: <material_structure>o w b OOO m OOO c OOO o Ag Ag Hg I I I I 0 6 -oo 0 3 -oo 0 5 ooo 0 4 ooo 1 4 o-o 1 5 ooo 1 3 o-o 1 6 ooo 2 3 --o 2 6 -o- 2 4 o-- 2 5 ooo</material_structure> property name: shear_modulus_gv
Read-only ground-truth fact sheet. ID
Reference fact
Value
A1
Decoded space group
A2 A3
Number of atoms Formula consistency
A4 A5
Target and ground truth Ground-truth regime
A6 A7
Atom-index table Key neighbors
A8
Coordination summary
No primer match. The leading tokens o w b OOO m OOO c OOO o do not exactly match any listed SLICES-PLUS primer row, so a concrete space-group label is not a checkable Q1 claim. 7; any cited atom index ≥ 7 is fabricated. The atom list Ag Ag Hg I I I I corresponds to 2 Ag, 1 Hg, and 4 I, matching Ag2HgI4. shear modulus gv = 5.77 GPa. Soft shear modulus, Gv < 20 GPa; far from the 20 GPa boundary. The hard physical constraint is Gv ≲ Kv . 0=Ag, 1=Ag, 2=Hg, 3=I, 4=I, 5=I, 6=I. Ag(0) connects to I(6,3,5,4); Ag(1) connects to I(4,5,3,6); Hg(2) connects to I(3,6,4,5). Each iodine connects to Ag(0), Ag(1), and Hg(2). Ag(0), Ag(1), and Hg(2) are each four-coordinate, tetrahedral by iodine; each iodine is three-coordinate.
Example claim prompts shown to the evaluator. Axis
Model A claim examples
Q1
The trace cites the atom list, selected edge The trace parses indices 0 and 1 as Ag, 2 tokens, and tetrahedral metal-iodine as Hg, and 3–6 as I, and lists the twelve coordination. metal-iodine edges. Heavy and polarizable iodide ions imply a The trace treats the material as a soft compliant lattice with low shear stiffness. iodide solid and invokes tetrahedral coordination.
Q2
Model B claim examples
31
Q3
The committed value 5.62 GPa lies in the correct soft regime and is close to the ground truth. The trace connects structure, coordination, heavy halide chemistry, and the target mechanical property.
Q4
The trace contains longer speculative discussion; evaluators check whether the final estimate follows from the cited evidence. No concrete fabricated entity is apparent if Evaluators check any named phase, the trace remains within decoded structure database identifier, or literature-like and standard halide chemistry. statement for fabrication.
Q5
B.4
The committed value 8.00 GPa also lies in the correct soft regime.
Gene Ontology: 1bd8 A-P55273, biological process
Field
Value
Dataset / task GO / BP. Protein name in sample 1bd8 A-P55273. Chain A. Model A performance metadata F1 = 0.967, precision = 0.993, recall = 0.943; 139 predicted BP terms. Model B performance metadata F1 = 0.209, precision = 0.314, recall = 0.156; 70 predicted BP terms. Number of true BP terms 145.
Input prompt. What are the Gene Ontology terms (biological process) for this protein? <protein>RAGDRLSGAAARGDVQEVRRLLHRELVHPDALNRFGKTALQVMMFGSTAIALELLKQGASPNVQDTSGTSPVHDAARTGFLDTLKVLVEHGADV NVPDGTGALPIHLAVQEGHTAVVSFLAAESDLHRRDARGLTPLELALQRGAQDLVDILQGHM</protein> <protein_structure>D L Q Q Q L L V C Q L V L N L P S N C C S C P V V V D Q Q Q D A D P V R G G S L A R G P L L N L S S L L S S L V S P N D L C D A D P Q Q D G S L L V N L L V L V V S N N V S S V V S P H D Q A R A G N Q Q D G S L L N N L Q N V N L V S N L V C L Q P Y P Q C G A G N V R D G S L R S N V V V V V V S S N V S N V V S D</protein_structure> Only the biological process (BP) aspect.
Model outputs shown in the questionnaire. Output
Abbreviated display
Model A final prediction
A long semicolon-separated list of 139 BP terms, including regulation of signal transduction, regulation of cell cycle, negative regulation of endopeptidase activity, proteolysis, regulation of apoptotic process, DNA damage response, regulation of kinase activity, and negative regulation of cell cycle. A JSON-style output with 70 BP terms, dominated by regulation of DNA-templated transcription, gene expression, positive regulation of RNA biosynthetic process, positive regulation of DNA-templated transcription, and related transcriptional or signaling terms. A long semicolon-separated list of 145 BP terms centered on negative regulation of cell cycle, G1/S transition, CDK activity regulation, apoptotic or programmed cell-death regulation, DNA-damage response and repair, and stress-response processes.
Model B final prediction
Ground truth
Read-only ground-truth fact sheet. ID
Reference fact
Value
A1 A2
Sequence length 3Di length and low-confidence stretches Diagnostic motifs
156 residues. 156 tokens, aligned 1:1 with the amino-acid sequence; no # low-confidence tokens are present. Basic-rich segments RRLLHRE at residue 19 and RRDARGL at residue 128. The sequence is built from tandem ankyrin repeats; it does not contain a real DNA-binding or bZIP motif.
A3
32
A4
Ground-truth identity / family Cyclin-dependent kinase 4 inhibitor D (p19INK4d / CDKN2D), human. It is an ankyrin-repeat CDK inhibitor and tumor suppressor. Ground-truth BP region Negative regulation of cell cycle and cell-cycle phase transition, especially G1/S; regulation of CDK or proteinserine/threonine kinase activity; apoptotic or programmed cell-death regulation; DNA-damage response and repair; response to stress, radiation, or chemical stimulus. Not transcription or DNA-templated gene expression. Number of true terms Ntrue = 145. UniProt / InterPro constraints InterPro IPR050776 Ank Repeat/CDKN Inhibitor, IPR002110 Ankyrin rpt, and IPR036770 Ankyrin rpt-contain sf. Keywords include Cell cycle, Tumor suppressor, ANK repeat, Nucleus, and Cytoplasm. The protein inhibits CDK4 and CDK6.
A5
A6 A7
Example claim prompts shown to the evaluator. Axis
Model A claim examples
Q1
The trace cites 3Di runs, loop-like 3Di The trace quotes the full sequence and segments, and basic sequence clusters such identifies a basic region, but also claims a as RRLLHRE. heptad or leucine-zipper-like pattern. The trace infers a regulatory protein and The trace identifies the protein as a bZIP, predicts cell-cycle, apoptosis, WRKY, or transcription factor-like kinase-regulation, and stress-response protein and predicts transcriptional terms. regulation terms. Model A’s committed terms largely Model B’s committed terms center on overlap the CDK inhibitor BP region. transcription and gene expression, which is outside the ground-truth BP region. Evaluators check whether the trace moves Evaluators check format-oriented from sequence and 3Di evidence to the reasoning, identity contradictions, and committed GO region without whether the final term list follows from unsupported leaps. grounded evidence. Named biological entities and GO terms The bZIP, WRKY, leucine-zipper, and should be checked for unsupported transcription-factor claims must be judged specificity or fabrication. as real-but-misassigned or fabricated, following the rubric.
Q2
Q3
Q4
Q5
B.5
Model B claim examples
Retrosynthesis: USPTO-50K sample 4, other
Field
Value
Dataset / task Sample ID Reaction class Matches gold
USPTO-50K / retrosynthesis. 4. Other / uncategorized retrosynthesis reaction. Model A matches the gold reactants; Model B proposes a related but not gold reactant set.
Input prompt. Please suggest potential reactants for the given product. <SMILES> [C:1](=[O:2])([C:3]([F:4])([F:5])[F:6])[NH:7][CH2:8][c:9]1[cH:10][cH:11] [cH:12][cH:13][c:14]1[S:15](=[O:16])(=[O:17])[CH:18]1[CH2:19][CH2:20]1 </SMILES>
Model outputs and gold reactants. Field
SMILES
Product
[C:1](=[O:2])([C:3]([F:4])([F:5])[F:6])[NH:7][CH2:8][c:9]1[cH:10][cH:11][cH:12][cH:13][c: 14]1[S:15](=[O:16])(=[O:17])[CH:18]1[CH2:19][CH2:20]1.
33
Gold reactants Model A final prediction Model B final prediction
O=C(O[C:1](=[O:2])[C:3]([F:4])([F:5])[F:6])C(F)(F)F.[NH2:7][CH2:8][c:9]1[cH:10][cH: 11][cH:12][cH:13][c:14]1[S:15](=[O:16])(=[O:17])[CH:18]1[CH2:19][CH2:20]1. O=C(O[C:1](=[O:2])[C:3]([F:4])([F:5])[F:6])C(F)(F)F.[NH2:7][CH2:8][c:9]1[cH:10][cH: 11][cH:12][cH:13][c:14]1[S:15](=[O:16])(=[O:17])[CH:18]1[CH2:19][CH2:20]1. NCc1ccccc1S(=O)(=O)C1CC1.OC(=O)C(F)(F)F.
Read-only ground-truth fact sheet. ID
Reference fact
A1
Product functional-group inventory
A2 A3
A4
Value
Trifluoroacetyl C(= O)CF3 at atom maps 1–6; secondary amide N-H at atom 7; benzylic CH2 at atom 8; ortho-disubstituted benzene ring at atoms 9–14; aryl sulfone at atom 15 with oxygens 16 and 17; cyclopropyl atoms 18–20. Highest atom-map index 20; any cited atom-map index > 20 is fabricated. Gold reaction class and formed Trifluoroacetylation of a primary amine. The forward bond reaction forms the amide C–N bond between carbonyl carbon [C:1] and nitrogen [NH:7]. The acyl source is trifluoroacetic anhydride (TFAA). Gold reactant atom-map set The TFAA fragment carries atoms 1–6, while the amine and legitimate lost atoms fragment carries atoms 7–20. The union covers the full product atom map. The unmapped leaving group is a trifluoroacetate or water-equivalent by-product.
Example claim prompts shown to the evaluator. Axis
Model A claim examples
Q1
The trace identifies the trifluoroacetyl group, amide N, benzyl group, sulfone, and cyclopropyl group.
Q2
Q3
Q4
Q5
Model B claim examples
The trace parses the product as a trifluoroacetamide attached to an ortho-substituted aryl sulfone and cyclopropyl group. The trace disconnects the C1–N7 amide The trace disconnects the same amide bond and proposes TFAA plus the bond but proposes trifluoroacetic acid plus primary amine. the amine. Model A matches the gold amide-forming Model B finds the same C–N disconnection reaction family and gold formed bond. but uses a less activated acyl source than the gold TFAA route. The trace follows product parsing to Evaluators check for length padding, amide disconnection to reactant selection. repeated route restatement, and wobble among acid, acid chloride, and anhydride before commitment. TFAA, primary amine acylation, and Trifluoroacetic acid and the amine are amide formation are real and supported by real; evaluators check whether any the product. unsupported reaction claims or invented reagents appear.
Input prompt Chemical formula: BaLaFe2Cu2O11 Target property: band_gap Material structure: <material_structure>o x b OOO j OOO o Ba La Fe Fe Cu Cu O O O O O O O O O O O 0 8 -oo 0 12 -oo 0 16 -oo 0 16 ooo 0 7 -oo 0 11 -oo 0 14 ooo 0 14 o+o 0 6 ooo 0 10 ooo 0 9 ooo 0 13 ooo 1 9 o-o 1 13 o-o 1 14 ooo 1 14 +oo 1 6 ooo 1 10 ooo 1 16 o-o 1 16 ooo 1 7 o-o 1 11 o-o 1 8 ooo 1 12 ooo 2 7 --o 2 8 -oo 2 9 o-o 2 6 ooo 2 14 ooo 3 10 oo- 3 13 oo- 3 12 oo- 3 11 oo- 3 15 ooo 3 16 oo- 4 11 --- 4 12 -o- 4 13 o-- 4 10 oo- 4 14 oo- 5 6 ooo 5 9 ooo 5 8 ooo 5 15 ooo 5 16 ooo 5 7 ooo 6 14 ooo 6 16 ooo 7 14 ++o 7 16 ooo 8 14 +oo 8 16 ooo 9 14 o+o 9 16 ooo 10 14 ooo 10 16 ooo 11 14 ++o 11 16 ooo 12 14 +oo 12 16 ooo 13 14 o+o 13 16 ooo</material_structure> Question:
34
You are a material scientist. Look at the chemical formula and structure information of the given crystalline material and predict its property. The output must be in a json format. For example: property_name: predicted_property_value. Answer as precise as possible and in as few words as possible. chemical formula: BaLaFe2Cu2O11 structure information: <material_structure>o x ...</material_structure> property name: band_gap
SciReasoner reasoning trace <think> To determine the band gap of this material, I first need to decode the structural information provided in the SLICES string to understand the chemical environment and bonding topology. The input string begins with the space group encoding <material_structure>o x b OOO j OOO o</material_structure>, which defines the symmetry operations, followed immediately by the atom list. Reading the atom symbols in order, I see <material_structure>Ba La Fe Fe Cu Cu O O O O O O O O O O O</material_structure>. This confirms the stoichiometry matches the formula BaLaFe2Cu2O11, cons ⌋ isting of one Barium, one Lanthanum, two Iron, two Copper, and eleven Oxygen atoms per unit cell. My primary focus for predicting the electronic property is the transition metal sublattice, specifically the Iron and Copper sites, which correspond to indices 2, 3, 4, and 5 in the atom list. I need to examine the bonding environment to see how these metals interact with the oxygen ligands. Scanning the edge list, I find connections such as <material_structure>2 6 ooo</material_structure> and <material_structure>2 14 ooo</material_structure>, which indicate that the Iron atom at index 2 is bonded to Oxygen atoms at indices 6 and 14 within the same unit cell. Similarly, the Copper atom at index 5 shows connections like <material_structure>5 15 ooo</material_structure> and <material_structure>5 16 ooo</material_structure>, linking it to Oxygen sites 15 and 16. Crucially, I observe that the Oxygen sites are not isolated; they act as bridges connecting the different metal centers. For instance, Oxygen site 14 is connected to both Iron (index 2 via <material_structure>2 14 ooo</material_structure>) and Copper (index 1 via <material_structure>1 14 ooo</material_structure>), creating a Fe-O-Cu pathway. This heteroatomic networking allows for significant orbital overlap between the transition metal d-orbitals and the oxygen p-orbitals. In materials containing mixed transition metals like Iron and Copper, the presence of these continuous pathways often leads to broadened energy bands. If the Fermi level intersects these bands, the material exhibits metallic behavior. The dense connectivity evident in the edge list, with multiple intra-cell and inter-cell bonds like <material_structure>0 16 -oo</material_structure> and <materia ⌋ l_structure>13 14 o+o</material_structure>, supports a scenario where charge carriers can delocalize across the lattice. Therefore, based on the structural evidence of a connected transition metal-oxy ⌋ gen framework, the most consistent prediction for the band gap is that it closes completely. band_gap: 0.0 </think>
SciReasoner final output band_gap: 0.0
Fig. B1: Full example of a structure-aware reasoning trace. The input contains the chemical formula, target property, and SLICES-PLUS structural string. The reasoning trace explicitly cites structural substrings from the input and connects them to a material-property mechanism before producing the final prediction.
35
Input prompt Protein name: 1t4b_A-P0A9Q9 Protein structure: <protein_structure>D F E E E E A C L V F P L N V V L L V V C L V V V V L V V Y N Y A Y E D C P Q F Q D F D D V S S V D R D T H H H L Q D L V V V L R G Q E Y A Y P N E D V S C V P R V V V N V V V V R L H A Y E E L Y P N C P P P P L E A E F D C L Q F V V V V V V S V V V S R R Y Y Y H A A L V L L L C C L Q Q S L C V V V Q F F Q A K E K D K A F A Q C S L G D V S L V L L V Q Q V V V L C V Q C V V L V V P P P R D V V V S V V S S V C C Q P V P P R D C V R V V H D A H V D K D F A D A D A D P V R H H P V Q V S Q Q V N N C R S N V D P D G H Y Y G Y I D M Y H S A H F K M K M K M W T F T P D Q D D L V V S Q V S S C V S D V Q N A E Q E Q D D P S C V Q C A D S V N A E P H S H W Y K Y P W D A D P V D R R I T I I M I M H G C S D S V G N P R S S V V V V V V D</protein_structure> Question: Given the protein sequence <protein>MKNVGFIGWRGMVGSVLMQRMVEERDFDAIRPVFFSTSQLGQAAPSFGGTTGTLQDAFDLEALKALDIIVTCQGGDYTNEIYPKLRESGW ⌋ QGYWIDAASSLRMKDDAIIILDPVNQDVITDGLNNGIRTFVGGNCTVSLMLMSLGGLFANDLVDWVSVATYQAASGGGARHMRELLTQMGHLYGHVADE ⌋ LATPSSAILDIERKVTTLTRSGELPVDNFGVPLAGSLIPWIDKQLDNGQSREEWKGQAETNKILNTSSVIPVDGLCVRVGALRCHSQAFTIKLKKDVSI ⌋ PTVEELLAAHNPWAKVVPNDREITMRELTPAAVTGTLTTPVGRLRKLNMGPEFLSAFTVGDQLLWGAAEPLRRMLRQLA</protein> and its structure representation <protein_structure>D F E ... </protein_structure>, predict its Gene Ontology annotations for biological process. Only the biological process (BP) aspect.
SciReasoner reasoning trace <think> To determine the appropriate Gene Ontology (GO) biological process annotations for this protein, I need to analyze the relationship between its amino acid sequence and its predicted three-dimensional structure. The core task is to infer the protein's function---specifically its role in cellular processes---based on the structural motifs and sequence signatures provided in the input. I will start by assessing the overall structural class defined by the 3Di representation, then identify specific sequence motifs that indicate enzymatic activity, and finally map these findings to the relevant biological processes. First, I examine the structural representation to understand the protein's fold. The 3Di string provides a residue-level encoding of the local geometry. Scanning through the structure, I observe a significant prevalence of residues encoding alpha-helical conformations. For instance, the segment <protein_structure>V V L L V V C L V V V V L V V</protein_structure> near the N-terminal region shows a continuous run of V and L characters, which according to the decoding rules, signifies a stable alpha-helix. Similarly, towards the C-terminus, the pattern <protein_structure>V V V V V V D</protein_structure> indicates another helical segment. The presence of these helical bundles suggests a globular protein with a compact core, typical of enzymes that require a defined active site pocket. While there are regions with mixed characters like <protein_structure>D F E E E E A C L V F P L N</protein_structure>, which likely represent loop or coil regions connecting the secondary structure elements, the dominant feature is the alpha-helical architecture. This structural class is commonly associated with metabolic enzymes that bind small molecules. Next, I turn to the amino acid sequence to identify specific functional motifs that correlate with the structural observations. The sequence contains several patterns indicative of cofactor binding or catalytic activity. Notably, there is a glycine-rich region <protein>GWQGYWIDAASSLRMKDDAIIILDPVN ⌋ QDVITDGLNNGIRTFVGGNCTVSLMLMSLGGLFANDLVDWVSVATYQAASGGGARHMRELLTQMGHLYGHVADELATPSSAILDIERKVTTLTRSGELP ⌋ VDNFGVPLAGSLIPWIDKQLDNGQSREEWKGQAETNKILNTSSVIPVDGLCVRVGALRCHSQAFTIKLKKDVSIPTVEELLAAHNPWAKVVPNDREITM ⌋ RELTPAAVTGTLTTPVGRLRKLNMGPEFLSAFTVGDQLLWGAAEPLRRMLRQLA</protein>, specifically the <protein>VGGNCTVSLMLMSLGGLFANDLVDWVSVATYQAASGGGARHMRELLTQMGHLYGHVADELATPSSAILDIERKVTTLTRSGELPVDNFGV ⌋ PLAGSLIPWIDKQLDNGQSREEWKGQAETNKILNTSSVIPVDGLCVRVGALRCHSQAFTIKLKKDVSIPTVEELLAAHNPWAKVVPNDREITMRELTPA ⌋ AVTGTLTTPVGRLRKLNMGPEFLSAFTVGDQLLWGAAEPLRRMLRQLA</protein> stretch which includes conserved residues often found in nucleotide-binding domains. The presence of lysine and arginine residues, such as in the segment <protein>KDDAIIILDPVNQDVITDGLNNGIRTFVGGNCTVSLMLMSLGGLFANDLVDWVSVATYQAASGGGARHMRELLTQMGH ⌋ LYGHVADELATPSSAILDIERKVTTLTRSGELPVDNFGVPLAGSLIPWIDKQLDNGQSREEWKGQAETNKILNTSSVIPVDGLCVRVGALRCHSQAFTI ⌋ KLKKDVSIPTVEELLAAHNPWAKVVPNDREITMRELTPAAVTGTLTTPVGRLRKLNMGPEFLSAFTVGDQLLWGAAEPLRRMLRQLA</protein>, suggests potential interaction with phosphate groups, a hallmark of enzymes involved in phosphorylation or nucleotide metabolism. Furthermore, the sequence contains motifs like <protein>M ⌋ GHLYGHVADELATPSSAILDIERKVTTLTRSGELPVDNFGVPLAGSLIPWIDKQLDNGQSREEWKGQAETNKILNTSSVIPVDGLCVRVGALRCHSQAF ⌋ TIKLKKDVSIPTVEELLAAHNPWAKVVPNDREITMRELTPAAVTGTLTTPVGRLRKLNMGPEFLSAFTVGDQLLWGAAEPLRRMLRQLA</protein> which resemble those found in synthase or transferase families. The combination of the alpha-helical structural scaffold and these specific sequence motifs strongly points towards an enzyme that participates in the synthesis or modification of amino acids and nucleotides. Based on this structural and sequence evidence, I can deduce the biological processes. The protein's ability to bind nucleotides and its enzymatic nature imply involvement in metabolic pathways. Specifically, the motifs suggest it may catalyze reactions in the biosynthesis of amino acids, particularly those involving sulfur or serine derivatives, and potentially interact with pyruvate or related intermediates. The structural stability indicates it functions within the cell cytoplasm or a specific compartment where these metabolites are abundant. Therefore, the annotations should reflect its role in metabolic processes, specifically focusing on the synthesis and regulation of amino acids and nucleobase compounds. I will verify this by checking for consistency with the observed structural constraints; the alpha-helical dominance supports a soluble enzyme function rather than a membrane transporter, and the specific motifs align with biosynthetic pathways rather than degradation. </think>
36
SciReasoner final output amino acid metabolic process; carboxylic acid biosynthetic process; lysine metabolic process; obsolete diaminopimelate metabolic process; dicarboxylic acid metabolic process; sulfur compound metabolic process; dicarboxylic acid biosynthetic process; methionine biosynthetic process; diaminopimelate biosynthetic process; isoleucine biosynthetic process; sulfur compound biosynthetic process; threonine metabolic process; methionine metabolic process; small molecule biosynthetic process; lysine biosynthetic process; sulfur amino acid biosynthetic process; branched-chain amino acid metabolic process; alpha-amino acid metabolic process; alpha-amino acid biosynthetic process; sulfur amino acid metabolic process; isoleucine metabolic process; amino acid biosynthetic process; carboxylic acid metabolic process; lysine biosynthetic process via diaminopimelate; aspartate family amino acid biosynthetic process; L-methionine biosynthetic process; organic acid biosynthetic process; organic acid metabolic process; obsolete aspartate family amino acid metabolic process; branched-chain amino acid biosynthetic process; oxoacid metabolic process
Fig. B2: Full example of a structure-aware reasoning trace for biological-process Gene Ontology prediction. The input contains the amino-acid sequence of 1t4b A-P0A9Q9 and its residue-level 3Di structural representation. The reasoning trace cites sequence and structural substrings and connects them to metabolic and amino-acid-biosynthetic processes before producing the final set of predicted BP annotations. Input prompt Reaction class: alkylation Question: Please suggest potential reactants for the given product. <SMILES> [CH2:1]([CH2:2][CH2:3][C:4]([c:5]1[c:6]([CH3:7])[s:8][c:9]2[c:10]1[CH2:11][N:12]([C:13]([C ⌋ H3:14])=[O:15])[CH2:16][CH2:17]2)=[O:18])[N:28]1[CH2:27][CH2:26][CH:25]([c:24]2[c:23]3[cH:22][cH:21 ⌋ ][c:20]([F:19])[cH:34][c:33]3[o:32][n:31]2)[CH2:30][CH2:29]1 </SMILES>
SciReasoner reasoning trace <think> Let's break down the retrosynthetic analysis for the provided product. 1. Analysis of the Product Structure The product is a complex molecule with two main structural domains connected by a propyl chain: - Domain A (Left): A thienopyridine ring system substituted with an acetyl group and a methyl group. This domain is attached to the propyl chain via a carbonyl group (ketone). - Domain B (Right): A piperidine ring substituted with a fluorinated benzisoxazole group. This domain is attached to the propyl chain via a nitrogen atom (tertiary amine). The connection between these domains is a propyl linker: `[CH2:1]-[CH2:2]-[CH2:3]`. 2. Retrosynthetic Disconnection The most strategic bond to disconnect is the C-N bond between the propyl chain and the piperidine nitrogen (bond between `[CH2:1]` and `[N:28]`). - This is a classic alkylation disconnection. - The propyl chain acts as the alkylating agent (electrophile). - The piperidine nitrogen acts as the nucleophile. 3. Identifying the Reactants Based on this disconnection, we can propose the two reactants: *
Reactant 1 (The Alkylating Agent): The propyl chain must be attached to a good leaving group. In organic synthesis, **chloride** is a standard leaving group for such alkylations. - Structure: `Cl-CH2-CH2-CH2-Domain A`. - In SMILES: `Cl[CH2:1][CH2:2][CH2:3][C:4](=[O:18])[c:5]1[c:6]([CH3:7])[s:8][c:9]2[c:10]1[CH2:1 ⌋ 1][N:12]([C:13]([CH3:14])=[O:15])[CH2:16][CH2:17]2`.
*
Reactant 2 (The Nucleophile): The piperidine ring must have a free hydrogen on the nitrogen to act as a nucleophile. - Structure: `Domain B-H`. - In SMILES: `[F:19][c:20]1[cH:21][cH:22][c:23]2[c:24]([CH:25]3[CH2:26][CH2:27][NH:28][CH2:29][ ⌋ CH2:30]3)[n:31][o:32][c:33]2[cH:34]1`.
4. Sanity Check - Chemical Feasibility: The alkylation of a secondary amine (piperidine) with a primary alkyl chloride is a high-yielding, standard reaction, typically performed in the presence of a base (like K2CO3) to scavenge the HCl byproduct.
37
- Selectivity: The piperidine nitrogen is the most nucleophilic site in Reactant 2. The amide nitrogen in the thienopyridine ring (Reactant 1) is much less nucleophilic due to delocalization and is not a competing site for alkylation under these conditions. - Connectivity: The disconnection correctly places the propyl chain on the nitrogen, matching the product structure. 5. Final Answer The possible reactants are the alkyl chloride derivative of the thienopyridine domain and the substituted piperidine. <SMILES> Cl[CH2:1][CH2:2][CH2:3][C:4]([c:5]1[c:6]([CH3:7])[s:8][c:9]2[c:10]1[CH2:11][N:12]([C:13]([ ⌋ CH3:14])=[O:15])[CH2:16][CH2:17]2)=[O:18].[F:19][c:20]1[cH:21][cH:22][c:23]2[c:24]([CH:25]3[CH2:26] ⌋ [CH2:27][NH:28][CH2:29][CH2:30]3)[n:31][o:32][c:33]2[cH:34]1 </SMILES> </think>
SciReasoner final output <SMILES> Cl[CH2:1][CH2:2][CH2:3][C:4]([c:5]1[c:6]([CH3:7])[s:8][c:9]2[c:10]1[CH2:11][N:12]([C:13]([ ⌋ CH3:14])=[O:15])[CH2:16][CH2:17]2)=[O:18].[F:19][c:20]1[cH:21][cH:22][c:23]2[c:24]([CH:25]3[CH2:26] ⌋ [CH2:27][NH:28][CH2:29][CH2:30]3)[n:31][o:32][c:33]2[cH:34]1 </SMILES>
Fig. B3: Full example of a retrosynthetic reasoning trace for an alkylation reaction from the USPTO-50K dataset. The input contains the atom-mapped SMILES representation of the target product. The reasoning trace identifies the bond between [CH2:1] and [N:28] as the strategic C–N disconnection, interprets the transformation as alkylation of a secondary piperidine amine with a primary alkyl chloride, and produces the corresponding reactant SMILES.
38
References [1] Thakur, A., Kim, J., Wyatt, B. C., Gogotsi, Y. & Anasori, B. Composition–structure–property relationships in mxenes. Nature Reviews Materials 1–16 (2026). [2] Le, T., Epa, V. C., Burden, F. R. & Winkler, D. A. Quantitative structure–property relationship modeling of diverse materials properties. Chemical reviews 112, 2889–2919 (2012). [3] Van de Walle, A. A complete representation of structure–property relationships in crystals. Nature materials 7, 455–458 (2008). [4] Creighton, T. E. Proteins: structures and molecular properties (Macmillan, 1993). [5] Tai, T.-Y. et al. Leveraging isothermal titration calorimetry to explore structure–property relationships of protein immobilization in metal–organic frameworks. Angewandte Chemie International Edition 61, e202209110 (2022). [6] Osadchy, M. & Kolodny, R. Maps of protein structure space reveal a fundamental relationship between protein structure and function. Proceedings of the National Academy of Sciences 108, 12301–12306 (2011). [7] Anfinsen, C. B. Principles that govern the folding of protein chains. Science 181, 223–230 (1973). [8] Abramson, J. et al. Accurate structure prediction of biomolecular interactions with alphafold 3. Nature 630, 493–500 (2024). [9] Xie, T. & Grossman, J. C. Crystal graph convolutional neural networks for an accurate and interpretable prediction of material properties. Physical review letters 120, 145301 (2018). [10] Merchant, A. et al. Scaling deep learning for materials discovery. Nature 624, 80–85 (2023). [11] Strieth-Kalthoff, F. et al. Artificial intelligence for retrosynthetic planning needs both data and expert knowledge. Journal of the American Chemical Society 146, 11005–11017 (2024). [12] Segler, M. H., Preuss, M. & Waller, M. P. Planning chemical syntheses with deep neural networks and symbolic ai. Nature 555, 604–610 (2018). [13] Duek, P., Mary, C., Zahn-Zabal, M., Bairoch, A. & Lane, L. Functionathon: a manual data mining workflow to generate functional hypotheses for uncharacterized human proteins and its application by undergraduate students. Database 2021, baab046 (2021). [14] Zhao, D., Tu, S. & Xu, L. Efficient retrosynthetic planning with mcts exploration enhanced a* search. Communications Chemistry 7, 52 (2024). [15] Achiam, J. et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023). [16] Mirza, A. et al. Are large language models superhuman chemists? Nature Chemistry (2025). [17] Narayanan, S. et al. Training a scientific reasoning model for chemistry. Advances in Neural Information Processing Systems 38, 157671–157710 (2026). [18] Boiko, D. A., MacKnight, R., Kline, B. & Gomes, G. Autonomous chemical research with large language models. Nature 624, 570–578 (2023). [19] Ghareeb, A. E. et al. A multi-agent system for automating scientific discovery. Nature 1–3 (2026). [20] Aygün, E. et al. An ai system to help scientists write expert-level empirical software. Nature 1–3 (2026). [21] Gottweis, J. et al. Accelerating scientific discovery with co-scientist. Nature 1–3 (2026). [22] Wang, H. et al. Scientific discovery in the age of artificial intelligence. Nature 620, 47–60 (2023). [23] Yang, K. et al. Analyzing learned molecular representations for property prediction. Journal of chemical information and modeling 59, 3370–3388 (2019). [24] Anthropic. System card: Claude opus 4.7. https://anthropic.com/claude-opus-4-7-system-card (2026). [25] OpenAI. Introducing GPT-5.5. https://openai.com/index/introducing-gpt-5-5/ (2026). Accessed: 2026-06-05.
39
[26] DeepSeek-AI. Deepseek-v4: Towards highly efficient million-token context intelligence (2026). [27] Kimi. Kimi k2.6 tech blog: Advancing open-source coding. https://www.kimi.com/blog/kimi-k2-6 (2026). Accessed: 2026-07-07. [28] Su, J. et al. Democratizing protein language model training, sharing and collaboration. Nature Biotechnology 1–7 (2025). [29] Lin, Z. et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science 379, 1123–1130 (2023). URL https://www.science.org/doi/abs/10.1126/science.ade2574. [30] Altschul, S. F., Gish, W., Miller, W., Myers, E. W. & Lipman, D. J. Basic local alignment search tool. Journal of molecular biology 215, 403–410 (1990). [31] Deng, Y. et al. Rsgpt: a generative transformer model for retrosynthesis planning pre-trained on ten billion datapoints. Nature communications 16, 7012 (2025). [32] Mysinger, M. M., Carchia, M., Irwin, J. J. & Shoichet, B. K. Directory of useful decoys, enhanced (dud-e): better ligands and decoys for better benchmarking. Journal of medicinal chemistry 55, 6582–6594 (2012). [33] Ashburner, M. et al. Gene ontology: tool for the unification of biology. Nature genetics 25, 25–29 (2000). [34] The gene ontology resource: enriching a gold mine. Nucleic acids research 49, D325–D334 (2021). [35] Consortium, T. U. Uniprot: the universal protein knowledgebase in 2023. Nucleic acids research 51, D523– D531 (2023). [36] Friedberg, I. Automated protein function prediction—the genomic challenge. Briefings in bioinformatics 7, 225–242 (2006). [37] Radivojac, P. et al. A large-scale evaluation of computational protein function prediction. Nature methods 10, 221–227 (2013). [38] Cantalapiedra, C. P., Hernández-Plaza, A., Letunic, I., Bork, P. & Huerta-Cepas, J. eggnog-mapper v2: functional annotation, orthology assignments, and domain prediction at the metagenomic scale. Molecular biology and evolution 38, 5825–5829 (2021). [39] Gligorijević, V. et al. Structure-based protein function prediction using graph convolutional networks. Nature communications 12, 3168 (2021). [40] Van Kempen, M. et al. Fast and accurate protein structure search with foldseek. Nature biotechnology 42, 243–246 (2024). [41] Schneider, N., Lowe, D. M., Sayle, R. A., Tarselli, M. A. & Landrum, G. A. Big data from pharmaceutical patents: a computational analysis of medicinal chemists’ bread and butter. Journal of medicinal chemistry 59, 4385–4402 (2016). [42] Coley, C. W., Rogers, L., Green, W. H. & Jensen, K. F. Computer-assisted retrosynthesis based on molecular similarity. ACS central science 3, 1237–1245 (2017). [43] Segler, M. H. & Waller, M. P. Neural-symbolic machine learning for retrosynthesis and reaction prediction. Chemistry–A European Journal 23, 5966–5971 (2017). [44] Dai, H., Li, C., Coley, C., Dai, B. & Song, L. Retrosynthesis prediction with conditional graph logic network. Advances in Neural Information Processing Systems 32 (2019). [45] Chen, S. & Jung, Y. Deep retrosynthetic reaction prediction using local reactivity and global attention. JACS Au 1, 1612–1620 (2021). [46] Yan, C., Zhao, P., Lu, C., Yu, Y. & Huang, J. Retrocomposer: composing templates for template-based retrosynthesis prediction. Biomolecules 12, 1325 (2022). [47] Shi, C., Xu, M., Guo, H., Zhang, M. & Tang, J. A graph to graphs framework for retrosynthesis prediction 8818–8827 (2020).
40
[48] Yan, C. et al. Retroxpert: Decompose retrosynthesis prediction like a chemist. Advances in Neural Information Processing Systems 33, 11248–11258 (2020). [49] Wang, X. et al. Retroprime: A diverse, plausible and transformer-based method for single-step retrosynthesis predictions. Chemical Engineering Journal 420, 129845 (2021). [50] Chen, Z., Ayinde, O. R., Fuchs, J. R., Sun, H. & Ning, X. G 2 retro as a two-step graph generative models for retrosynthesis prediction. Communications Chemistry 6, 102 (2023). [51] Gao, Z., Tan, C., Wu, L. & Li, S. Z. Semiretro: Semi-template framework boosts deep retrosynthesis prediction. arXiv preprint arXiv:2202.08205 (2022). [52] Zhong, W., Yang, Z. & Chen, C. Y.-C. Retrosynthesis prediction using an end-to-end graph generative architecture for molecular graph editing. Nature Communications 14, 3009 (2023). [53] Zheng, S., Rao, J., Zhang, Z., Xu, J. & Yang, Y. Predicting retrosynthetic reactions using self-corrected transformer neural networks. Journal of chemical information and modeling 60, 47–55 (2019). [54] Sacha, M. et al. Molecule edit graph attention network: modeling chemical reactions as sequences of graph edits. Journal of Chemical Information and Modeling 61, 3273–3284 (2021). [55] Tu, Z. & Coley, C. W. Permutation invariant graph-to-sequence model for template-free retrosynthesis and reaction prediction. Journal of chemical information and modeling 62, 3503–3513 (2022). [56] Zhong, Z. et al. Root-aligned smiles: a tight representation for chemical reaction prediction. Chemical Science 13, 9023–9034 (2022). [57] Yao, L. et al. Node-aligned graph-to-graph: elevating template-free deep learning approaches in single-step retrosynthesis. JACS Au 4, 992–1003 (2024). [58] Xiong, J. et al. Bridging three-dimensional molecular structures and artificial intelligence with a conformation description language. Nature Machine Intelligence 1–15 (2026). [59] Hemmer, M. C., Steinhauer, V. & Gasteiger, J. Deriving the 3d structure of organic molecules from their infrared spectra. Vibrational spectroscopy 19, 151–164 (1999). [60] Devinyak, O., Havrylyuk, D. & Lesyk, R. 3d-morse descriptors explained. Journal of Molecular Graphics and Modelling 54, 194–203 (2014). [61] Klein, C. T., Kaiser, D. & Ecker, G. Topological distance based 3d descriptors for use in qsar and diversity analysis. Journal of chemical information and computer sciences 44, 200–209 (2004). [62] Axen, S. D. et al. A simple representation of three-dimensional molecular structure. Journal of medicinal chemistry 60, 7393–7409 (2017). [63] Vainio, M. J., Puranen, J. S. & Johnson, M. S. Shaep: molecular overlay based on shape and electrostatic potential (2009). [64] Sastry, G. M., Dixon, S. L. & Sherman, W. Rapid shape-based ligand alignment and virtual screening method based on atom/feature-pair similarities and volume overlap scoring. Journal of chemical information and modeling 51, 2455–2466 (2011). [65] Liu, X., Jiang, H. & Li, H. Shafts: a hybrid approach for 3d molecular similarity calculation. 1. method and assessment of virtual screening. Journal of chemical information and modeling 51, 2372–2385 (2011). [66] Hu, J., Liu, Z., Yu, D.-J. & Zhang, Y. Ls-align: an atom-level, flexible ligand structural alignment algorithm for high-throughput virtual screening. Bioinformatics 34, 2209–2218 (2018). [67] Niyongabo Rubungo, A., Arnold, C., Rand, B. P. & Dieng, A. B. Llm-prop: predicting the properties of crystalline materials using large language models. npj Computational Materials 11, 186 (2025). [68] Dana, J. M. et al. Sifts: updated structure integration with function, taxonomy and sequences resource allows 40-fold increase in coverage of structure-based annotations for proteins. Nucleic Acids Research 47, D482–D489 (2019). [69] Berman, H. M. et al. The protein data bank. Nucleic Acids Research 28, 235–242 (2000).
41
[70] Pubmed. https://pubmed.ncbi.nlm.nih.gov/ (2026). Accessed: 2026-06-21. [71] Pubmed central. https://www.ncbi.nlm.nih.gov/pmc/ (2026). Accessed: 2026-06-21. [72] Varadi, M. et al. Alphafold protein structure database: massively expanding the structural coverage of protein-sequence space with high-accuracy models. Nucleic Acids Research 50, D439–D444 (2022). [73] Su, J. et al. Saprot: Protein language modeling with structure-aware vocabulary (2024). [74] Steinegger, M. & Söding, J. Mmseqs2 enables sensitive protein sequence searching for the analysis of massive data sets. Nature biotechnology 35, 1026–1028 (2017). [75] Kshirsagar, M. et al. Rapid and accurate prediction of protein homo-oligomer symmetry using seq2symm. Nature Communications 16, 2017 (2025). [76] Wu, Z. et al. Moleculenet: a benchmark for molecular machine learning. Chemical science 9, 513–530 (2018). [77] Huang, K. et al. Therapeutics data commons: Machine learning datasets and tasks for drug discovery and development. Advances in neural information processing systems (2021). [78] Polykovskiy, D. et al. Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models. Frontiers in Pharmacology (2020). [79] NVIDIA et al. Nvidia nemotron nano 2: An accurate and efficient hybrid mamba-transformer reasoning model (2025). URL https://arxiv.org/abs/2508.14444. arXiv:2508.14444. [80] Olmo, T. et al. Olmo 3 (2025). URL https://arxiv.org/abs/2512.13961. arXiv:2512.13961. [81] Su, E. et al. Sciif: Benchmarking scientific instruction following towards rigorous scientific intelligence. arXiv preprint arXiv:2601.04770 (2026). [82] Yang, A. et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388 (2025). [83] Sennrich, R., Haddow, B. & Birch, A. Neural machine translation of rare words with subword units 1715–1725 (2016). [84] Gage, P. A new algorithm for data compression. The C Users Journal 12, 23–38 (1994). [85] Xiao, H. et al. An invertible, invariant crystal representation for inverse design of solid-state materials using generative deep learning. Nature Communications 14, 7027 (2023). [86] Yu, Q. et al. Dapo: An open-source llm reinforcement learning system at scale. Advances in Neural Information Processing Systems 38, 113222–113244 (2026). [87] Bogard, N., Linder, J., Rosenberg, A. B. & Seelig, G. A deep neural network for predicting and engineering alternative polyadenylation. Cell 178, 91–106 (2019). [88] Wang, Y., Wang, J., Cao, Z. & Barati Farimani, A. Molecular contrastive learning of representations via graph neural networks. Nature Machine Intelligence 1–9 (2022). [89] Dalla-Torre, H. et al. Nucleotide transformer: building and evaluating robust foundation models for human genomics. Nature Methods 22, 287–297 (2025). [90] Suresh, V., Liu, L., Adjeroh, D. & Zhou, X. Rpi-pred: predicting ncrna-protein interaction using sequence and structural information. Nucleic acids research 43, 1370–1379 (2015). [91] Zhang, Y. et al. Multiple sequence alignment-based rna language model and its application to structural inference. Nucleic acids research 52, e3–e3 (2024). [92] Almagro Armenteros, J. J., Sønderby, C. K., Sønderby, S. K., Nielsen, H. & Winther, O. Deeploc: prediction of protein subcellular localization using deep learning. Bioinformatics 33, 3387–3395 (2017).
42