ElectroChemLLM: A Multimodal LLM Pipeline for High-Fidelity Electrochemical Informatics
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
arXiv:2611.00638v1 [cs.CL] 31 Oct 2026
ElectroChemLLM: A Multimodal LLM Pipeline for High-Fidelity Electrochemical Informatics Dikshya Mohanty2† , Manoj Praveen Nandigama2† , Kuldeepsinh Raj1 , Sourav Kanti Maiti1 , Jiannan Yang2 , Ruiqi Luo2 , Srinivasa Phani Madhav Marupudi2 , Mounika Geriki2 , Prayag Raghunandan4 , Puneet Lingutla2 , Tengfei Ma3 , Niranjan Balasubramanian2 , Nav Nidhi Rajput1* 1*
Dept. of Materials Science and Chemical Engineering, Stony Brook University. 2 Dept. of Computer Science, Stony Brook University. 3 Dept. of Biomedical Informatics, Stony Brook University. 4 Dept. of Materials Engineering, Indian Institute of Technology Jodhpur.
*Corresponding author(s). E-mail(s): navnidhi.rajput@stonybrook.edu; Contributing authors: dimohanty@cs.stonybrook.edu; manojpraveen.nandigama@stonybrook.edu; † These authors contributed equally to this work. Abstract Electrochemistry is central to solving many modern-day challenges, including energy storage systems for a sustainable future, and its advancement relies heavily on the data from past findings. Existing automated pipelines are limited by text-only architectures, context fragmentation, and numerical hallucinations - collectively preventing accurate, large-scale curation of property databases. We introduce ElectrochemLLM, a multimodal information extraction pipeline that jointly identifies structured electrochemical records encompassing electrolyte compositions, electrode materials, cell configurations, and their measured physicochemical properties from unstructured scientific PDFs at scale. By combining hybrid document parsing with vision-capable LLM orchestration, the pipeline extracts verifiable, structured data across text, tables, and figures. Evaluated on the battery-electrolyte subset of our manually annotated benchmark of 232 papers, ElectrochemLLM achieves an F-1 score of 0.97, and has been applied to curate ElectroChemDB, a structured database spanning 15,000 electrochemical research articles. We demonstrate the utility of this resource by
1
training machine learning models for electrolyte property prediction, illustrating a complete pathway from unstructured literature to predictive materials discovery. Keywords: Large Language Models, Electrolyte Informatics, Knowledge Base Construction, Scientific Document Understanding
1 Introduction Electrochemical technologies (next-generation battery electrolytes and CO2 electroreduction catalysts) are fundamental to the global transition towards long-term sustainable and carbon-neutral storage and chemical synthesis solutions. Designing such high-performance electrolytes, whether for lithium-ion, solid-state, or flow battery systems, requires precise and extensive knowledge of physicochemical properties such as ionic conductivity, electrochemical stability window, viscosity, and Coulombic efficiency, and how to achieve them. Similarly for CO2 electro-reduction, advances rely on identifying electrolyte compositions that maximize Faradaic efficiency and product selectivity under feasible conditions [1]. In both cases, the design process begins with prior work. The relevant experimental data and corresponding conditions have been reported, but they remains largely siloed and often inaccessible, buried in unstructured text, tables, and figures from a scientific literature base that now exceeds five million articles and continues to grow at an exponential rate [2]. Manually curating such a corpus is impractical – while expert annotation achieves high fidelity, given the scale of the literature, this is expensive and time consuming. Existing curated databases cover only a narrow fraction of published experimental data. Automated text-mining is an established alternative [3]. ChemDataExtractor [4] provides extensible NLP pipelines for extracting chemical entities and properties from text, but requires task-specific models for new domains, and BatteryDataExtractor [5] extends text-based extraction to battery materials by combining BatteryBERT [6] models with question-answering methods to recover material–property relationships. Encoders pre-trained on scientific text, such as SciBERT [7], MatBERT [8], and MaterialsBERT [9], improve named entity recognition and relation classification over general-purpose models [10, 11]. Domain-adapted large language models (LLMs) such as LLaMat [12] and OmniScience [13] have extended this approach to broader range of materials science tasks such as structured extraction and scientific reasoning. However, these architectures are inherently text-only and share a critical limitation – the quantitative property values most relevant for database curation are often reported only in figures, or in tables whose structures is lost on conversion to text, and so they lie largely beyond the reach of test-based models. Multimodal LLMs have begun to close this gap, and are being applied beyond text to heterogeneous scientific imagery: Li and Jain [14] diagnose visible, electroluminescence and infrared photovoltaic images with a single prompt-driven pipeline and no modality-specific retraining, returning structured outputs with confidence and rationale. While their task is classification, the capabilities of LLMs are now being
2
extended to read figures and tables. Moreira-Filho et al. [15] pair document-parsing tools with LLMs in a low-code KNIME workflow with separate text and image extraction modes, but the workflow is domain-agnostic, requiring the mode to be chosen per document, and outputs structured JSON without the chemistry-aware standardization required for a machine-learning-ready property database. MERMaid [16] applies vision-language models to figures, tables and captions to build knowledge graphs and has so far been demonstrated only on reaction mining. In the battery domain, LLMB [17] combines hierarchical LLM-based text mining with graph to extract lithium-metal-battery compositions and cycling data, but is limited to this specific battery chemistry and focuses on complete cells and cycling curves rather than formulation-level electrolyte properties. Table 1 summarises the capabilities and limitations of these approaches relative to ElectroChemLLM. None of the existing systems combine multimodal extraction with chemistry-aware standardisation at the level of electrolyte formulations and their measured properties. Another issue with existing extraction pipelines is context fragmentation i.e. PDF text is processed at a sentence- or paragraph-level processing to manage context window limits. This breaks the hierarchical associations inherent to scientific documents, where an electrolyte introduced in one section may only acquire its measured property value in a results table several pages later. ChemDataExtractor and BatteryDataExtractor process isolated text spans and cannot link an entity to properties introduced elsewhere in the document. More recent LLM-based frameworks reason over larger bodies of knowledge. JRLKG [18] builds a knowlegde graph from the battery literature and prompts GPT-4 to reason jointly over it when predicting material properties, and (LLaMP) [19] uses hierarchical agents to answer questions against materials projects. Both are built for prediction and question answering, rather than data curation. Further these generative architectures introduce a distinct failure mode: numerical hallucinations, where the model produces plausible but fabricated quantitative values. For large-scale, reliable curation of a composition and property database, explicit grounding mechanisms therefore need to be designed: systematic benchmarking the extraction accuracy and traceability of extractions to the sources’ exact section, table or figure. These limitations are compounded by problems specific to the electrochemical literature. Reporting conventions vary substantially across research groups and journals – the same property can be expressed under different terminology, measured under different conditions, or reported at different levels of specificity. Electrolyte compositions are also more challenging to extract and parse than electrode materials. Cathode and Anode values are usually stated as single entities, whereas electrolyte formulations are inherently multi-component, comprising salts, solvents, and additives whose concentrations, ratios, and identities may be omitted, implied by reference to prior work, or described only partially. Linking such an entity to its measured properties is impossible without context from the rest of the document. Unit ambiguities are another source of error: conductivity values may appear in S/cm, mS/cm, or µS/cm without explicit conversion. These factors are even more pronounced for CO2 electroreduction, where reporting of cell configurations, reference electrodes, and product selectivity is far less standardized than in the battery community - so even a pipeline
3
with strong NER [20] and relation extraction can produce a structurally inconsistent database unless explicit mechanisms handle reporting heterogeneity at the document level, which makes cross-paper standardization and post-processing a prerequisite for any database intended for downstream machine learning tasks.
Fig. 1 ElectroChemLLM workflow for constructing ElectroChemDB. Scientific PDFs are parsed into multimodal document representations comprising text, figures, and tables. Prompt-guided large language models aggregate information across modalities to extract complete electrolyte compositions (salts, solvents, additives, and concentrations), electrode and cell-chemistry information, physicochemical properties, and electrochemical performance metrics. Extracted records are standardised using external chemistry tools and databases, verified by domain experts, and consolidated into ElectroChemDB, enabling downstream machine-learning tasks including property prediction and materials discovery.
To address these challenges, we introduce ElectroChemLLM, an end-to-end, multimodal, schema-driven pipeline that extracts complete electrolyte compositions, electrode and cell information, physicochemical properties, and electrochemical performance metrics from unstructured electrochemical literature. Our pipeline addresses each of the limitations in prior work: it reads text, tables, and figures jointly to overcome multimodal blindness, processes each paper as a whole to avoid context fragmentation, grounds every extracted value in its source location so that numerical hallucination becomes auditable, and standardises chemistry, units, and conditions so that heterogeneous reporting becomes a consistent, machine learning ready dataset. The pipeline combines a hybrid document parser—S2ORC-Grobid [21] for full text and section structure, Docling’s [22] TableFormer for table reconstruction, and a fine-tuned YOLO [23] detector for sub-panel-level figure localisation—with a visioncapable LLM-based summariser that translates each figure and table into a textual representation that travels alongside the body text. The full document context is then passed to an extraction LLM, which is constrained by an explicit JSON schema, designed in collaboration with domain experts, that defines target properties and their associated metadata. Attributing each generated statement to an identified source makes it verifiable [24], and selecting the supporting span before generating improves attribution accuracy and reduces human verification effort [25]. In materials
4
Capability Heterogeneous PDF ingestion Full-document contextual extraction Table extraction Figure understanding Structured property schema Chemical and unit normalisation Field-level source provenance Automated database construction Broad electrolyte-property scope
ElectroChem Direct LLM LLM CDE BDE MERMaid LLMB ∼ ∼ ✗ ✗ ✓ ∼ ∼ ✓ ∼
✓ ✓ ∼ ∼ ✓ ∼ ∼ ∼ ∼
✗ ∼ ✗ ✗ ✓ ∼ ∼ ✓ ∼
✓ ✓ ✓ ✓ ✓ ∼ ∼ ✓ ✗
∼ ✓ ✗ ✓ ✓ ✓ ✓ ✓ ∼
✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
✓ indicates native support; ∼ indicates partial, task-specific, or implementation-dependent support; and ✗ indicates no support. CDE and BDE denote ChemDataExtractor and BatteryDataExtractor, respectively. Table 1 Capability comparison of direct multimodal LLM extraction, ChemDataExtractor 2.0 [4, 27], BatteryDataExtractor [5], MERMaid [16], LLMB [17], and ElectroChemLLM.
extraction specifically, Polak et al. [26] show that source attribution supresses fabricated entries. Applying the same principle to data curation: every extracted value is recorded with the section, table or figure it was taken from and check against it. This enables fabricated or misattributed values to be traced back to its source and flagged during verification. The resulting outputs are passed through an extensive chemistry-aware standardisation pipeline that reconciles heterogeneous chemical names, aliases, formulations, property labels, units, and measurement metadata into a consistent representation. This layer combines automated name resolution, canonical structure assignment, rule-based unit conversion, consistency checks, and targeted expert review for ambiguous or unresolved records. This pipeline is deliberately modular and schema-driven, i.e., target properties can be added or restructured, new electrochemical subdomains incorporated, and the extraction LLM swapped out, all without modifying the rest of the architecture. We evaluate our pipeline’s extractions on a manually extracted subset of 232 papers. ElectroChemLLM achieves an F-1 score of 0.97, outperforming both text-only baselines and prior extraction pipelines. Applied to a corpus of ∼15,000 articles spanning battery electrolytes and CO2 electro-reduction, the pipeline produces ElectroChemDB—a standardized, queryable property database that we further use to train downstream ML models that predict cell-level specific capacity from extracted electrolyte, electrode, and test-condition fields, demonstrating a complete pathway from unstructured literature to predictive materials models. By converting literature that is largely locked in unstructured, multimodal documents into a standardised, provenance-linked and machine-readable resource, ElectroChemDB is intended to increase the value that can be derived from existing scientific data and to make it findable, interoperable and ready for AI-enabled discovery. The rest of the paper is organised as follows: Section 2 outlines our design goals and the ElectrochemLLM pipeline, with component details in Appendix A. Section 3 includes our experimental setup, end-to-end extraction performance, database coverage analysis, and a downstream property-prediction case study (component-level and judge-based evaluation details are in Appendix B), followed by conclusions in Section 4.
5
2 Methods To effectively extract information from full-text PDFs, with high fidelity and coverage across multiple modalities, we identified a set of desiderata that our framework must satisfy. First, since quantitative property values are distributed non-uniformly across the narrative text, tables, and figures, the parser must achieve “modality completeness”—i.e., accessing and collecting information from all the available content types—as any pipeline restricted to text or figures alone would omit a substantial fraction of reported data. The framework must therefore recover all available content types while preserving their internal structure, including the unit annotations that disambiguate values reported in varying conventions (e.g., conductivity in S/cm, mS/cm, or µS/cm; diffusion coefficients in cm2 /s or m2 /s). Furthermore, the framework must demonstrate robustness when applied to CO2 reduction literature. Second, as a consequence of our first goal and given the nature of how information is distributed throughout the paper, it’s important to track the origin/grounding of the extracted text–in order to maintain transparency and enable validation/evaluation. Hence, our framework should annotate each extracted element to its source location (section, table, figure). Third, we want our framework to be able to unify information across multiple segments/modals–electrolyte entities are frequently introduced in one section, and characterized quantitatively across several pages/figures. Our framework must retain section hierarchy and cross-references, rather than emitting disconnected fragments— preserving hierarchical associations that sentence- and paragraph level frameworks often miss. Lastly, scalability and generalizability—our framework should be able to process tens of thousands of heterogeneous PDFs, spanning decades of typesetting conventions and publisher formats, within a compute budget compatible with downstream LLM inference costs. Beyond scale, it should also generalize across electrochemical subdomains—extending from battery electrolytes to adjacent use cases such as CO2 electro-reduction—without requiring domain-specific re-engineering of the parsing or extraction stages. Satisfying all four of these desiderata simultaneously is challenging–no single offthe-shelf parser recovers text, tables, and figures with the fidelity and grounding we need at scale. Hence, we designed a hybrid, multi-stage pipeline that decouples parsing along content-type boundaries, and delegates reasoning to a vision-capable LLM orchestrated through deterministic function calls. Our parsing framework decouples extraction along content-type boundaries – routing each modality through the tool best suited to handle it, and recombining the outputs into a unified document-level representation. Full article text is recovered via S2ORC-Grobid [21], while tables and figures are processed in parallel by Docling’s [22] TableFormer and a fine-tuned YOLO [23] detector respectively. Each extracted element is tagged with its source location, and the parallel outputs are recombined into a single payload that is passed to the downstream vision-capable LLM stage. The pipeline relies only on open-source components and requires no publisher- or domain-specific tuning–supporting scalability and generalizability across electrochemical subdomains. We discuss each component separately in Appendix A. 6
3 Results 3.1 Experimental Setup Benchmark. We evaluate ElectroChemLLM on a manually annotated benchmark of 232 papers spanning two electrochemical domains: 121 battery-electrolyte papers (526 electrolyte entries and 9,849 claims across 14 fields) and 111 CO2 electroreduction papers (1,160 electrolyte entries). To ensure high annotation quality, we further investigate the interannotator agreement: a randomly selected subset of 50 records was independently annotated by two reviewers, yielding 95% agreement and a Cohen’s κ of 0.90. For benchmarking the performance of our ElectroChemLLM pipeline against prior extraction pipelines and closed-source models, we use the subset of 121 battery-electrolyte papers. Baselines & Evaluation Metrics. We compare ElectroChemLLM against three categories of baselines: (a) established data-extraction frameworks, namely ChemDataExtractor2 [4, 27], configured with ten custom electrolyte models, and BatteryDataExtractor [5], evaluated on its five supported properties; (b) the open-source model ChemLLM-20B-SFT [28]; and (c) the closed-source multimodal models Gemini-2.5-Flash [29], Gemini-3.6-Flash [30], and GPT-4o [31], applied directly to the original PDFs. The direct-PDF models receive the same extraction instructions and output schema as ElectroChemLLM, but without document parsing or visual summarization. The existing frameworks and the open-source model are evaluated using text extracted with GROBID. The LLM baselines are evaluated on the complete 14-field schema, whereas the established frameworks are evaluated only on their supported fields. Therefore, their scores represent performance within their respective extraction scopes. Gemini-3.5-Flash [32] compares the extracted records with the human-annotated ground truth through separate precision and recall passes. Precision, recall, and F1 are computed at the claim level, with matches required to belong to the same electrolyte formulation. Further implementation details and the complete judge prompt are provided in Appendix B.
3.2 End-to-End Property Extraction Performance Table 2 presents the end-to-end property-extraction performance of ElectroChemLLM against the manually annotated benchmark. We report precision, recall, and F1 score for the complete pipeline and the selected baselines. As shown in Table 2, ElectroChemLLM with Gemini-2.5-Flash achieves the best overall performance, with an F1 score of 0.97, compared with 0.57 for direct-PDF extraction. The GPT-4o configuration achieves an F1 score of 0.64, while ChemLLM-20B-SFT reaches 0.50. The prior extraction pipelines obtain lower scores on their supported property subsets, highlighting the advantage of schema-guided LLM extraction. Property-level performance is consistently high (Table B4), with a micro-average F1 of 0.97. The highest scores are for fields that are stated explicitly and in a consistent form (solvents,
7
Configuration
Precision
Recall
F1
Prior Extraction Pipelines BatteryDataExtractor† ChemDataExtractor†
0.18 0.37
0.14 0.28
0.16 0.32
LLM Baselines ChemLLM-20B-SFT GPT-4o (Direct PDF) Gemini-2.5-Flash (Direct PDF) Gemini-3.6-Flash (Direct PDF)
0.57 0.75 0.43 0.66
0.45 0.44 0.85 0.74
0.50 0.55 0.57 0.70
ElectroChemLLM GPT-4o Gemini-2.5-Flash
0.79 0.94
0.53 0.98
0.64 0.97
Table 2 End-to-end property-extraction performance on the 121-paper benchmark. Direct-PDF models receive the original PDFs without the document-processing and visual-summarization components of ElectroChemLLM. † Because the prior extraction pipelines support only specific property types, their results are calculated on the corresponding restricted property subsets; the LLM-based systems are evaluated on the complete output schema.
99.55; salts, 98.61; cathode and anode, 98.47), whereas the weakest are overpotential (90.42), pH (90.91), additives (93.28) and total electrolyte composition (94.37), which are reported in heterogeneous or partial forms (additives, total composition) or can only be interpreted with context such as the reference electrode or current density (overpotential). Taken together, these results indicate that most of the gain over direct-PDF prompting comes from the pipeline rather than from the choice of LLM: with the same Gemini-2.5-Flash backbone, parsing, figure and table summarisation and schema-constrained, source-grounded extraction raise F1 from 0.57 to 0.97, whereas prior text-only pipelines reach only 0.16–0.32 on the properties they support. The smaller gain with GPT-4o (0.55 to 0.64) suggests that the backbone still matters, and the remaining errors concentrate on a mismatch between number of retrieved rows w.r.t. the ground truth. GPT-4o run variants are not able to match the ground truth’s row granularity, consistently merging multiple reported conditions (such as a concentration or current-density series) into a single entry regardless of input pipeline, which caps precision and recall independent of parsing quality. In throughput terms,Gemini-2.5-Flash with ElectroChemLLM pipeline processes roughly 2.3 papers per cent spent, compared with 0.53 for Gemini-3.6-flash directPDF, 0.41 for Gemini-2.5-Flash direct-PDF, and 0.12–0.23 for GPT-4o – resulting in a 10- to 20-fold cost advantage alongside its higher F1 score. We also evaluate the text-extraction, figure-localisation, and image-summarisation components individually. The figure-localisation model achieves 91% accuracy, while the summarisation evaluation identifies coverage as the principal limitation. Coverage (1.8 out of 3) scores below accuracy (2.4) and faithfulness (2.7), i.e., the figure summaries are mostly correct but not exhaustive, so the dominant risk is that a value plotted in a figure is missed (lower recall) and not misreported (lower precision), consistent with the lower scores on fields such as overpotential that are often reported graphically. Full experimental details and results are reported in Appendix B.
8
Statistic
Value
Total papers processed Battery electrolytes CO2 electroreduction
232 121 111
Total electrolyte entries Battery electrolytes CO2 electroreduction
1,686 526 1,160
Unique salts (names) Unique solvents (names) Unique additives (names)
177 110 152
% entries with ≥1 quant. property % entries with full composition
98.0% 89.7%
Table 3 Summary statistics for the manually validated benchmark subset of ElectroChemDB used for evaluation, comprising battery electrolyte and CO2 electroreduction records with unit-standardised compositions and properties.
3.3 ElectroChemDB: Coverage and Distribution Having established the extraction performance of ElectroChemLLM, we characterise the benchmarked subset of ElectroChemDB. It contains 1,686 standardised electrolyte entries from 232 papers, including 121 battery-electrolyte and 111 CO2 electroreduction papers (Table 3). Overall, 89.7% of entries contain complete composition information, and 98.0% contain at least one quantitative property. (a) Records per class
(b) Distinct compositions
4,859 / 10,145 (24.5%)
aqueous
6,809
9,873 / 15,818 (38.2%)
organic
11,247
4,642 / 6,509 (15.7%)
solid-state
4,772
4,987 / 8,940 (21.6%)
unknown (excluded) 0
10,000
20,000
Number of records
4,774
0
5,000
10,000
Number of distinct compositions
Fig. 2 Distribution of records and distinct electrolyte compositions by electrolyte class in the full battery-electrolyte corpus (41,144 records). (a)Records per class: The solid segment counts records with at least one of five properties (two electrolyte properties, ionic conductivity and viscosity, and three cell-level performance metrics that depend on both electrolyte and electrodes: cycle life, Coulombic efficiency and specific capacity) within its plausible physical range; the pale segment is the remainder. Labels give usable/total records and the class’s share of all records. (b)Number of distinct electrolyte compositions per class. unknown class shows unmapped compositions.
The battery-electrolyte corpus comprises 41,412 records from around 11k articles: the 41,412 rows produced by the unit-conversion pipeline. We assign each record to one of four electrolyte classes from its composition text (Fig. 2). Organic electrolytes dominate (38.4%), followed by aqueous (24.7%) and solid-state (15.8%) systems. The 9
remaining 21% records could not be assigned a class and are excluded from all subsequent analyses. Between 47.9% (aqueous) and 71.3% (solid-state) of each class’s records carry at least one property value that survives range screening. The number of distinct compositions closely tracks the record count for the three named classes (67.1–73.3% of records are distinct), so the class statistics below are not driven by a few formulations reported many times. The unknown class is the exception, with only 55.1% distinct compositions. Organic and aqueous electrolytes together account for 63.1% of all records, in line with the dominance of liquid electrolytes in the battery literature, whereas solid-state systems are a minority of records (15.8%) but have the highest share with a usable property value (71.3%), plausibly because ionic conductivity is the headline figure of merit in that literature. Property Coverage and Chemical Diversity.
Fig. 3 Number of values per property and electrolyte class in the full battery-electrolyte corpus, after removing values outside each property’s plausible physical range. Excludes unknown class.
Property coverage is uneven across classes (Fig. 3). Organic electrolytes have the most values for every property except ionic conductivity, where solid-state systems are slightly ahead (3,602 vs. 3,504 values). Specific capacity is the best-covered property, with up to 5,622 values for organic electrolytes. Viscosity is the sparsest, with only 27 solid-state values, so viscosity comparisons involving solid-state systems should be read with caution. Figure 4 shows the distribution of each property by class in physical units. First, ionic conductivity separates the classes most clearly. Aqueous electrolytes have the highest median (21.3 mS cm−1 ; interquartile range 3.9–73.5), followed by organic (1.5 mS cm−1 ) and solid-state systems (0.38 mS cm−1 ). This ordering matches the literature: moderately concentrated acidic and alkaline aqueous electrolytes (e.g., KOH, H2 SO4 ) routinely exceed 100 mS cm−1 , whereas ultra-concentrated water-insalt formulations fall to about 10 mS cm−1 [33], and most polymer and oxide solid
10
Fig. 4 Distributions of cycle life, ionic conductivity, Coulombic efficiency, specific capacity and viscosity by electrolyte class in the full battery-electrolyte corpus. Boxes span the interquartile range, the thick line marks the median, and whiskers extend to the 5th and 95th percentiles. All axes are logarithmic except Coulombic efficiency.
electrolytes fall well below 1 mS cm−1 at room temperature, with only a few sulfide conductors reaching liquid-like values ( [34], [35]). The organic median lies below the ∼10 mS cm−1 typical of carbonate electrolytes [36, 37] because the class also contains ionic-liquid, gel, and highly concentrated formulations and measurements below room temperature. Second, aqueous systems report the longest and most widely spread cycle life (median 500 cycles; interquartile range 100–2,000), compared with 130 and 120 cycles for organic and solid-state electrolytes. This likely reflects the many aqueous zinc and high-rate cells cycled for thousands of cycles. Because cycle life depends on rate, depth of discharge, and the end-of-life criterion, which differ between papers, these values are indicative rather than strictly comparable. Third, Coulombic efficiency medians are similar across classes (98–99%), but the aqueous distribution has a much longer low-efficiency tail (5th percentile 38%, against 63% for organic and 70% for solid-state electrolytes). This is consistent with the narrow electrochemical stability window of water, where hydrogen evolution and electrode corrosion consume charge. The wide ranges on logarithmic axes reflect the diversity of chemistries and measurement conditions, and the number of values behind each box is given in Fig. 3. While the extracted data show trends consistent with the electrochemical literature, comparisons across electrolyte classes need some caution. Properties such as ionic conductivity and cycle life depend on composition, temperature, and testing conditions, which vary considerably between studies. The distributions also reflect what has been reported in the literature, including a bias toward successful results, rather than the full range of performance possible for each electrolyte class. Source Provenance. Each database entry retains its source modality and document location. Of all the successfully source tagged entries across all 15K papers, 66.2% draw on at least one table or figure: 58.6% combine text with tables or figures, and a further 7.6% come exclusively from a table (5.0%) or a figure (2.6%). As shown in Fig. 5, figures and graphs are by far the most frequently cited sources, followed by tables and abstracts. This
11
Fig. 5 Source provenance of ElectroChemDB records from the multimodal extraction run: 56,925 records from 15k papers, split into battery electrolytes (n = 40,261) and CO2 electroreduction (n = 16,664). (a) Distribution of records by source modality, as a percentage of each domain’s records. Mixed records draw their fields from more than one of text, tables and figures; table only and figure only records come entirely from a single table or figure. (b) The ten most frequently cited sources. Labels were normalized; numbered tables and figures were collapsed into Table and Figure / Graph.
highlights the importance of capturing information beyond the main text, particularly for properties that are primarity reported through plots and tables. The benefit of this approach is also reflected in the benchmark results, where ElectroChemLLM achieves an F1 score of 0.97, outperforming both text-only extraction pipelines and direct-PDF LLM extraction. Together, these results demonstrate the value of combining text, tables, and figures for large-scale electrochemical data extraction.
12
3.4 Downstream Application: Property Prediction
2
(b)
Random Forest
1
R² = 0.76 MAE = 0.24 n = 325
predicted log10 (S cm 1)
predicted log10 (S cm 1)
1
3 4 5 6
2
(c)
Ridge Regression
1
R² = 0.14 MAE = 0.45 n = 325
predicted log10 (S cm 1)
(a)
3 4 5
5
4
3
true log10 (S cm 1)
2
1
3 4 5 6
6 6
2
XGBoost R² = 0.79 MAE = 0.20 n = 325
6
5
4
3
true log10 (S cm 1)
(d)
2
1
6
5
4
3
true log10 (S cm 1)
2
1
(e)
Mixed (n=16) Mixed carbonate (n=209)
67.8%
Solvent chemistry
Other (n=13) Sulfoxide (n=3) Sulfone (n=7)
Temperature
Cyclic carbonate (n=31)
30.7%
Ionic liquid (n=10) Phosphate ester (n=12)
Temperature reported 1.5%
Linear carbonate (n=13) Glyme / ether (n=11) 6
5
4
log10 (S cm 1)
3
2
Fig. 6 ML readiness of the Li-ion electrolyte slice of ElectroChemDB, evaluated on ionic conductivity. (a–c) In-sample parity plots for (a) Random Forest, (b) Ridge regression, and (c) XGBoost on concentration-weighted ECFP composition features; the dashed line indicates y = x, and the shaded band corresponds to ±0.5 log10 units. (d) log10 σ by solvent class (n ≥ 3, ordered by descending median). (e) Random Forest feature importance aggregated by descriptor type across the top 20 features.
3.4.1 ML utility of ElectroChemDB. A core motivation for ElectroChemDB is that the curated, standardised entries should be directly consumable by downstream ML pipelines for materials discovery. Unlocking the value of the published literature for AI-enabled discovery requires data that are standardised, linked to their measurement context, and ready for use without further manual curation. We test this with a case study that predicts cell-level specific capacity, the best-covered of the five screened properties (Fig. 3), for Li-ion and Li-metal cells separately. The case study asks two questions: whether models trained directly on records extracted by ElectroChemLLM learn a non-trivial relationship between a cell’s description and its measured capacity, and which parts of that description carry the signal. All results below are out-of-fold predictions for entries the model did not see during training.
3.4.2 Dataset and representation. We use the Li-ion and Li-metal battery records of ElectroChemDB, split by the negative electrode (graphite or Si versus Li foil) and modelled separately. Extracted formulations are first converted to a common molar-concentration basis (mol L−1 ), while the original reported composition and component-specific conversion status
13
are retained; the conversion rules, assumptions and coverage statistics are given in Appendix A.5.3. After strict, rule-based cleaning, which removes every row that has a component that cannot be mapped to a validated SMILES, the sets contain 970 Li-ion entries (480 papers, 191 distinct formulations) and 1,116 Li-metal entries (580 papers, 228 distinct formulations). The prediction target is the base-10 logarithm of the reported specific capacity, which spans roughly three orders of magnitude (Fig. 6). These records are LLM-extracted and have no human-annotated reference, so the case study tests whether the database can be used as delivered, not whether it reproduces curated labels. Each entry is described by three groups of inputs. (i) Electrolyte composition: a 2048-bit Morgan/ECFP fingerprint (radius 2; Rogers and Hahn 2010) is computed for every component, and the per-component fingerprints are aggregated within role by concentration-weighted averaging, with additives included as extra components. The resulting vector has the same length regardless of recipe size, so multi-component electrolytes (e.g., EC + DMC + DEC + EMC + LiPF6 ) and single-component formulations share one feature space. (ii) Electrode information: total salt concentration, number of additives, and anode and cathode class (31 features). (iii) Test conditions: current density, C-rate, areal capacity, cycle number, cell configuration and voltage window (18 features). Groups (ii) and (iii) are stored alongside each formulation in ElectroChemDB, which is what allows them to be used here without further extraction.
3.4.3 Models and validation. We compare three standard regression models, Random Forest (RF), Ridge Regression and XGBoost [38–40], with a pretrained graph neural network (GNN) [41, 42] that receives the same electrode and test-condition features at its prediction head. The classical models use identical inputs. Performance is assessed only out of fold, with 5-fold cross-validation over shuffled rows, so that every point in Fig. 6 is a prediction for an entry the model did not see during training; in-sample fits, which overstate performance, are not used. The classical models are repeated with five different shuffles; the GNN is run once, on the folds of the first repeat, which is the repeat plotted. We report the coefficient of determination R2 and the mean absolute error (MAE) in log10 units (definitions in Section 5.1). Because the target is logarithmic, an MAE of 0.17 corresponds to a typical error of about a factor of 1.5 in the capacity itself. Two further tests probe what the models have learned: an electrolyte-only variant, which isolates how much signal comes from the formulation, and a grouped split in which every formulation is confined to a single fold, which tests generalisation to unseen electrolytes.
3.4.4 Predictive performance. Cross-validated accuracy. With electrolyte, electrode and test-condition inputs, XGBoost and RF reach R2 = 0.735 and 0.726 on Li-ion (MAE = 0.173 in log10 units), ahead of the GNN (R2 = 0.645, MAE = 0.201) and Ridge (R2 = 0.562, MAE = 0.247) (Fig. 6). On Li-metal, XGBoost, RF and the GNN reach R2 = 0.500, 0.497 14
and 0.469 (MAE = 0.152–0.157), and Ridge 0.352 (MAE = 0.197). Averaged over the five shuffles, RF and XGBoost give R2 = 0.71 and 0.72 on Li-ion and 0.51 and 0.52 on Li-metal, so the repeat plotted in Fig. 6 is representative. On Li-ion cells (top row of Fig. 6), the tree-based models follow the parity line over most of the range, while Ridge shows visibly wider scatter. On Li-metal cells (bottom row), the scatter is larger for every model and predictions are pulled toward the centre of the distribution: the highest reported capacities (log10 above about 3.3) are underpredicted and the lowest are overpredicted. Li-metal is also harder to rank (R2 about 0.50 versus 0.74 for Liion) even though its absolute error is slightly smaller (MAE about 0.15 versus 0.17), which implies a narrower spread of capacities, so that the same error explains less of the variance. The tree-based models outperform Ridge by about 0.15–0.17 in R2 on both chemistries, consistent with a non-linear dependence of capacity on the interplay between electrode, current density and cycling conditions. The pretrained GNN does not outperform the tree-based models (0.645 versus 0.735 on Li-ion; 0.469 versus 0.500 on Li-metal); with only 191 and 228 distinct formulations, a plausible reason is that there is little for a learned electrolyte representation to exploit.
Fig. 7 Out-of-fold predictions of log10 specific capacity for Li-ion (top) and Li-metal (bottom) cells. Columns show Random Forest, Ridge, XGBoost, and a pretrained GNN using electrolyte, electrode, and test-condition inputs. Each panel reports R2 and MAE (in log10 units) for the first of five crossvalidation repeats, with n the number of entries; dashed lines indicate perfect agreement. Both axes show log10 of the reported specific capacity; each point is one extracted entry, predicted by a model that did not see it during training. GNN, pretrained graph neural network.
3.4.5 Effects of input features and generalisation. Using electrolyte composition alone, the models achieve R2 = 0.17–0.38 on Li-ion and 0.20–0.28 on Li-metal cells. Further adding the electrode and test-condition fields raises the best scores to 0.735 and 0.500 respectively. Since a reported capacity depends on the active materials, current density, voltage window and cycle number at least as
15
much as on the electrolyte, retaining this information adds value to ElectroChemDB for downstream property prediction. The random cross-validation results aloow the same electrolyte formulation to apprear in both training and test sets. When formulations are kept separate across folds, we observe limited predictive performance, with electrolyte-only R2 ranging from −0.07 and 0.04. This reflects the diversity of electrolyte compositions and reported property ranges across the literature, suggesting that substatially more data covering a wider range of formulations will be needed to generalise to unseen electrolytes. Overall, the results show that ElectroChemDB provides standardised, machinelearning-ready data without requiring additional manual curation beyond rule-based filtering. The case study also highlights the value of extracting electrolyte compositions together with electrode information and experimental conditions.
4 Conclusion We introduced ElectroChemLLM — a multimodal, end-to-end pipeline for extracting electrolyte chemical entities and their physicochemical properties from unstructured scientific literature. By combining hybrid document parsing with vision-capable LLM orchestration and a schema-driven extraction layer, the pipeline jointly addresses the three main limitations of prior work in this space - multimodal blindness, context fragmentation, and numerical hallucination. On a manually annotated benchmark of 232 papers, ElectroChemLLM achieves an F-1 score of 0.97 - substantially outperforming both text-only baselines and prior extraction pipelines. We applied the pipeline to a corpus of 15,000 articles spanning battery electrolytes and CO2 electroreduction, to construct ElectroChemDB — a standardised, queryable property database that we further use to train downstream ML models that predict cell-level specific capacity from extracted electrolyte, electrode and test-condition fields (out-of-fold R2 up to 0.735 for Li-ion and 0.500 for Li-metal cells) illustrating a complete pathway from unstructured literature to predictive materials models. ElectroChemLLM pipeline is modular by design, allowing new properties, electrochemical domains, and LLM backends to be incorporated without redesigning the overall workflow, making the pipeline adaptable to future data extraction tasks with minimal changes. Data & Code Availability. The source code and benchmark dataset compiled during this study, including our prompts, pipeline modules, CO2 reduction and Battery electrolytes properties, will be released publicly on GitHub. Acknowledgment. This work was supported by the National Science Foundation under Grant Nos. NSF CSSI-2514002 and NSF CBET 2505289, and by seed funding from Stony Brook University Institute of Advanced Computational Science. We thank George Mirgorodskiy and Maggie Li for their assistance with battery-papers benchmarking and Ray Zhang (St. George’s School, Vancouver, Canada), Yuanxi “Cici” Yao (Ho Chi Minh City, Vietnam) and Albert Huang (Saigon South International School) for their assistance with CO2 ER benchmarking.
16
References [1] Raj, K., Bliss, M., Nandigama, M. P. & Rajput, N. N. Data-driven molecular design rules for electrolytes in CO2 electroreduction. Cell Reports Physical Science 7, 103390 (2026). URL https://doi.org/10.1016/j.xcrp.2026.103390. [2] Deshsorn, K., Chavalekvirat, P., Deepaisarn, S., Chuang, H.-C. & Iamprasertkun, P. Historical data mining deep dive into machine learning-aided 2d materials research in electrochemical applications. ACS Materials Au 6, 28–56 (2026). URL https://doi.org/10.1021/acsmaterialsau.5c00030. [3] Xiang, J., Li, Y., Zhang, X., He, Y. & Sun, Q. Local large language modelassisted literature mining for on-surface reactions. Materials Genome Engineering Advances 3, e88 (2025). URL https://onlinelibrary.wiley.com/doi/abs/10.1002/ mgea.88. [4] Swain, M. C. & Cole, J. M. Chemdataextractor: A toolkit for automated extraction of chemical information from the scientific literature. Journal of Chemical Information and Modeling 56, 1894–1904 (2016). URL https://doi.org/10.1021/ acs.jcim.6b00207. PMID: 27669338. [5] Huang, S. & Cole, J. M. Batterydataextractor: battery-aware text-mining software embedded with bert models. Chemical Science 13, 11487–11495 (2022). [6] Huang, S. & Cole, J. M. Batterybert: A pretrained language model for battery database enhancement. J. Chem. Inf. Model. DOI: 10.1021/acs.jcim.2c00035 (2022). URL DOI:10.1021/acs.jcim.2c00035. [7] Beltagy, I., Lo, K. & Cohan, A. Scibert: A pretrained language model for scientific text (2019). URL https://arxiv.org/abs/1903.10676. arXiv:1903.10676. [8] Walker, N. et al. Quantifying the advantage of domain-specific pre-training on named entity recognition tasks in materials science. Patterns 3, 100488 (2022). [9] Shetty, P. et al. A general-purpose material property data extraction pipeline from large polymer corpora using natural language processing. npj Computational Materials 9, 52 (2023). URL https://doi.org/10.1038/s41524-023-01003-w. [10] Gupta, T., Zaki, M., Krishnan, N. M. A. & Mausam, M. Matscibert: A materials domain language model for text mining and information extraction. npj Computational Materials 8 (2022). [11] Song, Y., Miret, S. & Liu, B. Rogers, A., Boyd-Graber, J. & Okazaki, N. (eds) MatSci-NLP: Evaluating scientific language models on materials science language tasks using text-to-schema modeling. (eds Rogers, A., Boyd-Graber, J. & Okazaki, N.) Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 3621–3639 (Association for
17
Computational Linguistics, Toronto, Canada, 2023). URL https://aclanthology. org/2023.acl-long.201/. [12] Mishra, V. et al. Foundational large language models for materials research (2025). URL https://arxiv.org/abs/2412.09560. arXiv:2412.09560. [13] Prabhakar, V. et al. Omniscience: A domain-specialized llm for scientific reasoning and discovery (2025). URL https://arxiv.org/abs/2503.17604. arXiv:2503.17604. [14] Li, B. & Jain, A. A unified large language model-based framework for heterogeneous pv image diagnosis. SOLAR ENERGY 315 (2026). [15] Moreira-Filho, J. T. et al. Automating data extraction from scientific literature and general pdf files using large language models and knime: An application in toxicology. WIREs Computational Molecular Science 15, e70047 (2025). URL https://wires.onlinelibrary.wiley.com/doi/abs/10.1002/ wcms.70047. E70047 CMS-1201.R1. [16] Leong, S. X., Pablo-García, S., Wong, B. & Aspuru-Guzik, A. Mermaid: Universal multimodal mining of chemical reactions from pdfs using vision-language models. Matter 8, 102331 (2025). URL https://www.sciencedirect.com/science/article/ pii/S2590238525003741. [17] Lee, J. et al. Llmb: Ai agent for lithium metal battery research using large language model. ACS Central Science 12, 484 (2026). [18] Lei, G. et al. Material property prediction with joint reasoning based on large language models and knowledge graphs for lithium batteries (2024). [19] Chiang, Y., Chou, C.-H. & Riebesell, J. Llamp: Large language model made powerful for high-fidelity materials knowledge retrieval and distillation. arXiv preprint arXiv:2401.17244 (2024). [20] Jehangir, B., Radhakrishnan, S. & Agarwal, R. A survey on named entity recognition — datasets, tools, and methodologies. Natural Language Processing Journal 3, 100017 (2023). URL https://www.sciencedirect.com/science/article/ pii/S2949719123000146. [21] Lo, K., Wang, L. L., Neumann, M., Kinney, R. & Weld, D. Jurafsky, D., Chai, J., Schluter, N. & Tetreault, J. (eds) S2ORC: The semantic scholar open research corpus. (eds Jurafsky, D., Chai, J., Schluter, N. & Tetreault, J.) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 4969– 4983 (Association for Computational Linguistics, Online, 2020). URL https: //aclanthology.org/2020.acl-main.447/.
18
[22] Team, D. S. Docling technical report. Tech. Rep., IBM (2024). URL https: //arxiv.org/abs/2408.09869. 2408.09869. [23] Redmon, J., Divvala, S., Girshick, R. & Farhadi, A. You only look once: Unified, real-time object detection (2016). URL https://arxiv.org/abs/1506.02640. arXiv:1506.02640. [24] Gao, T., Yen, H., Yu, J. & Chen, D. Bouamor, H., Pino, J. & Bali, K. (eds) Enabling large language models to generate text with citations. (eds Bouamor, H., Pino, J. & Bali, K.) Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 6465–6488 (Association for Computational Linguistics, Singapore, 2023). URL https://aclanthology.org/2023.emnlp-main. 398/. [25] Slobodkin, A., Hirsch, E., Cattan, A., Schuster, T. & Dagan, I. Ku, L.-W., Martins, A. & Srikumar, V. (eds) Attribute first, then generate: Locally-attributable grounded text generation. (eds Ku, L.-W., Martins, A. & Srikumar, V.) Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 3309–3344 (Association for Computational Linguistics, Bangkok, Thailand, 2024). URL https://aclanthology.org/2024.acl-long.182/. [26] Polak, M. P. & Morgan, D. Extracting accurate materials data from research papers with conversational language models and prompt engineering. Nature Communications 15 (2024). URL http://dx.doi.org/10.1038/ s41467-024-45914-8. [27] Mavracic, J., Court, C. J., Isazawa, T., Elliott, S. R. & Cole, J. M. Chemdataextractor 2.0: Autopopulated ontologies for materials science. Journal of Chemical Information and Modeling 61, 4280–4289 (2021). URL https://doi.org/10.1021/ acs.jcim.1c00446. [28] Zhang, D. et al. arXiv:2402.06852.
Chemllm: A chemical large language model (2024).
[29] Google. Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities (2025). URL https://arxiv. org/abs/2507.06261. arXiv:2507.06261. [30] Google. Gemini 3.6 flash - model card (2026). URL https://storage.googleapis. com/deepmind-media/Model-Cards/Gemini-3-6-Flash-Model-Card.pdf. [31] OpenAI. Gpt-4o system card (2024). URL https://arxiv.org/abs/2410.21276. arXiv:2410.21276. [32] Google. Gemini 3.5 flash - model card (2026). URL https://storage.googleapis. com/deepmind-media/Model-Cards/Gemini-3-5-Flash-Model-Card.pdf.
19
[33] Suo, L. et al. “water-in-salt” electrolyte enables high-voltage aqueous lithium-ion chemistries. Science 350, 938–943 (2015). URL https://doi.org/10.1126/science. aab1595. [34] Kamaya, N. et al. A lithium superionic conductor. Nature Materials 10, 682–686 (2011). URL https://doi.org/10.1038/nmat3066. [35] Famprikis, T., Canepa, P., Dawson, J. A., Islam, M. S. & Masquelier, C. Fundamentals of inorganic solid-state electrolytes for batteries. Nature Materials 18, 1278–1291 (2019). URL https://doi.org/10.1038/s41563-019-0431-3. [36] Xu, K. Nonaqueous liquid electrolytes for lithium-based rechargeable batteries. Chemical Reviews 104, 4303–4418 (2004). URL https://doi.org/10.1021/ cr030203g. [37] Xu, K. Electrolytes and interphases in li-ion batteries and beyond. Chemical Reviews 114, 11503–11618 (2014). URL https://doi.org/10.1021/cr500003w. [38] Breiman, L. Random forests. Machine learning 45, 5–32 (2001). [39] Hoerl, A. E. & Kennard, R. W. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12, 55–67 (1970). [40] Chen, T. & Guestrin, C. Xgboost: A scalable tree boosting system (2016). URL https://doi.org/10.1145/2939672.2939785. [41] Yang, J., Thost, V. & Ma, T. Self-supervised learning on molecular graphs: A systematic investigation of masking design. Transactions on Machine Learning Research (2025). [42] Rampášek, L. et al. Recipe for a general, powerful, scalable graph transformer. Advances in Neural Information Processing Systems 35, 14501–14515 (2022). [43] Allen Institute for AI. Semantic scholar. (2026). Accessed: May 2026.
https://www.semanticscholar.org
[44] Hendricks, G., Tkaczyk, D., Lin, J. & Feeney, P. Crossref: The sustainable source of community owned scholarly metadata. Quantitative Science Studies 1, 1–14 (2020). [45] Pfitzmann, B., Auer, C., Dolfi, M., Nassar, A. S. & Staar, P. DocLayNet: A large human-annotated dataset for document-layout segmentation (2022). URL https://doi.org/10.1145/3534678.3539043. [46] Lowe, D. M., Corbett, P. T., Murray-Rust, P. & Glen, R. C. Chemical name to structure: Opsin, an open source solution. Journal of Chemical Information and Modeling 51, 739–753 (2011). URL https://doi.org/10.1021/ci100384d. PMID: 21384929. 20
[47] Kim, S., Thiessen, P. A., Cheng, T., Yu, B. & Bolton, E. E. An update on pug-rest: Restful interface for programmatic access to pubchem. Nucleic Acids Research 46, W563–W570 (2018). URL https://doi.org/10.1093/nar/gky294. [48] Bento, A. P. et al. An open source chemical structure curation pipeline using RDKit. Journal of Cheminformatics 12, 51 (2020). URL https://doi.org/10. 1186/s13321-020-00456-1. [49] Weininger, D. Smiles, a chemical language and information system. 1. introduction to methodology and encoding rules. Journal of Chemical Information and Computer Sciences 28, 31–36 (1988). URL https://doi.org/10.1021/ci00057a005. [50] Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M. & Monfardini, G. The graph neural network model. IEEE Transactions on Neural Networks 20, 61–80 (2009). [51] Rogers, D. & Hahn, M. Extended-connectivity fingerprints. Journal of Chemical Information and Modeling 50, 742–754 (2010). URL https://doi.org/10.1021/ ci100050t. PMID: 20426451. [52] OpenAI. gpt-oss-120b & gpt-oss-20b model card (2025). URL https://arxiv.org/ abs/2508.10925. arXiv:2508.10925. [53] Lee, D., Mizuseki, H., Choi, J. & Lee, B. Building an end-to-end battery recipe knowledge base via transformer-based text mining. Communications Materials 6, 100 (2025). URL https://doi.org/10.1038/s43246-025-00825-z. [54] Mullick, A. et al. Matscire: Leveraging pointer networks to automate entity and relation extraction for material science knowledge-base construction. Computational Materials Science 233, 112659 (2024). [55] Gupta, S., Mahmood, A., Shetty, P., Adeboye, A. & Ramprasad, R. Data extraction from polymer literature using large language models. Communications Materials 5, 269 (2024). [56] Ekuma, C. E. Dynamic in-context learning with conversational models for data extraction and materials property prediction. APL Machine Learning 3, 016119 (2025). URL https://doi.org/10.1063/5.0254406. [57] El-Bousiydy, H., Troncoso, J. F., Johansson, P. & Franco, A. A. LIBAC: An annotated corpus for automated reading of the lithium-ion battery research literature. Chemistry of Materials 35, 1849–1857 (2023).
21
Appendix A A.1
ElectroChemLLM Pipeline
Component A: Knowledge Base Creation
Our parsing pipeline begins with targeted literature acquisition from high-impact journals and repositories. We start by querying Semantic Scholar [43] and CrossRef [44] using a curated set of electrochemistry-specific keywords, filtering for articles that are either open-access or have a direct PDF link available. The resulting candidate list is then used to fetch PDFs from the respective publishers–each of which exposes its content slightly differently, requiring publisher-specific handling at the download stage. At the end of this step, we are left with a total of 15K papers– 10K covering battery electrolytes and 5K covering CO2 electro-reduction.
A.2
Component B: Document Parser
Once the relevant PDFs have been acquired, the next step is to extract their content in a form that preserves both textual and visual information. As outlined in Section 2, no single off-the-shelf parser recovers all modalities with the fidelity we need–hence, so we decouple extraction along content-type boundaries and route each modality through a dedicated tool. Full text and captions are handled by S2ORC-Grobid(Section A.2.1), tables are reconstructed using Docling’s TableFormer model(Section A.2.2), and figures are localised using a fine-tuned YOLO detector(Section A.2.3). The outputs of these three streams are then merged into a unified document-level representation, which serves as the input to the downstream LLM extraction stage.
A.2.1
Full Text Extraction with S2ORC-Grobid
For the textual backbone of each paper, we use the S2ORC doc2json parser–a utility from Allen AI that converts scientific PDFs into a semi-structured, machine readable JSON format. Under the hood, S2ORC relies on the Grobid ML library to first convert raw PDFs into a structured TEI-XML format, which is then passed through a custom grobid2jsn step to extract paper components into a final json output. We run this stage in a locally configured Python environment (setup details available in our GitHub repository). The output, as shown in Table A1, gives us a structured, section-by-section representation of the paper–bibliographic metadata, the abstract, and the full body text organized by section heading–with inline references to figures and tables preserved in-place. This addresses our document-level context desideratum. However, S2ORC does not recover the visual content of figures or the internal structure of tables–for those, we turn to Docling’s TableFormer and a fine-tuned YOLO detector described in Section A.2.2 and A.2.3.
A.2.2
Table Structure Recognition with Docling and TableFormer
Since S2ORC does not recover the internal structure of tables, we use the Docling framework to handle this. Docling [22] is an open-source document processing package powered by a suite of specialized models for layout analysis and table structure
22
Field
Content
Paper ID
c5ee03874j.grobid.tei
metadata Title Authors DOI Publisher Published date Abstract Text (section-keyed) Introduction Results and discussion Film characterisation Device characterisation Conclusion
Cesium-containing triple cation perovskite solar cells: improved stability [...] Michael Saliba, Taisuke Matsui, Ji-Youn Seo, [...] 10.1039/c5ee03874j Royal Society of Chemistry (RSC) 2016-03-16 Today’s best perovskite solar cells use a mixture of formamidinium and methylammonium [...]
Perovskite solar cells have attracted enormous interest in recent years [...] We investigated triple cation perovskites of the generic form [...] In Fig. 1a, we show X-ray diffraction (XRD) data for Cx M with [...] As illustrated in the cross-sectional SEM images in Fig. 3, the solar cell [...] This work, for the first time, used a mixture of a triple Cs/MA/FA cation [...]
Table A1 Example S2ORC-Grobid output structure for a representative paper. The parser recovers structured bibliographic metadata, abstract, and section-keyed body text with inline figure/table references preserved. Visual content and table structure are not recovered at this stage.
Fig. A1
Sub Figure extraction via YOLOv8 Processing.
recognition. We use it specifically for tables–the layout analysis model (an object detector trained on DocLayNet [45]) first localises table regions on each page, and the TableFormer model then takes these cropped table images and predicts their logical row and column structure, including merged cells and nested headers. The output of this stage is a structured representation of each table that preserves the spatial relationships between cells–which, as noted in our desiderata, is essential for keeping property-entity associations intact. Alongside the structured form, we store the tables in structured CSV formats and augment the table data with the Grobid JSON output.
A.2.3
Figure Localisation with a Fine-Tuned YOLO Detector
For figure extraction, we build on Docling’s layout analysis model–an object detector originally trained on DocLayNet that predicts bounding boxes and classes for page elements such as figures, tables, captions, and text blocks. While the base model performs reasonably well on general scientific documents, it struggles with a pattern that is especially common in electrochemistry literature–composite figures made up of multiple sub-panels clustered together under a single caption, where each subpanel reports a different property or experimental condition. Figure A2 for example,
23
Fig. A2
YOLOv8 SubFigure Extraction to isolate individual sub-panels from a composite image.
shows a composite figure comprising charge/discharge voltage profiles, capacity versus cycle number, and energy density curves reported side by side under a single caption. When the base detector treats such a cluster as a single figure, the downstream LLM receives one merged image in which individual property plots are difficult to isolate, leading to mis-associations between property values and their axes, units, or sample labels. Accurate sub-panel localisation is therefore critical for preserving the one-toone mapping between a plotted quantity and its extracted value. To address this, we introduce a separate YOLO detector, fine-tuned on a manually curated set of electrochemistry figures. The training set comprises 496 images extracted through docling, augmented using standard computer vision techniques (grayscale conversion, hue, saturation, exposure, and noise perturbation) to yield 1,296 training images in total, with 2 label classes: graphs and diagrams. The YOLO detector is applied downstream of Docling’s layout model–once a composite figure region has been identified on the page, the YOLO detector operates within that region to isolate individual sub-panels(as shown in fig A2). Each sub-panel is then cropped, Base64encoded, and passed downstream alongside the structured table outputs from A.2.2. As with tables, retaining sub-panels as individual images (rather than attempting
24
Input Figure Crop
Summariser Output (JSON) { "summary": "A cyclic voltammetry (CV) plot showing the electrochemical performance of different electrodes [...]", "key_findings": [ "The bare GC electrode exhibits negligible current response.", "The Cu.MOF electrode shows a pair of redox peaks [...]", "The (GO 8 wt%)Cu.MOF electrode demonstrates significantly enhanced current density [...]", "Increasing the weight percentage of GO generally leads to an increase in current response [...]", "[...]" ] }
Table A2 Example input–output pair from the image summariser. The left column shows a figure crop extracted by the fine-tuned YOLO detector A.2.3; the right column shows the corresponding JSON summary produced by the vision-capable LLM, capturing figure-level context, key quantitative findings, and reference metadata.
to parse their content at this stage) lets the downstream vision-capable LLM reason directly over each plot and its associated axes, legends, and in-plot annotations. At the end of this stage, we have three complementary streams of extracted content for each paper: (i) section-level text and metadata from S2ORC-Grobid, (ii) structured, cell-level table representations from Docling’s TableFormer, and (iii) subpanel-level figure crops from our fine-tuned YOLO detector. Before these streams can be merged into a unified document-level payload, the figure crops need to be converted into a form that can be reasoned over alongside the text–which brings us to our next component, the Image Summarizer.
A.3
Component C: Image and Table Summarizer
The outputs from our Document Parser provides, per paper, a set of individual figure crops and structured table representations alongside the full text. Before these can be merged into a unified payload for downstream extraction, each visual artifact is passed through an image summarizer: a vision-capable LLM (Gemini 2.5 Flash, processing figures in batches of ten per API call) that generates a detailed textual description of the figures in isolation. The motivation for this step is granularity of attention–when a large multimodal payload containing many figures and tables is passed to a single LLM call, individual visual details (axis labels, unit annotations, sub-panel legends, specific cell values) are often skimmed over or missed entirely, since the model distributes its attention across the full context. By processing each image and table individually, we ensure every visual artifact receives the model’s full attention, and all fine-grained details–sample names, reported values, measurement conditions, units–are captured in the resulting summary.
25
An example input-output pair from this step is shown in Table A2, where a cyclic voltammetry figure is translated into a structured JSON summary capturing both high-level context and specific quantitative findings. These summaries are text, which means they can be merged directly with the body text from S2ORC-Grobid into a single document-level context for the downstream extraction stage, without running into the context-length or multimodal-payload-size limits of a typical LLM call.
A.4
Component D: LLM-Based Property Extraction
The next step of the pipeline is to convert the assembled document-level context into structured, queryable property data–the actual target of this work. With body text from the document parser and structured summaries of figures and tables from the image summarizer now merged into a single JSON payload, we can hand the full paper to an LLM in text form and ask it to identify electrolyte entities and their associated physicochemical properties. We break this step into two parts: Section A.4.1 defining schemas (i.e. what to extract), and Section A.4.2 executing the extraction via a structured API call.
A.4.1
Property Selection
Electrochemical literature reports a wide range of properties, but not all are equally relevant for downstream materials discovery–and reporting conventions vary considerably across papers, so a naive "extract everything" approach tends to produce noisy, inconsistent outputs. We therefore worked with material science experts to define a focused set of target properties that are both scientifically meaningful for electrolyte design and commonly reported in the literature. The final list, shown in Table A3, covers the core physicochemical and electrochemical descriptors needed to characterise an electrolyte–from ionic conductivity and Coulombic efficiency to stability windows, overpotentials, and capacity metrics– alongside a structured breakdown of the electrolyte composition (salts, solvents, additives) and cell information (cathode, anode). Each property is captured along with its associated metadata–value, unit, measurement conditions, and reference electrode where relevant–to preserve the context needed for downstream normalisation and comparison across papers. Rather than leaving the LLM to produce free-form JSON, we encode this property list as an explicit JSON schema–one object per electrolyte, with nested fields for each property and its associated metadata. Every field is nullable to avoid forcing the model to hallucinate values when a property is not reported. The schema also includes a source_section field for every extracted entry, recording the section heading, figure number, or table number from which each value was drawn–directly addressing our grounding desideratum and enabling downstream validation and manual spot-checks. This schema-driven design also gives the pipeline its generalizability: the property list is defined declaratively in the schema rather than hard-coded into extraction logic, meaning properties can be added, removed, or restructured without modifying the rest of the pipeline. For this paper, we target battery electrolytes and CO2 electro-reduction systems, but the same architecture extends naturally to adjacent
26
Property
Captured Fields
Electrolyte Composition Total composition Salt(s) Solvent(s) Additive(s)
Full electrolyte description Name, concentration, unit Name, ratio Name, concentration, unit
Cell Information Cathode Anode
Material Material
Electrochemical Properties Ionic conductivity Coulombic efficiency Cell operating voltage range Electrolyte stability window Cycling stability Specific capacity Energy density Capacity retention Overpotential
Value, unit, measurement temperature Value, unit, conditions (initial / stable / end cycles) Range, unit, reference electrode Range, unit, reference electrode Descriptive Value, unit Value, unit Descriptive Value, unit, reference electrode (cathodic / anodic / total)
Physicochemical Properties pH Viscosity Cell operating temperature range
Value Value, unit, measurement temperature Descriptive
Provenance Source section Source Modality
Section heading, figure, or table number text_only, image_only, table_only
Table A3 Target properties and captured fields in the extraction schema. Properties are grouped into composition, cell configuration, electrochemical, physicochemical, and provenance categories. Every field is nullable to avoid forcing hallucinated values when a property is not reported in the source document.
electrochemical subdomains–such as fuel cells, supercapacitors, or electrochemical sensors – by swapping in a schema tailored to that domain’s properties and conventions. The document parser, summarizer, and extraction call remain unchanged.
A.4.2
Making the API Call
Given the large context lengths supported by current LLMs, the entire document– structured text from document parser and image/table summaries from image summarizer—can be passed to the model in a single API call, rather than chunking the paper or processing each section in isolation. This lets the LLM reason over the full paper at once, which is essential when an electrolyte and its properties are discussed over several sections of the paper. For each paper, we assemble the payload and pass it to the LLM along with a twopart prompt–a system prompt that instructs the model with relevant domain context (electrochem terminology, role of reference electrodes, etc.), and a user prompt that specifies the extraction task and target fields. The schemas per usecase are passed as a
27
structured output constraint so the model is required to return a valid json conforming to the schema. The pipeline is designed to be model-agnostic–the same payload, schema, and prompts can be routed to any LLM that supports structured JSON outputs. We benchmark multiple models (both on closed and open-source) on this step and compare their extraction accuracy, cost and latency.
A.5
Component E: ElectroChemDB
The LLM extraction stage produces one structured JSON object per electrolyte per paper–rich in content, but not yet ML-ready. Electrolyte and solvent names appear as free-form natural-language strings, property values reported in whichever units the original paper happened to use, and the same chemical entity can appear under multiple surface forms across different papers. The end goal is to produce a standardized, queryable data that can be consumed directly by ML pipelines–for tasks such as electrolyte property prediction, synthesis route determination–which means these inconsistencies need to be resolved before storage. To achieve this, we perform three post-processing steps: (i) chemical entity standardisation, in which molecular names are mapped to canonical SMILES representations; (ii) unit normalisation, in which extracted property values are converted to a consistent set of canonical units; and (iii) failure handling, which combines domain-specialised LLMs and expert review to resolve entities or measurements that cannot be processed automatically. The resulting records are then consolidated into ElectroChemDB, a structured and machine-learning-ready repository of electrolyte compositions and properties.
A.5.1
Chemical Entity Standardization
For every extracted electrolyte component—including salts, solvents, and additives— we resolve the literature-reported natural-language name to a standardized molecular representation, as summarized in Fig. A3. The workflow first normalizes raw names by cleaning text, harmonizing aliases and abbreviations, and identifying known non-molecular materials that cannot be assigned a single small-molecule structure. Candidate names are then generated using lookup dictionaries, synonym expansion, ChemDataExtractor [4], and, when needed, LLM-assisted fallback resolution. These candidates are queried against external chemistry resources, including OPSIN [46] for IUPAC-style names and PubChem [47] for database-backed synonym and structure lookup. RDKit [48] is then used to canonicalise and validate the resulting SMILES strings [49], with unresolved or ambiguous entities flagged for review. Standardizing chemical entities to canonical SMILES provides a single machinereadable identifier for each molecule, enabling deduplication across papers when different surface names refer to the same compound. The resulting standardized records also make ElectroChemDB directly compatible with downstream cheminformatics representations, including graph neural network inputs [50], molecular embeddings, and Morgan fingerprints [51], supporting machine-learning workflows built on curated electrolyte compositions.
28
Fig. A3 Chemical entity standardization workflow. Extracted literature-reported chemical and material names are normalized, expanded through dictionary and synonym-based candidate generation, resolved to molecular structures using external chemistry resources, and validated to produce canonical machine-readable identifiers for downstream database construction and machine-learning workflows.
A.5.2
Unit Normalisation
Extracted property values are normalised to a canonical unit per property, defined in consultation with domain experts to match the conventions most commonly used in electrochemical modelling and materials science. Normalisation is handled by a rule-based conversion layer that parses the extracted unit string and maps it to the canonical form, with robust handling of formatting variations. We also remove outliers based on the specified ranges for each property in accordance with the previous literature.
A.5.3
Electrolyte Composition Normalization
Electrolyte compositions are reported in the literature using heterogeneous conventions: solvent blends appear as volume, mass, or molar ratios, while salt and additive concentrations are expressed as molarity, molality, weight or mole percentages, and other concentration units. To establish a consistent quantitative representation for downstream machine-learning applications, we apply a deterministic compositionnormalization step downstream of unit normalization that converts extracted electrolyte formulations into a common molar-concentration basis (mol L−1 ). For each record, the solvent-ratio basis is identified from keywords in the reported composition, with volume ratios assumed when unspecified. Solvent ratios are converted into volume fractions using tabulated densities and molar masses where required. A nominal one-liter solvent-blend basis is then used to calculate the mass and molar amount 29
of each solvent. Salt and additive concentrations are subsequently converted to the same basis using unit-specific relationships, while reported molarities are retained unchanged, neglecting the salt’s contribution to the solution volume. Ambiguous units, missing physicochemical information, and unsuccessful conversions are recorded through component-specific status indicators, preserving the original information without introducing unsupported values. Applied to 41,412 extracted records, the procedure normalized solvent compositions in 24,847 records; the remainder failed almost entirely because the source publication reports no solvent composition or reports it incompletely. It converted 24,901 salt concentrations and 3,430 additive concentrations to the molar basis. Overall, 17,091 records (41.3%) normalize fully across every reported component. This standardized representation establishes a consistent set of composition-dependent features for subsequent machine-learning models.
A.5.4
Failure Handling
Not every extracted entity can be resolved cleanly–some molecule names are ambiguous, misspelled, or refer to proprietary or uncommon compounds–which are not listed by the chemistry tools we use for the resolution, unit strings outside the defined rule set. In these cases, we employ a general-purpose open-weight language model (GPTOSS-20B) [52] as a fallback to assist with chemical name resolution, including name conversions (IUPAC names to SMILES representations or molecular formulas). Entries that remain unresolved after this step are manually reviewed and resolved by domain experts.
A.5.5
Storage
Standardised entries are stored in MongoDB as the back-end for ElectroChemDB. MongoDB’s flexible document model accommodates schema evolution as new properties are added, while JSON Schema validation (using the schema from A.4.1) enforces data integrity. ElectroChemDB can be queried through MongoDB’s native interface and exported as flat tabular snapshots (CSV, Parquet) for direct consumption by downstream ML pipelines.
Appendix B B.1
Results
Evaluation metrics.
We report standard precision B1, recall B2, and F-1 score B3, computed by comparing each extracted JSON entry against its manually annotated counterpart. A predicted value is counted as a true positive if it matches the ground-truth value after standardisation - SMILES canonicalisation A.5.1 for chemical entities, and unit normalisation A.5.2 for property values. For categorical fields (e.g., reference electrode, cathode, anode), matching is exact after canonicalisation. Precision =
30
TP TP + FP
(B1)
Category
Property
F1
Composition
Total electrolyte composition Salt(s) Solvent(s) Additive(s)
94.37 98.61 99.55 93.28
Cell Information
Cathode Anode
98.47 98.47
Electrochemical Properties
Ionic conductivity Coulombic efficiency Cell operating voltage range Electrolyte stability window Specific capacity Energy density Capacity retention Overpotential
97.66 96.08 98.66 96.74 98.01 100.00 97.81 90.42
Physicochemical Properties
pH Viscosity Cell operating temperature range
90.91 97.55 98.17
Overall
Micro-average
97.15
Table B4 Property-wise extraction performance (F1 score) of ElectroChemLLM on the battery-electrolyte benchmark. Properties are grouped into composition, cell information, electrochemical, and physicochemical categories.
TP TP + FN 2TP Precision × Recall = F1 -score = 2 × Precision + Recall 2TP + FP + FN Recall =
(B2) (B3)
n
1X |yi − ŷi | n i=1 Pn (yi − ŷi )2 2 R = 1 − Pi=1 n 2 i=1 (yi − ȳ ) where the mean of the actual values ȳ is defined as:
MAE =
(B4) (B5)
n
ȳ =
1X yi n i=1
(B6)
We also compute F-1 at the individual property level, which surfaces which properties the pipeline extracts reliably and which remain difficult (reported in Section B4).
B.2
Cost Analysis.
Figure B4 situates these accuracy gains against their cost. ElectroChemLLM with Gemini-2.5-Flash is Pareto-optimal among the API-based configurations: it reaches the highest F1 (0.97) while costing roughly 4- to 20-fold less per paper than the direct-PDF baselines (∼0.004 vs. 0.019−0.083). The document-processing and visualsummarization components of ElectroChemLLM do not benefit every backbone equally 31
Fig. B4 Extraction cost vs. accuracy across configurations on the 121-paper benchmark (Table 2). Points are colored by pipeline type: prior extraction pipelines (gray, local tools with no API cost), direct-PDF LLM baselines (blue), and ElectroChemLLM (orange). The left panel shows configurations with no API cost on a separate axis; the right panel shows per-paper API cost on a log scale. Gemini-2.5-Flash under ElectroChemLLM achieves the highest F1 (0.97) at the lowest cost among API-based methods (∼$0.004/paper), dominating all other configurations on both axes.
– GPT-4o sees only a modest F1 gain over its direct-PDF counterpart (0.64 vs. 0.55) at roughly half the cost, while Gemini-2.5-Flash gains sharply on both axes (0.97 vs. 0.57, at roughly one-sixth the cost of its own direct-PDF variant). This suggests the structured-input pipeline is necessary but not sufficient for accuracy gains; it interacts strongly with the underlying model’s ability to exploit the pre-extracted text and visual summaries. Prior rule-based pipelines (BatteryDataExtractor, ChemDataExtractor) and the locally-run ChemLLM-20B-SFT incur no per-paper API cost but trail substantially on accuracy (F1 ≤ 0.50), underscoring the trade-off a practitioner faces between zero marginal cost and extraction quality at scale.
B.3
Component-Wise Performance (text extraction, figure localisation, summarisation quality)
Before evaluating end-to-end extraction quality, we validate that each pipeline component performs its intended function reliably. We evaluate three components individually: text extraction B.3.1, figure localisation B.3.2, and image summarisation B.3.3.
B.3.1
Text extraction
To assess the performance of S2ORC-Grobid, we conduct a qualitative human review of 50 papers. Our findings suggest that S2ORC-Grobid consistently recovered the
32
Detector Fine-tuned YOLO
Accuracy
Image Quality
Image Complexity
91%
1.92
1.93
Table B5 Cropped sub-panel quality and complexity scores (Component B.3) on 60 manually annotated figures. Each dimension is rated on a 1-3 scale by domain experts; see Appendix for the full rubric.
textual backbone of each article, including bibliographic metadata, abstracts, section headings, inline citations, and the majority of the narrative body text. This aligns with the original S2ORC evaluation, which reported an F1 score of approximately 0.89 for inline-citation detection and bibliography parsing [21]. Localised challenges were observed for notation- and layout-sensitive content, such as chemical subscripts, mathematical symbols, equations, and occasional mixing of figure captions with body text. These cases do not limit its role for our usecase: S2ORC-Grobid provides scalable, section-aware document context, while tables, figures, and other visually structured content are handled by the complementary TableFormer and YOLO–vision summarisation components.
B.3.2
Figure Localisation
We compare the fine-tuned YOLO sub-panel detector against Docling’s baseline layout model on a randomly sampled set of 60 figures drawn from the benchmark corpus. Domain experts annotate each cropped output along two dimensions - image quality (1-3: blurry / readable / crisp) and image complexity (1-3: simple / moderate / dense) - characterising the inputs that feed into the downstream summariser. Mean scores are reported in the following table B5, with rubric details in Appendix.
B.3.3
Image Summarisation
Using the same 60-figure sample, each figure-summary pair is scored by domain experts along three dimensions – accuracy, faithfulness, and coverage – on a 1-3 scale. The sampled figures are predominantly graph-type figures (CV plots, polarisation curves, capacity-vs-cycle curves, etc.), reflecting the dominant figure type in electrochemistry literature where quantitative property values are reported. Mean scores across the three dimensions are reported in the table B6, the full rubric is in Appendix.
B.4
LLM-Judge Evaluation
We evaluate extracted records against the human-annotated ground truth using Gemini-3.5-Flash as an LLM judge. The judge is run at a temperature of 0 and constrained to return structured JSON. Evaluation is performed independently for each paper through separate recall and precision passes, avoiding brittle one-to-one alignment between electrolyte records.
33
Dimension
Mean Score
Accuracy Faithfulness Coverage
2.4 2.7 1.8
Overall
2.28
Table B6 Image summarisation quality A.3 on 60 manually annotated graph-type figure-summary pairs. Each dimension is rated on a 1-3 scale (higher is better); see Appendix for the full rubric.
Claim Construction. Each ground-truth and predicted electrolyte entry is flattened into a set of non-empty scalar claims. A claim consists of a schema field and its associated value, such as a salt name, solvent ratio, ionic-conductivity value, or measurement condition. Null, empty, and unavailable values are excluded. List-valued fields, including salts, solvents, additives, and overpotentials, are treated as unordered collections. Recall Pass. Each ground-truth electrolyte entry is compared with all predicted entries from the same paper. For every non-empty ground-truth claim, the judge determines whether an equivalent claim is recovered in the predictions. A claim is counted as recovered only when it is associated with the same electrolyte formulation. Precision Pass. Each predicted electrolyte entry is compared with all ground-truth entries from the same paper. The judge determines whether each predicted claim is supported by the annotations. Unsupported claims and values associated with a different formulation, measurement condition, cell, voltage, or cycle count are counted as false positives. Matching Criteria. The judge determines electrolyte identity using salts, solvents, additives, concentrations, units, and overall composition. Harmless formatting differences, such as 1 versus 1.0 or mA/cm2 versus mA cm−2 , are accepted. Unambiguous chemical aliases and equivalent composition ratios are also accepted. However, speculative unit conversions and numerically similar but scientifically non-equivalent values are rejected. All comparisons are restricted to records from the same paper. Metric Calculation. Let NGT denote the number of non-empty ground-truth claims, Ncovered the number recovered by an extraction system, Npred the number of non-empty predicted claims, and Nsupported the number supported by the ground truth. Recall and precision are calculated as
34
Ncovered , NGT The corresponding F1 score is Recall =
Precision =
Nsupported . Npred
(B7)
Precision × Recall . (B8) Precision + Recall Metrics are aggregated by schema field to obtain property-level performance. The overall micro-average is calculated by pooling claim counts across fields before computing precision, recall, and F1 . If a paper contains no predicted entries, its ground-truth claims are counted as false negatives. Conversely, if predicted entries have no corresponding ground-truth entries, their claims are counted as false positives.
F1 = 2
Strict and Conditional Evaluation. The primary evaluation includes all non-empty ground-truth claims within each system’s declared extraction scope. Properties that a system fails to extract remain in the recall denominator. We additionally report a conditional evaluation restricted to property–paper pairs for which the system produces at least one prediction. This secondary measure characterises performance when a system attempts an extraction, but does not measure complete retrieval coverage and is therefore reported separately from the primary results.
B.5
Pipeline-Specific Evaluation Scopes
Several existing materials- and battery-domain models were considered as potential baselines because their extraction objectives partially overlap with the electrolytecomposition and property schema evaluated in this study. T2BR [53] was considered particularly relevant because it extracts battery cell-assembly information, including electrolyte salts, solvents, and amounts; however, the trained cell-assembly checkpoint and tokenizer resources required to reproduce the published model were not available in the public repository, so it was not quantitatively evaluated. BatteryDataExtractor [5] and ChemDataExtractor [4, 27] support extraction of selected battery or materials properties, support extraction of selected battery or materials properties, but their outputs and extraction scopes do not directly match the complete structured electrolyte composition–property schema used here. ChemLLM [28] provides chemistry-focused LLM-based extraction, but primarily operates on extracted text and does not provide an equivalent battery-specific pipeline incorporating tables and figures. BatteryBERT [6] supports battery-domain classification, question answering, and entity identification, but does not directly generate complete structured composition–property records. LLaMP [19] primarily targets materials knowledge retrieval and agent-based reasoning, while MatSciRE [54] focuses on material–property relation extraction and could not be directly evaluated because trained checkpoints were not publicly available. We also examined the PromptDataExtraction polymer-property extraction pipeline [55], which uses MaterialsBERT [9] and LLM-based approaches. However, the released environment
35
Property
LLMs
CDE2
BDE
Electrolyte composition Coulombic efficiency Cell information Cell operating voltage range Ionic conductivity Electrolyte stability window Specific capacity Overpotential Cycling stability Cell operating temperature range Capacity retention Viscosity Energy density
4,035 1,227 929 688 602 472 465 290 248 242 235 187 56
3,518 793 – – 602 327 465 218 – 242 235 187 56
– 793 – 508 602 – 465 – – – – – 56
Total claims Properties with ground-truth claims
9,676 13
6,643 10
2,424 5
Table B7 Ground-truth claims included in each system’s evaluation scope. Dashes indicate properties outside a system’s extraction scope. The schema contains a pH field, but it is omitted because the benchmark contains no non-null pH claims.
and supporting data were incomplete for direct reproduction and would require substantial battery-specific adaptation. PropertyExtractor [56], based on GPT/Gemini prompting and dynamic in-context learning, can extract user-specified material properties, but would require extensive battery-specific configuration to match our full extraction schema. Finally, LIBAC [57] provides battery-domain named-entity recognition for electrolyte-related entities such as salts, solvents, concentrations, and ratios, but does not directly link these entities into complete composition–property records. These approaches were therefore treated as related domain-specific methods rather than directly equivalent quantitative benchmarks. All systems are evaluated on the same set of 120 papers. The LLM-based systems are evaluated on the complete schema, whereas ChemDataExtractor2 and BatteryDataExtractor are evaluated only on the properties they were designed or configured to extract. ChemDataExtractor2 is evaluated using ten custom electrolyteproperty models, while BatteryDataExtractor is evaluated using its five default property extractors. Free-text subfields are excluded from the rule-based evaluation because these systems do not generate descriptive text. The excluded fields comprise measurement-condition descriptions, reference-electrode descriptions, and totalelectrolyte-composition summaries. Table B7 reports the resulting ground-truth claim counts. Although several properties are shared across systems, their claim counts may differ because prose-based subfields are retained for the LLMs and excluded for the rule-based systems. For example, measurement-condition claims are included in the LLM evaluation of Coulombic efficiency, while reference-electrode claims are included in the LLM evaluation of operating-voltage ranges. The complete judge prompt, structured-output schema, model identifier, and field mappings are provided in the supplementary materials.
36
Related documents
- ElectroChemLLM: A Multimodal LLM Pipeline for High-Fidelity Electrochemical Informatics#1536466
- DianShi-RxnDB: A Large-Scale, Fine-Grained Organic Reaction Data Platform Built via a Fully Automated Pipeline for Researchers and AI Agents#974802
- Accelerating Large-Scale Cheminformatics Using a Byte-Offset Indexing Architecture for Terabyte-Scale Data Integration#1036626
- Librarian of Alexandria: A Modular Chemical Data Extraction Pipeline to Compare LLM Performance.#312559
- Materials Experiment and Analysis Database: Electrochemistry measurements containing 510 files performed on plate containing Sn,Fe,Cu,Mn,Co,Ta annealed at 400.0C to add O on 2017-01-25 from Run 20170125.093041#1319400
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive