FETS Benchmark: Foundation Models Outperform Dataset-specific Machine Learning in Energy Time Series Forecasting Marco Obermeiera,b,c , Marco Prucknera , Florian Haselbeckb,1 , Andreas Zeiselmairc,1,∗
arXiv:2604.22328v1 [cs.LG] 24 Apr 2026
a
Julius-Maximilians-Universität Würzburg, Modeling and Simulation Lab, Am Hubland, Würzburg, 97074, Germany b Weihenstephan-Triesdorf University of Applied Sciences, Smart Farming, Am Staudengarten 1, Freising, 85354, Germany c Weihenstephan-Triesdorf University of Applied Sciences, Digital Energy Transition, Hans-Carl-von-Carlowitz-Platz 3, Freising, 85354, Germany
Abstract Driven by the transition towards a climate-neutral energy system, accurate energy time series forecasting is critical for planning and operation. Yet, it remains largely a datasetspecific task, requiring comprehensive training data, limiting scalability, and resulting in high model development and maintenance effort. Recently, foundation models that aim to learn generalizable patterns via extensive pretraining have shown superior performance in multiple prediction tasks. Despite their success and strong potential to address challenges in energy forecasting, their application in this domain remains largely unexplored. We address this gap by presenting the Foundation Models in Energy Time Series Forecasting (FETS) benchmark. We (1) provide a structured overview of energy forecasting use cases along three main dimensions – stakeholders, attributes, and data categories. (2) 54 datasets across 9 data categories are collected and analyzed, guided by typical stakeholder interests. (3) Foundation models are benchmarked against classical machine learning approaches across different forecasting settings, where foundation models consistently outperform datasetspecific optimized machine learning approaches across all settings and data categories – despite the latter having seen the full historic target data during training. In particular, covariate-informed foundation models achieve the strongest performance. Further analysis reveals a strong correlation between predictive performance and the spectral entropy, performance saturation beyond a certain context length and improved performance at higher levels of aggregation, such as national load, district heating demands, and power grid data. Overall, our findings highlight the strong potential of foundation models as scalable and generalizable forecasting solutions for the energy domain, in particular in data-constrained and privacy-sensitive settings. Keywords: Time series foundation models, energy data, forecasting benchmark, machine learning ∗
Corresponding author: [email protected] Email addresses: [email protected] (Marco Pruckner), [email protected] (Florian Haselbeck), [email protected] (Andreas Zeiselmair) 1 These authors contributed equally as joint last authors.
2
1. Introduction Modern energy systems are undergoing fundamental transformation. Starting from existing centralized structures with a small number of large-scale dispatchable generation units, adapting to predictable load patterns towards high shares of volatile renewable and decentralized generation. This integration demands higher flexibility and demand response, increasing system complexity. To address this, data-driven approaches are key for optimized operation and planning of energy infrastructures [1]. A key component of these is the anticipation of upcoming system states – be it from a market, grid, or system stability perspective. Eventually, accurate time series forecasting plays an essential role in the digitalized energy system of the future. For example, traders can optimize their market positions using precise load and generation forecasts, grid operators need reliable predictions to determine whether a power plant curtailment is necessary to maintain grid stability, and balancing authorities want to estimate their ancillary service needs [2, 3]. In recent years, machine learning-based prediction models have emerged as state-ofthe-art approaches for energy data forecasting [4, 5, 6, 7]. Despite their good prediction performance when optimized for specific energy forecasting tasks, employing machine learning-based approaches leads to several challenges. Many energy systems constitute critical infrastructure, making most energy time series data highly sensitive and thus limiting their availability [8]. Furthermore, current energy systems and markets are fractured in their organizational structure, driven by unbundling requirements, market regulations, and the increasing decentralization of assets, which leads to energy data silos that are not accessible for cross-application use cases. Additionally, many newly deployed energy assets, particularly in the rapid upscaling of renewable energy, frequently lack sufficiently long historical records required for training [9, 10]. The global transformation of the energy system further reinforces the challenge of changing data distributions, requiring recurring model updates [11, 12]. In general, niche applications or forecasting for small scale energy asset often do not justify the effort required for specially trained models. These limitations motivate the development of forecasting approaches that need less task-specific training data, generalize across datasets, and remain stable under distribution shifts. Time series foundation models (TSFMs) have recently gained significant attention in the machine learning community. In particular, Chronos [13] in 2024 attracted attention by adapting existing language model architectures through minimal modifications – requiring only tokenization via scaling and quantization – and demonstrating strong zero-shot performance across diverse domains including finance, healthcare, nature, retail, mobility and energy [13, 14]. Since then, general-purpose benchmarks such as GIFT-EVAL [15] and FEV-Benchmark [16] have adopted similar domain coverage to systematically compare the growing number of TSFMs. By learning generalizable representations from large and diverse pretraining datasets, these models often achieve competitive performance on previously unseen data in zero-shot settings, i.e., without any task-specific training, and thus potentially providing large benefits for energy forecasting. A detailed description of TSFM architectures and modeling approaches is provided in Section 2 (Related Work). Recent works have begun to explore TSFMs for specific energy use cases. Meyer et al. [17] benchmark TSFMs for household load forecasting and find that zero-shot models can match trained-from-scratch Transformers, particularly with longer context, yet the study is limited to univariate settings without covariates or classical machine learning
3
baselines. Hornek et al. [18] evaluate TSFMs for electricity price forecasting across five European markets and report that task-specific machine learning methods consistently outperform all tested TSFMs in zero-shot mode – again without considering covariates or fine-tuning. Simeone [19] assesses TSFMs for energy load forecasting on a single dataset without machine learning baselines or covariate support. Ferdaus et al. [20] provide a structured review of foundation models for clean energy forecasting but do not conduct a dedicated benchmark. While these studies provide valuable first insights, they each focus on single energy use cases, consider only univariate forecasting, and omit either classical machine learning comparisons or covariate-informed and fine-tuned settings. Despite the general success and the potential benefits of TSFMs, multiple gaps in terms of their application on energy data exist in current research. General-purpose benchmarks treat energy as a single category among many domains, lacking the granularity to determine in which energy use cases TSFMs perform better or worse than task-specific models such as random forests or XGBoost. As shown above, recent domain-specific studies focus on individual energy use cases with narrow dataset coverage and do not include newer models, particularly those supporting covariate forecasting, nor do they systematically compare against classical machine learning baselines. Hence, there is a lack of a comprehensive benchmarking of TSFMs on energy data that include univariate and covariate approaches, zero-shot and task-specific fine-tuning settings as well as a comparison with state-of-the-art classical machine learning-based methods trained task-specifically. In this work, we address these research gaps by empirically investigating the potential of TSFMs to overcome the key challenges of energy data forecasting identified above. For this purpose, we introduce the FETS (Foundation models for Energy Time Series) benchmark, comprising a diverse set of energy-related data as well as foundation models and classical machine learning approaches. Specifically, we make the following contributions: • Leveraging a representative collection of openly available energy datasets we provide as a contribution of this paper. • We systematically assess recent TSFMs across multiple settings such as the forecasting horizon under both zero-shot and fine-tuned conditions. • We further compare these TSFM approaches with specifically trained machine learning predictors (i.e., random forest and XGBoost), which can be considered the state-of-the-art in energy forecasting. • As a further contribution, we analyse in detail the effects of certain parameters of TSFMs on downstream prediction performance. Thus, our findings provide a comprehensive empirical assessment of foundation models for energy time series forecasting, including their strengths and limitations across diverse settings, offering guidance for real-world energy applications. The paper follows a hybrid structure combining the IMRaD convention [21] with the CRISP-DM methodology [22]. Section 2 reviews related work, followed by energy forecasting use cases (Section 3) and the materials and methods (Section 4) covering the dataset collection, evaluated models, and evaluation setup. Benchmark results are presented in Section 5 and discussed separately in Section 6, before Section 7 concludes with key findings and future deployment directions.
4
2. Related Work In the energy domain, forecasting has traditionally been addressed using statistical approaches accounting for temporal patterns such as ARIMA and machine learningbased methods for tabular data, e.g., random forests and gradient boosting techniques [3, 8]. Comprehensive reviews of electricity price forecasting established early on that the heterogeneous statistical properties of energy time series – spikes, mean reversion, calendar effects – preclude a single dominant model class, motivating dataset-specific tuning and ensemble strategies [23]. As a consequence, practical energy forecasting pipelines are typically built around careful, domain-specific feature engineering – temperature and weather covariates, calendar and holiday indicators, lagged target values, and recency effects – combined with comparatively small, well-regularized models. Lessons from the Global Energy Forecasting Competitions (GEFCom) [24] confirmed that such feature engineering often outweighs architectural complexity, with gradient boosting and quantile regression emerging as strong probabilistic baselines. In line with these findings, Gradient Boosted Trees like XGBoost dominate recent energy forecasting competitions [25, 4, 5], while random forest remains a robust, stable, and simple baseline widely adopted in practical applications due to its minimal tuning requirements and interpretability [26]. Large-scale empirical comparisons further report that such compact, task-specifically tuned tree ensembles remain highly competitive with task-specific deep learning architectures, as the limited historical data typical of individual energy forecasting tasks favor small, low-variance models with strong inductive biases and hand-crafted features over larger, data-hungry architectures [27]. Together, these findings establish XGBoost and random forest – combined with energy-specific feature engineering – as the natural task-specific baselines for evaluating generalist forecasting approaches in the energy domain. Building on these developments, a new class of models has emerged that goes beyond task-specific training – Time Series Foundation Models (TSFMs). 2.1. Time Series Foundation Models TSFMs as well as tabular foundation models have emerged as a new paradigm in time series and tabular data forecasting in general. TSFMs are typically large sequential deep learning based models pretrained on large volumes of diverse real-world and synthetic time series data. Similar to tokenization in natural language processing, an input sequence is divided into fixed-length patches (e.g. 32 timesteps), each transformed into a learned embedding vector. During pretraining, models learn sequential dependencies between these embeddings, often through masked prediction tasks, with the objective of learning generalizable patterns transferable to previously unseen data. Similar principles have recently been proposed for tabular foundation models, which also aim to retrieve transferable representations via pretraining on large and diverse real-world and synthetic data. Hence, after pretraining, TSFMs and tabular foundation models enable downstream forecasting on unseen data, often achieving a good performance in zero-shot and few-shot settings, respectively. While sharing similar pretraining strategies, current foundation models differ regarding their underlying architectural design and modeling assumptions. Several approaches leverage transformer-based sequential models operating on patch embeddings of the time series, e.g., Chronos-2 [14], TimesFM [28], and Moirai2 [29]. Further stateof-the-art approaches are FlowState [30], leveraging state space models, as well as TiRex
5
[31] building upon an xLSTM-based architecture [32]. For tabular data, TabPFN2.5-TS [33, 34] employs a transformer-based prior-data fitted network. Further distinction between these state-of-the-art approaches lies in the forecasting modes they support, i.e., univariate forecasting predicting a single time series without additional information, covariate-informed forecasting incorporating auxiliary features, and multivariate forecasting jointly modeling multiple related time series. While FlowState and TiRex currently only support univariate forecasting, the further above-mentioned methods also allow to include covariates, which might be beneficial for energy forecasting. Figure 1 shows a schematic example of uni- and covariate zero-shot forecasting. In univariate mode, the model input consists of a segment of the target time series (the context), and the model output comprises a configurable set of forecast quantile trajectories (the horizon). In covariate mode, the inputs are extended with covariates, such as weather forecasts or holiday indicators, allowing to account for dependencies between the target and covariates, e.g., via cross-attention mechanisms. Historical Data
Model Forecast
Uncertainty (10%-90%)
Forecast Start
60
Value
Actual Values
40 20 0 Context
Horizon
Covariates
Covariate 1 (e.g., Temperature Forecast)
Covariate 2 (e.g., Wind Speed Forecast)
1 0.5 0
0
1
2
3
4
5
6
7
8
Time Figure 1: Zero-shot time series forecasting schematic for univariate and covariate modes: The upper panel shows historical data (blue, 7 days context), model forecast with median (red dashed, 1 day horizon), 10%-90% uncertainty interval (red shaded), and actual values (green). The lower panel displays optional covariates (blue) that are used as additional input features in covariate mode across the same time axis.
2.2. Benchmarks and Energy-Specific Applications To compare the prediction performance of these foundation models, multiple generalpurpose benchmarks such as GIFT-EVAL [15] and FEV-Benchmark [16] have been published. However, these benchmarks show limited coverage of the energy domain, with GIFT-EVAL only including three energy-related datasets and FEV-Benchmark providing data for aggregated country and household loads, electric price forecasting, and solar as well as wind production forecasting [35]. A complementary direction is pursued by TS-Arena [36], a live forecasting platform with a pre-registration protocol that evaluates models on genuinely unseen future data to eliminate train–test contamination by design,
6
with an initial application focus on the energy sector; however, it currently provides neither a systematic comparison against classical machine learning baselines such as XGBoost or random forest, nor support for covariate-informed forecasting. As already discussed in the introduction, recent works also explore TSFMs for energy data, focusing on individual use cases such as household load forecasting [17], electricity price forecasting [18], univariate energy load forecasting [19], and clean energy forecasting reviews [20]. These contributions provide first insights into the applicability of TSFMs in energy forecasting, but each concentrates on a single energy use case and typically omits covariate-informed modes, fine-tuning, or comparisons against classical machine learning baselines. Building on this, our FETS benchmark differs from prior work as follows: • Unlike the general-purpose benchmarks GIFT-EVAL [15] and FEV-Benchmark [16], which treat energy as one of many domains, we organize the evaluation along stakeholder-driven energy use cases and assemble 54 datasets across 9 energy-specific data categories. • Unlike energy-specific TSFM studies [17, 18, 19], each restricted to a single use case in univariate zero-shot mode, we evaluate covariate-informed TSFMs such as Chronos-2 [14] across diverse energy use cases under both zero-shot and fine-tuned conditions. • Unlike TS-Arena [36], which lacks classical baselines, covariate support, and finetuning, we benchmark against task-specifically tuned XGBoost and random forest as the de facto state-of-the-art in practical energy forecasting. To the best of our knowledge, this provides the first systematic, use-case-differentiated evidence on where foundation models surpass established baselines in energy forecasting, and where dataset-specific machine learning remains the stronger choice. 3. Forecasting Use Cases in the Energy Sector While general-purpose benchmarks treat energy as a single domain, energy data in fact covers a wide range of specific subdomains itself. To allow for a more fine-grained analysis of TSFMs on energy data, we propose an energy-specific taxonomy that clusters datasets by representative fields of current forecasting applications, sub-divided by data categories, stakeholders, and forecast attributes as depicted in Figure 2. Spanning a tree of involved parties, energy applications, and time series characteristics, the respective leafs reflect existing dimensions to be considered. Some leaf-level examples are specific to the European and German market, but the overall structure is broadly transferable. The forecast attributes shown extend those discussed in Ferdaus et al. [20]. The introduced energy stakeholders are derived from the ENTSO-E market role definitions [37] and abstracted to ensure transferability to energy markets beyond Europe, following the stakeholder categorization discussed in Antonopoulos et al. [3]. Data categories reflect the energy sectors electricity, heat, and mobility [38] that come with specific requirements in forecasting respective time series. The electricity domain stands out, as it plays a central role in a future, fully carbon-free energy system, [2], covering generation, load, market, system services and grid time series. Each forecast can be characterized by
7
attributes such as horizon (long-term to real-time), grid level (transmission to low voltage), and spatial aggregation (national to individual asset). Forecast attributes introduce the technical dimension, covering temporal data resolution as well as forecasting horizons, external influences, addressed grid levels, and finally regional or type aggregation levels [20]. Trader
Grid
Retailer
Op. Balance
Prod-
Resp.
ucer
Op.
EV
Balancing
Stakeholder
Market
Service
Load
District
System
Con-
Op.
sumer
Long
Mid Short
Heat
Mobility
Process
Real-
Heat
Space
Heat
Heat
time
Horizon
Energy Forecasts
Transmission
Wind
PV
Data Categories Gener-
Battery
Dispatch.
15 min
ation
Forecast Attributes
1 h
Nondisp.
Holi-
Load
Industry
Grid
Aggregation
Market
System
Export
Day Ahead
Influences
National
days Import
Household
LV
Temporal
5 min
Electricity
HV MV
Resolution Gas
Grid Level
Cluster
IndiLocal
Policy
vidual Region Price
Weather
mFRR
Intraday reBAP
FCR
aFRR
Figure 2: An overview of energy forecasts from different perspectives and dimensions. It constitutes a synthesis of an abstracted interpretation of ENTSO-E market role definitions [37], and forecast attributes derived from Ferdaus et al. [20], common energy balances on a state or national level [38], with aggregated nodes summarizing consumption and production sectors, as well as own considerations.
8
We can further link each energy system stakeholder to typical data categories of interest, which we show in Table 1. The tasks we consider focus on short-term forecasting applications, which are particularly relevant to operational planning and often subject to challenges such as non-stationarity, making them a promising application domain for TSFMs in the near future. Table 1: Stakeholder interests in energy forecasts with focus on short-term applications Stakeholder
Role / task related to forecasts
System Operator
Real-time grid balancing, frequency control, and system security (intraday to day-ahead).
Grid Operator
Congestion forecasting to anticipate line/transformer overloads, enabling pre-emptive switching operations, redispatch requests, and real-time monitoring. Minimizing imbalance costs through portfolio balancing (15-min to dayahead).
Balance Party
Responsible
Trader
Intraday and day-ahead trading, arbitrage, and position optimization.
Producer
Unit commitment and dispatch optimization (5min ahead to day-ahead).
Energy Supplier
Short-term procurement and balancing group management for retail customers. Day-ahead and intraday market clearing and price formation.
Market Operator
Balancing Provider
Service
Consumer (industry commercial)
/
Consumer (residential with HEMS) Metering Point Administrator / Data roles
Bidding strategies for frequency restoration reserves (aFRR, mFRR). Demand response, peak shaving, and intraday procurement for flexible loads. Home energy management, optimal scheduling of flexible loads and storage. Real-time data validation and operational monitoring of metering infrastructure.
Typical forecasted targets (data catagories) Aggregated load, non-dispatchable generation (wind, PV), balancing reserve activation (aFRR, mFRR), grid power flows. Regional load, distributed nondispatchable generation, mobility (EV peaks), heat (heat pumps), grid line flows, grid components/assets, i.e., network transformer load. Portfolio load, non-dispatchable generation, balancing energy prices (reBAP), imbalance volumes, balancing discrepancies, short-term/ID prices. Market prices (day-ahead, intraday), load patterns, non-dispatchable generation, cross-border flows. Plant-specific non-dispatchable generation (wind, PV), market prices, balancing service activation. Customer load, mobility (EV charging), heat (heat pumps), market prices, distributed generation. Aggregated load, non-dispatchable generation, cross-border capacity, market bid/offer curves. Balancing reserve activation, system frequency, market prices for reserve energy, flexible assets. Site load, on-site non-dispatchable generation (PV), process heat, mobility (fleet), market prices. Household load, heat (heat pump), mobility (EV charging), rooftop PV, battery storage, market prices. Metered load, mobility (EV), heat (heat pumps), anomaly detection, data volume validation.
9
4. Materials and Methods In this work, we provide a systematic assessment of TSFMs on a comprehensive set of energy forecasting data. In Figure 3, we provide an overview of the main components of our study. First, we consider representative datasets from different categories of the energy sector following the above-described taxonomy, allowing both general and task-specific conclusions. Second, we evaluate a wide range of prediction models including TSFMs as well as classical machine learning-based state-of-the-art comparison partners, across the three TSFM forecasting modes: univariate zero-shot, covariate zero-shot settings, and taskspecific fine-tuning regimes. Third, we define a consistent evaluation framework allowing for a fair comparison and further analysis of the behavior of the employed approaches. In this section, we describe the components of this benchmark in detail, beginning with the selection and preparation of the datasets, followed by the forecasting models, and finally the evaluation setup. Data
Models
Evaluation
Non-dispatch Generation PV
Univariate
NRMSE
Market Dayahead
Chronos-2
Flowstate
TimesFM
Tirex
Covariate Heat Heat Demand
Chronos-2 TimesFM
Mobility EV Load Data Category XY ...
Covariates: Hist. Weatherforecasts (Temp., Wind, Radiation) Calendar (Hour, Day, Holiday)
TabPFNTS
Training/Finetuning Chronos-2
XGBoost
Median of each Data Category Spectral Entropy vs. Forecast Performance Sensitivity Analyses: Context, Horizon, Aggregation Level
Random Forest
Ó Benchmark Settings: Context Length: 672 – 8000 (1w – 12w @ 15min) Forecast Horizon: 96 – 288 (1d – 3d @ 15min) Rolling Windows: 35 windows
Figure 3: Benchmark architecture overview: Datasets are fed into three deployment modes with covariates as additional inputs. Models are evaluated across multiple perspectives with consistent benchmark settings.
10
4.1. Selected Datasets Based on the data categories that are typically of interest for stakeholders (see Table 1), we selected a representative set of datasets for this study, presented in Table 2. Our dataset selection follows four main criteria: (1) open availability, (2) recency with a preference for datasets covering timeseries data from 2022 onwards, (3) domain relevance based on citation count and market size, and (4) category coverage across all segments identified in Table 1. For each dataset and benchmark mode, representative target subsets are used (partly randomly selected; see Table A.5). Each dataset is assigned to the data categories given in Figure 2. The general data section contains datasets that could be assigned to multiple data categories or comprise general feature sets. Historical weather forecasts and calendar data serve as covariates across all forecasting tasks. Typical meteorological features include temperature (2 m height), wind speed (at 80 m, 120 m, and 180 m hub heights), shortwave radiation, and direct radiation. Temporal features comprise cyclic encodings of hour, minute, weekday, day, and month using sine and cosine transformations to preserve periodicity. Calendar features include binary indicators for weekends and public holidays derived from state-specific holiday calendars. Most datasets originate from the largest European electricity markets, with additional datasets from Asia and the United States. Table 2: Comprehensive overview of all datasets used in this study, categorized according to Figure 2 and providing references besides a general description and outlining their usage in our comparative study. Category & Dataset
Description
Benchmark Usage
Ref.
Holiday and temporal features (DE, FR, NL, UK, CN, CH, CA, Bavaria, ...) Load, generation, and market data for European countries
All benchmark modes; required by TabPFN [33][34]
[39]
Country-level load, solar, wind, fossil generation, dayahead spot market prices
[40]
EV charging at large office parking lot, Netherlands Public EV charging stations across Germany Urban EV charging demand dataset, Shenzhen, China Domestic EV chargepoint analysis data, United Kingdom
Aggregated EV charging power forecasting Aggregated EV charging (50–25000 EVs) Urban-scale EV charging demand forecasting Residential EV charging forecasting
[41]
Heat pump smart meter data with inspection protocols Heat Grid Flensburg Network data of the district heating system for the city of Flensburg from 2020–2024 Non-Dispatchable Generation Energy Forecasting ComHybrid wind and PV forecasting petition competition, UK
Heat pump electricity demand forecasting District heating forecasting with historical weatherprediction
[45]
General Data Calendar Features
ENTSO-E Transparency
Mobility Data Office EV Parking (NL) Mobilithek UrbanEV UK Department Transport Heat Data HEAPO
for
Hill of Towie Wind Farm PV Hong Kong DE/FR/DK Power Solar
Onshore wind farm active power measurements, Scotland High-resolution rooftop PV generation, 3-year, China Country-level solar generation for DE, FR, DK
[42] [43] [44]
[46]
Wind park, PV cluster, and [47] hybrid wind+PV forecasting 15-min wind farm power [48] forecasting Single rooftop PV system [49] forecasting National solar generation [40] forecasting Continued on next page
11
Table 2 – continued from previous page Description Benchmark Usage Onshore and offshore wind generaNational wind generation tion for Germany forecasting California CAISO 5-min resolution aggregated load Aggregated solar forecastdata for California (CAISO) ing (US market) Dispatchable Generation ENTSO-E Germany Fossil gas and hard coal generation Dispatchable generation for Germany forecasting 5-min resolution aggregated generBattery storage dispatch California CAISO ation data for California (CAISO) forecasting (US market) Load Data KIT Company Load Electricity consumption of 28 GerIndustrial and commercial man companies (15-min) load forecasting Industrial VEA Profiles 5359 industrial load profiles Industrial load forecasting Country-level load for Germany National electricity demand DE/FR Power Load and France forecasting California CAISO 5-min resolution aggregated load Aggregated load forecasting data for California (CAISO) (US market) Residential Load TSFM Household BenchHousehold electricity load with Short-term household load mark foundation model benchmark forecasting HTW Berlin Households Representative load profiles at 1Individual and aggregated second resolution household load (2–80 households) Lower Saxony HouseSingle-family house and heat pump Individual household deholds load profiles mand with/without PV Market Data reBAP balancing energy price accross conBalancing energy price foretrol areas for Germany casting Day-Ahead Prices EPEX day-ahead auction prices Day-ahead electricity price (DE-LU) forecasting Intraday Prices Continuous intraday market prices Intraday price forecasting Locational marginal prices (NP15, Electricity price forecasting California CAISO SP15, ZP26) (US market) Grid Data 50Hertz Line Power Transmission line power for highHigh-voltage line power voltage lines flow forecasting Bayernwerk MV Grid Medium voltage grid feed-in and MV grid load and feed-in consumption forecasting LV Grid Feeders (200) Real-world energy data of 200 lowLow-voltage grid load forevoltage grid feeders with metadata casting Balancing Services aFRR Germany Automatic frequency restoration reaFRR activation forecastserve activation ing (positive/negative) mFRR Germany Manual frequency restoration remFRR activation forecastserve (TenneT TSO) ing (positive/negative) NRV Saldo Network control area balance for NRV balance forecasting Germany Weather & Calendar Data Open-Meteo API Historical and forecast weather Weather covariates for all data forecasting tasks High-resolution weather model High-resolution weather DWD ICON-D2 (2.2 km, Central Europe) features for Germany/Europe Dataset DE Power Wind
Ref. [40] [50, 51]
[40] [50, 51]
[52] [53] [40] [50, 51]
[17] [54]
[55]
[56] [40] [57] [50, 51]
[58] [59] [60][61]
[62] [62] [62]
[63] [64]
4.2. Data Preparation Since 15-minute settlement intervals are the standard for the most of the European and Asian energy markets, all time series are resampled to this resolution. California (CAISO) datasets constitute an exception and are retained at their native 5-minute resolution to reflect US market practices. Datasets with lower native resolution (for example, hourly data) are upsampled by duplicating values within each hour. For datasets with mixed resolutions, such as historic segments at hourly resolution and more recent segments
12
at 15-minute resolution, both resolutions are retained keeping the original time series. Additionally, some time series exhibit varying resolutions with outliers or data gaps resulting in irregular sampling intervals. Mobility datasets typically store individual charging events in a tabular format, recording start time, end time, energy delivered (in Wh or kWh), and, if available, maximum charging power per charging point. For datasets lacking explicit power specifications, a standard charging power of 11 kW was assumed, in line with the prevalent three-phase Type 2 AC charging standard in Europe [65]. From these event-based records, continuous time series were constructed by converting start time, charging power, and energy delivered into aggregated load profiles at 15-minute resolution. Table A.5 provides a statistical overview of all datasets, including sample size (N ), temporal resolution, coefficient of variation (CV), share of negative and positive values, and the Forecastability Index ϕ, which is formally introduced and described in Section 4.4. The collection spans a wide range of signal characteristics, with CV values typically ranging from ≈ 0.18 for stable aggregated signals such as system load to values above 2 for highly volatile signals such as balancing services (CV ≈ 1.7–12) and individual residential loads (CV ≈ 0.9–2.4), with district heat (CV ≈ 0.57) positioned in between. Extreme CV values occur for signals with a near-zero mean, such as low-voltage feeders combining local consumption and PV feed-in (CV ≈ 27), where consumption and generation largely cancel out on average; in such cases, the CV becomes disproportionately large and no longer reflects the effective amplitude of the signal. More generally, a high CV indicates strong amplitude variation relative to the mean, but does not necessarily imply low predictability – a distinction captured by ϕ, which reflects structural regularity independently of the mean. Temporal resolutions mostly lie at 15 minutes, with a few datasets at 5 minutes, 30 minutes, or 1 hour. Negative values – typical for signed quantities such as grid balancing errors or battery charging power – occur primarily in balancing services, some grid feeders, and dispatchable battery profiles. All datasets, except for a small number with license restrictions, are released by the authors in a preprocessed form. 2 4.3. Selected Forecasting Models For our systematic assessment of TSFMs for energy data forecasting, we further select a diverse set of models due to multiple criteria, see Table 3. Only models with openly available weights and code are included. We further aim to include TSFMs that differ in terms of their underlying architecture, i.e., transformer-, state space-, and xLSTM-based approaches. Beyond that, the selected models should allow to evaluate univariate and covariate-informed settings as well as a task-specific fine-tuning, which is currently a limitation for many approaches. The multivariate mode is excluded due to its minimal improvement potential compared to the univariate setup, as shown in the Chronos-2 paper by Ansari et al. [14] (Fig. 10a, p. 22). Finally, we consider performance on the general-purpose benchmarks GIFT-Eval [15] and FEV-Bench [16] as selection criterion.
2
Available at: 10.5281/zenodo.19418721 [66].
13
Table 3: Overview of the forecasting models used in this study, including references and the forecasting modes we employ. Model
Type
Ref.
Mode
Additional Information
Chronos-2
Foundation Model Foundation Model Foundation Model
[14]
Version 2.2.2
[28]
Univariate, Covariate, Finetuning Univariate, Covariate
[31]
Univariate
FlowState
Foundation Model
[30]
Univariate
TabPFN-TS
Foundation Model
[33][34]
Covariate
Random Forest
Bagging Ensemble Gradient Boosting
[26]
Training
[25]
Training
TimesFM TiRex
XGBoost
Version 2.0.0, does not yet support finetuning Version 1.4.0, does not yet support covariates and finetuning Version -r1.1, does not yet support covariates and finetuning TabPFN-TS with TabPFN2.6 [33], Version 7.0.1 (TabPFN), Version 1.0.7 (TabPFN-TS) Version 26.2.0, Built with cuml-cu12 Version 3.1.1, Built with xgboost python package
Most foundation models use attention-based transformer architectures [67], including Chronos-2 [14], TimesFM [28], and TabPFN-TS [34, 33]. To evaluate architectural diversity, we include FlowState [30], a state space model [68] based on S5 [69], and TiRex [31], which uses an xLSTM-based architecture [32]. While TiRex and FlowState only support univariate forecasting, TimesFM and Chronos-2 are considered both in univariate and covariate-informed settings, whereas TabPFN-TS is used in covariate mode. To assess potential benefits of a domain-specific adaptation, we additionally fine-tune Chronos-2 on the respective training datasets. In Figure 4, we provide an overview of the data splits employed for our comparative study. Chronos-2 is fine-tuned using the hyperparameters listed in Table A.6 on the same fixed evaluation block as used in the univariate and covariate modes. All remaining time steps of each dataset constitute the training block, whose length therefore varies per dataset. The training block is segmented into sliding windows of identical context length C and forecast horizon H for each experimental setting, with a window overlap of 75%. A main question of our study is how TSFMs perform compared to state-of-the-art models in energy forecasting, which is why we include the classical machine learning-based approaches XGBoost and random forest – the dominant task-specific baselines in the energy domain as outlined in Section 2. Both are trained task-specific, employing the subsequent pipeline following established practices in the literature [70, 71, 5]: 1. Automatic lag selection: Generation of candidate lagged features and selection of the most informative lags based on SHAP importance scores. 2. Feature selection: Retention of the top 50 features from lagged features and engineered features using SHAP values to reduce dimensionality and prevent overfitting. 3. Hyperparameter optimization: Bayesian optimization with Optuna, using 250 trials per quantile and validation performance in terms of the mean squared error for the median and the pinball loss for the other quantiles as objective. An overview of the hyperparameters considered and their ranges is given in Table A.6.
14
4. Final retraining: Training of the final model on the full training set using the selected features and optimized hyperparameters. 5. Evaluation: Evaluation employing recursive multi-step-ahead forecasting without retraining, as frequent retraining is often not required to maintain comparable forecast accuracy while reducing computational costs [72], although distribution shifts may require model updates [11, 12]. Figure 4 illustrates this in more detail. Similar to fine-tuning Chronos-2, XGBoost and random forest are trained on the same training block using the hyperparameters listed in Table A.6 and the evaluation setup shown in Figure 4. For hyperparameter optimization, a subset of at most 5 000 time steps is drawn from the end of the training block; this subset is further split 80/20 into an hyperparameter optimization (HPO) training and an HPO validation set used as the Optuna objective. Final models are then retrained on the full training block, with lag features constructed from a context window of length C to ensure comparability with the TSFMs. All experiments were conducted on a multi-GPU server equipped with 2× AMD EPYC 9334 CPUs, 1.1 TiB of memory, and 4× NVIDIA RTX 6000 Ada Generation GPUs (48 GB VRAM each). Running the complete benchmark in parallel across multiple workers required approximately one week of wall-clock time, with the dominant share attributed to the training of random forest and XGBoost models as well as the fine-tuning of Chronos-2. The benchmark and in particular inference of the foundation models can also be executed on a single, less powerful GPU. 4.4. Evaluation Figure 4 illustrates the rolling evaluation scheme applied uniformly across all datasets and model types. Each dataset is split into a training/fine-tuning block of datasetdependent length and a fixed evaluation block, on which all models are evaluated under identical conditions. In the following, we first introduce the forecasting error metric and the Forecastability Index, then describe the benchmark configuration along three key dimensions, and finally detail the training and evaluation procedure. We evaluate the forecasting performance using the Normalized Root Mean Squared Error (NRMSE), a standard metric in energy forecasting that enables comparison across time series with different scales and units. Using the mean absolute value of the observations |y| defined as n
|y| =
1X |yi |, n i=1
where yi denotes the observed values and n the number of time steps, the NRMSE for the predicted values ŷi can be determined as v u n X 1 u t1 NRMSE = (yi − ŷi )2 . n i=1 |y| We normalize using the mean absolute value, since this is more robust for approximately stationary signals with near-zero means. Such time series are for instance occurring for battery storage dispatch profiles where charging and discharging power approximately
15
Dataset sample length N Full Dataset HPO Optimization
HPO Training
Training Finetuning
Val
Training Context H
Evaluation Shift 0
Evaluation block
start
Context H
Evaluation Shift 1
Evaluation block steps Context H
Evaluation Shift 2
Evaluation block .. .
.. .
Evaluation Shift K
Context H
Evaluation block start eval block t0
Evaluation block
Training Context
end eval block tend
train end
Full dataset
end
Validation
time
Horizon (H)
End buffer
Figure 4: Data splitting and rolling evaluation scheme. Each dataset is divided into a training/fine-tuning block of dataset-dependent length and a fixed evaluation block of 4,500 steps plus a 1,000-step buffer matching the maximum forecast horizon of Chronos-2. Within the evaluation block, a rolling scheme shifts the context window and horizon H in steps of 132, yielding W = ⌈4,500 / 132⌉ = 35 windows per model and horizon.
16
cancel out over operating cycles. Furthermore, this normalization allows for an approximate interpretation as a percentage error, making NRMSE particularly intuitive, with, e.g., a NRMSE of 0.05 corresponding approximately to 5% deviation from typical signal levels. To assess the model performance across our diverse collection of datasets, we further aim to quantify the intrinsic predictability of each time series independent of model choice. Analogous to Shannon’s 1951 finding [73] that English is predictable due to its low entropy (resulting from non-random letter frequencies), spectral entropy may quantify time series predictability by measuring deviation from uniform frequency distributions and therefore periodicity. Hence, we employ the spectral entropy-based Forecastability Index ϕ [74], a widely used metric for determining time series complexity, defined as ϕ=1−
where pk = |Fk |2 /
m X
H Hmax
with
H=−
m X
pk log(pk ),
k=1
|Fj |2 represents the normalized power at frequency k, Fk are
j=1
the real Fast Fourier Transform (FFT) coefficients of the mean-centered series, and Hmax = log(m) is the maximum spectral entropy for m frequency components. Values range from 0 (random, unforecastable) to 1 (highly periodic, easily forecastable). For a comprehensive assessment of prediction performance, our benchmark study is configured along three key dimensions: Ó Context Length Three context lengths are evaluated: 672, 2,000, and 8,000 steps. The minimum of 672 steps corresponds to one week at 15-minute resolution – the most prevalent resolution across the dataset collection. The maximum of 8,000 steps represents a trade-off between the upper context limits of TimesFM-2.5 (16,384 steps) and FlowState (≈16,000 steps at scale_factor = 0.25; no architectural sequencelength constraint) on the one hand, and the shorter context windows of Chronos-2 (8,192 steps) and TiRex (2,048 steps) on the other; Chronos-2 is evaluated near its maximum at this length. FlowState’s SSM-based encoder can in principle process arbitrarily long contexts, subject only to available memory; the pretrained checkpoint specifies a default context length of 4,096 steps. TabPFN-TS is not constrained by a fixed context window but operates on the underlying TabPFN-2.6 model, for which a recommended maximum of 50,000 samples applies; both are evaluated at the same lengths for comparability. The intermediate length of 2,000 steps was identified as a favorable trade-off in a preliminary sensitivity analysis and approximates the maximum context length of TiRex. Ó Forecast Horizon Horizons of 96, 192, and 288 steps are used, corresponding to 1, 2, and 3 days at 15-minute resolution. These intervals cover typical short-term forecasting periods relevant to operational energy systems planning. Ó Rolling Windows Evaluation is performed over 35 rolling windows with a step size of 132 steps. The number of windows reflects a trade-off between the length of the
17
shortest dataset and total computation time, while ensuring coverage of diverse temporal conditions including varying times of hour, day, weekdays, and months. Full seasonal cycles cannot be adequately represented due to the limited length of several datasets. The training and evaluation procedure visualized in Figure 4 is implemented as follows: For HPO-based models (XGBoost, random forest), a subset of the training block is split 80/20 into a training and a validation set for hyperparameter search; once the optimal hyperparameters are found, the model is retrained on the full training block. For finetuning-based models, the full training block is used directly without any validation split. To ensure comparability with TSFMs, lag features for random forest and XGBoost are constructed from a context window of length C, matching the TSFM context window.
18
5. Results We present our results in three parts: (1) an aggregated overview across all data categories and model configurations, (2) an analysis of the relationship between forecastability and prediction performance, and (3) a sensitivity analysis of the top-performing model investigating the influence of context length, forecast horizon, and aggregation level. Detailed per-dataset results are provided in the Appendix in Tables B.7, B.8, and B.9. 5.1. Results Overview Table 4 presents the aggregated results of all benchmark experiments. Figure 5 illustrates the underlying aggregation pipeline: experiment-level NRMSE values are first aggregated per (dataset, target) – as reported in Tables B.7, B.8 and B.9 – then per data category, and finally globally across all experiments to form the overall and best-count rows of Table 4. Mode Model
univariate / covariate / training
Dataset × Target
Context Length
54 series
{672, 2000, 8000}
Single Experiment one NRMSE value
Rolling Windows
Horizon {96, 192, 288}
≈ 35 shifts
≈ 17,010 experiments per mode
Min, Q25, median, Q75, Max
Aggregate over rolling windows, context length, horizon per model, per (dataset, target)
⇒ Tables B.7, B.8, B.9
median of medians, (Q10, Q90)
Aggregate over datasets within category
⇒ Table 4
per model, per data category
Overall Row
Best Count Row
median across all experiments
wins per (dataset, target, context, horizon)
Figure 5: Aggregation pipeline of the benchmark results, from individual experiments to the per-category, overall, and best-count rows of Table 4.
Each row reports the average of the median NRMSE values across all experiments within a given data category. The experiments cover different model modes and forecasting models as described in Section 4.3. The summary row overall reports the overall median NRMSE across all experiments. The best count row indicates the number of times a model achieves the best performance for a given experimental setting, defined by identical horizon length, context length, and prediction target, while varying rolling windows and covariate configurations. We observe that covariate-informed approaches achieve the best performance with the lowest overall median NRMSEs across these three approaches ranked first and dominate in
19
terms of total wins across all 17,010 experiments (Table 4). Chronos-2 (covariate) achieves both the overall lowest median NRMSE of 0.421 and the most wins among all individual model modes with 3,399 wins (20%). Figure 6 further illustrates the complementary strengths of the two best-performing (in terms of the median NRMSE) models through a closer pairwise comparison between Chronos-2 (covariate) and TabPFN-TS (covariate). Chronos-2 (covariate) achieves a higher overall win rate across all paired experiments and prevails in the majority of individual experiment settings within each data category. Table 4: Results overview across all benchmark modes. Each cell shows the averaged median NRMSE across all datasets and configurations for each data category and prediction model. Best median per benchmark highlighted. Best Count shows wins across all benchmarks. Total: 17,010 unique experiments (Dataset:Target × Rolling Windows × Horizon × Context Length) evaluated for each model across different benchmark modes. Values shown as median with (Q10, Q90) interval for classes and overall row. For Best Count, All = Total - Ties = 17,010 - 9 = 17,001. A orange background marks the best model within each benchmark mode, while a green background highlights the overall best across all modes in each row. Data Category
Univariate
Covariate
Training
TimesFM
Chronos-2
FlowState
TiRex
Chronos-2
TabPFN
TimesFM
Chronos-2
RandomForest
XGBoost
Balancing Services
2.24
2.26
2.25
2.27
2.26
2.24
2.57
2.25
2.50
2.61
⟨1.65, 6.28e5⟩
⟨1.63, 6.21e5⟩
⟨1.64, 1.99e6⟩
⟨1.65, 6.21e5⟩
⟨1.65, 2.00e6⟩
⟨1.64, 6.71e6⟩
⟨1.74, 2.15e8⟩
⟨1.63, 7.37e7⟩
⟨1.63, 1.68e10⟩
⟨1.63, 1.25e9⟩
Dispatchable Generation
0.410
0.384
0.451
0.459
0.398
0.428
0.654
0.707
0.639
0.535
⟨0.342, 0.519⟩
⟨0.359, 0.487⟩
⟨0.346, 1.02⟩
⟨0.398, 0.545⟩
⟨0.267, 0.456⟩
⟨0.295, 0.461⟩
⟨0.387, 0.695⟩
⟨0.524, 1.47⟩
⟨0.462, 1.19⟩
⟨0.385, 0.577⟩
Grid Data
0.567
0.544
0.530
0.590
0.437
0.427
0.450
0.498
0.597
0.489
⟨0.125, 0.921⟩
⟨0.118, 0.849⟩
⟨0.120, 0.905⟩
⟨0.121, 0.909⟩
⟨0.112, 0.510⟩
⟨0.116, 0.589⟩
⟨0.137, 0.656⟩
⟨0.154, 0.862⟩
⟨0.223, 0.891⟩
⟨0.173, 0.647⟩
0.827
0.796
0.816
0.849
0.778
0.822
0.815
0.793
0.997
0.990
⟨0.283, 0.894⟩
⟨0.282, 0.885⟩
⟨0.287, 0.918⟩
⟨0.292, 0.952⟩
⟨0.245, 0.898⟩
⟨0.272, 0.967⟩
⟨0.300, 0.946⟩
⟨0.269, 0.842⟩
⟨0.343, 1.17⟩
⟨0.305, 1.16⟩
0.031
0.032
0.092
0.037
0.029
0.064
0.066
0.146
0.098
0.062
⟨0.027, 0.196⟩
⟨0.028, 0.181⟩
⟨0.038, 0.189⟩
⟨0.035, 0.202⟩
⟨0.026, 0.182⟩
⟨0.042, 0.200⟩
⟨0.051, 0.252⟩
⟨0.105, 0.415⟩
⟨0.051, 0.216⟩
Heat Data Load Market Data Mobility Data Non-Dispatchable Generation Residential Load Overall Best Count (All)
⟨0.041, 0.195⟩
0.313
0.319
0.333
0.319
0.295
0.288
0.386
0.332
0.485
0.545
⟨0.270, 0.537⟩
⟨0.258, 0.539⟩
⟨0.291, 0.520⟩
⟨0.275, 0.545⟩
⟨0.264, 0.495⟩
⟨0.268, 0.492⟩
⟨0.356, 0.637⟩
⟨0.286, 0.526⟩
⟨0.361, 0.689⟩
⟨0.501, 0.848⟩
0.683
0.699
0.578
0.862
0.698
0.655
0.712
1.01
0.865
0.808
⟨0.413, 1.09⟩
⟨0.411, 1.08⟩
⟨0.334, 1.04⟩
⟨0.455, 1.13⟩
⟨0.417, 1.08⟩
⟨0.384, 1.10⟩
⟨0.438, 1.13⟩
⟨0.465, 1.58⟩
⟨0.509, 1.22⟩
⟨0.482, 1.19⟩
0.588
0.570
0.618
0.581
0.269
0.333
0.346
0.566
0.614
0.441
⟨0.410, 0.993⟩
⟨0.387, 0.988⟩
⟨0.470, 1.26⟩
⟨0.401, 0.932⟩
⟨0.197, 0.674⟩
⟨0.256, 0.660⟩
⟨0.205, 0.700⟩
⟨0.271, 1.33⟩
⟨0.374, 1.18⟩
⟨0.322, 0.816⟩
0.798
0.783
0.796
0.785
0.788
0.806
0.857
0.806
0.917
0.961
⟨0.581, 1.07⟩
⟨0.578, 1.06⟩
⟨0.579, 1.03⟩
⟨0.582, 1.07⟩
⟨0.580, 1.07⟩
⟨0.584, 1.10⟩
⟨0.613, 1.17⟩
⟨0.593, 1.09⟩
⟨0.630, 1.31⟩
⟨0.678, 1.59⟩
0.589
0.575
0.612
0.591
0.421
0.432
0.523
0.617
0.659
0.603
⟨0.261, 0.980⟩
⟨0.250, 0.977⟩
⟨0.269, 1.04⟩
⟨0.265, 1.00⟩
⟨0.198, 0.839⟩
⟨0.229, 0.864⟩
⟨0.266, 1.02⟩
⟨0.271, 1.06⟩
⟨0.343, 1.17⟩
⟨0.319, 1.10⟩
1,121 (7%)
1,175 (7%)
1,650 (10%)
888 (5%)
3,399 (20%)
2,134 (13%)
1,521 (9%)
2,665 (16%)
961 (6%)
1,487 (9%)
Mode Winner
Category Winner / Overall Winner
20
+6.2%
+0.9% +2.3% +2.2%
0 -2.3%
-5.7%
-7.4%
-2.6%
100 80
-23.5%
−40
941 669 2,277
1,444 10,484
−60
726
907
1,938
1,055
527
−80
534
668
1,527
835
418
60 40
Win rate [%]
Rel. NRMSE [%]
−20
6,526 1,188
761
276
−100
319
−120
-116.5%
s d n ta ad on ata ata ata oa ice tio Lo t Da erati l L ity D Serv rid D et D nera a a i n e k e r G H bil Ge dent ing Ma ble G Mo lanc ble Resi a a a h h B atc atc isp isp D D n-
TabPFN Chronos-2
20 0
all
er Ov
No
Figure 6: Pairwise relative NRMSE comparison between TabPFN (covariate) and Chronos-2 (covariate), the two top-ranked models by overall median NRMSE (cf. Table 4). Bars show (Chronos − 2 − T abP F N )/Chronos − 2 × 100%; positive values (amber) favour TabPFN, negative values (blue) favour Chronos-2. Lines (right axis) show per-category win rates with absolute counts in parentheses. Overall, Chronos-2 wins 62% of the 17,010 paired experiments, yielding a net relative improvement of 2.6%.
21
5.2. Results Analysis Since our results overview shows that Chronos-2 achieves the overall lowest median NRMSE and the highest total number of wins across all experiments, and given that its pairwise performance advantage over the second-ranked TabPFN-TS (covariate) is considerably larger than vice versa, we focus on Chronos-2 in its three forecasting modes for further analysis. In Figure 7, we analyze the correlation between the Forecastability Index ϕ (see Section 4.4) and the forecasting performance defined as 1 − N RM SE, aiming to compare the prediction performance with the intrinsic predictability of a time series. Values with an NRMSE larger than one are clipped to zero. For each dataset–target combination and model mode (varying rolling windows, context lengths, and forecast horizons), we computed the median across all results. The plot reveals a strong correlation between forecasting performance and forecastability (r = 0.673, p < 0.001). As expected, datasets with higher intrinsic stability such as aggregated country loads, aggregated load on grids, and aggregated heat demands are considerably better predictable for Chronos-2. In contrast, highly volatile time series, including single residential loads or balancing services, show substantially lower predictability. Given this relatively high correlation, the Forecastability Index ϕ may serve as an indicator for the predictability of a data category. However, it does not provide an absolute measure, meaning that the scaling of ϕ and the actual forecast score (1-NRMSE) may not be directly proportional, i.e., a high ϕ does not guarantee a correspondingly high forecast performance in absolute terms.
22
Forecastability vs. Forecast Performance (Chronos2, all settings)
Forecast Score (1-NRMSE)
Data Categories
0.75
Balancing Services Dispatchable Generation Grid Data Heat Data Load Market Data Mobility Data Non-Dispatchable Generation Residential Load
0.50
Mode
1.00
r = 0.673, p < 0.001
Univariate Training Covariate
0.25
0.00 0.0
0.2
0.4
0.6
0.8
1.0
Forecastability ϕ
Figure 7: Forecastability analysis for Chronos-2 across all experimental settings. The x-axis shows the Forecastability Index ϕ of each dataset – a measure of inherent predictability based on signal regularity – while the y-axis reports the forecast score (1-NRMSE), where higher values indicate better performance. A positive correlation (r = 0.673, p < 0.001) confirms that datasets with more regular patterns yield consistently better forecasts. Datasets with higher aggregation levels – such as grid data and heat data (upper right) – exhibit both high forecastability and strong forecast scores, suggesting that spatial or temporal aggregation smooths stochastic variability. In contrast, granular datasets such as individual residential load profiles cluster in the lower-left region. Surprisingly, some cases with high forecastability but near-zero forecast scores may indicate catastrophic forgetting during fine-tuning [75], which remains an open question for future work (see Section 6).
23
5.3. Sensitivity Analyses We further examine the influence of three key parameters on the performance of the overall best performing model Chronos-2 (covariate), i.e., the context length, the forecast horizon, and the data aggregation level. All experiments maintain the same configurations as the main benchmark settings (see the benchmark overview in section 4 and the evaluation scheme in section 4.4) to ensure consistency and comparability. First, we analyze the sensitivity with respect to the context length, increasing it from 100 to 8,000 time steps (the maximum context length of Chronos-2). In Figure 8, we show the results for four different datasets. The four datasets are representative examples drawn from three data categories – load data (country-level and industrial aggregation), market data, and grid data – with consistent behavior observed across additional datasets within each category; analogous plots for all datasets are provided in the supplementary material. Across all datasets and forecast horizons, we observe a relatively consistent pattern with a decreasing median NRMSE as context length increases, with performance saturating at a context length of approximately 2,000 time steps. We further examine the influence of the forecast horizon, gradually increasing it from 100 up to 1,000 time steps (the maximum horizon supported by Chronos-2). We again selected the same four datasets and show the results in Figure 9. Across all datasets and context lengths, the analysis reveals a decrease in predictive performance as the horizon length increases, reflecting the well-known effect that forecasts become increasingly uncertain the further they extend into the future. For a shorter context length, this performance decrease is a bit more pronounced and sets in earlier. For analyzing the effect of the aggregation level in Figure 10, we use the datasets HTW Berlin Households [55], Mobilithek [42], and Industrial VEA Profiles [53], selected from residential load, market data, and mobility data as representative datasets containing multiple target variables suitable for aggregation. Here, we observe that the forecast error consistently decreases with increasing aggregation level. This decrease indicates that temporal smoothing through aggregation improves overall forecasting accuracy. This behavior is characteristic for aggregated energy time series and aligns with the concept of standard load profiles, where larger aggregated groups of consumers tend to exhibit more predictable, standardized patterns [76, 77].
24
Horizon 96
80
70
60
50
40
30
20
10
0.20
0.15
0.15
0.15
0.10
0.10
0.10
0.05
0.05
0.05
0.00
0.00
0.00 10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.20
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.20
0.700
0.525
0.525
0.525
0.350
0.350
0.350
0.175
0.175
0.175
0.000
0.000
0.000 10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.700
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.700
0.250
0.125
0.125
0.125
0.000
0.000
0.000
80
70
60
50
00
40
00
30
20
10
10
Context Length
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.250
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.250
00
0.375
00
0.375
00
0.375
00
0.500
00
0.500
0 00
0.500
Context Length
Horizon 288
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.0
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
0.0 00
0.0 00
0.1
00
0.1
00
0.1
00
0.2
00
0.2
00
0.2
10
NRMSE NRMSE
0.4 0.3
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
NRMSE
Industrial VEA 2 Agg Profiles California Caiso
Horizon 192
0.3
10 0 10 00 20 00 30 00 40 00 50 00 60 00 70 00 80 00
FR Power
0.4
0.3
0 00
NRMSE
Netze BW LV, Feeder 160
0.4
Context Length
Figure 8: Context length sensitivity analysis for Chronos-2 (covariate mode) across four representative datasets spanning load, market, and grid data categories, evaluated at forecast horizons of 96, 192, and 288 time steps. Each box plot summarizes the NRMSE distribution across all rolling windows within the respective dataset, with the red dashed line indicating the median trend. Context length ranges from 100 to 8,000 time steps (maximum supported by Chronos-2). Datasets include country-level (FR Power) [40] and industrial load aggregations (Industrial VEA) [53], market data (California Caiso) [51], and grid data (Netze BW LV) [60].
25
Context 672
Context 2000
0.3500
0.1750
0.1750
0.1750
0.0875
0.0875
0.0875
0.0000
0.0000
0.0000
0.09
0.09
0.09
0.06
0.06
0.06
0.03
0.03
0.03
0.00
0.00
0.00 0.60
0.45
0.45
0.45
0.30
0.30
0.30
0.15
0.15
0.15
0.00
0.00
0.00 4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.60
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.60
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.60
0.45
0.45
0.45
0.30
0.30
0.30
0.15
0.15
0.15
0.00
0.00
0.00
Horizon
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.60
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.60
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
NRMSE NRMSE
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.12
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.12
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.12
Horizon
Context 8000
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.2625
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
0.2625
NRMSE
DE Power Industrial VEA 2 Agg Profiles California Caiso
0.3500
0.2625
4 100 0 20 0 30 0 40 0 50 0 60 0 70 0 80 0 90 0 10 00
NRMSE
Netze BW LV, Feeder 160
0.3500
Horizon
Figure 9: Forecast horizon sensitivity analysis for Chronos-2 (covariate mode) across four representative datasets, evaluated at context lengths of 676, 2,000, and 8,000 time steps. The x-axis spans forecast horizons from 100 to 1,000 time steps, reflecting the full supported range of Chronos-2. Each box plot summarizes the NRMSE distribution across all time series within the respective dataset, with the red dashed line indicating the median trend. Datasets include country-level (DE Power) [40] and industrial load aggregations (Industrial VEA) [53], market data (California CASIO) [51], and grid data (Netze BW LV) [60].
26
0.22
0.22
0.15
0.15
0.15
0.07
0.07
0.07
0.00
0.00
0.00
0.75
0.75
0.75
0.00
0.00
0.00
Aggregation Level
64 80
32
16
8
Aggregation Level
50 00
1.50
50 0 10 00
1.50
50 00
1.50
50 0 10 00
2.25
50 10 0
2.25
10
2.25
50 00
3.00
50 0 10 00
3.00
50 10 0
3.00
50 10 0
2 4 8 16 32 6 1104 208 25 6 51 2 10 24 20 48 40 96
0.22
2 4 8 16 32 6 1104 208 25 6 51 2 10 24 20 48 40 96
0.30
10
NRMSE
64 80
64 80
0.30
2 4 8 16 32 6 1104 208 25 6 51 2 10 24 20 48 40 96
NRMSE
0.30
4
0.00 2
0.00 32
0.00
16
0.19
8
0.19
4
0.19
2
0.38
32
0.38
16
0.38
8
0.56
4
0.56
Aggregation Level
Horizon 288
0.75
0.56
2
NRMSE
Household Demand Industrial VEA EV Charging Stations
Horizon 192
0.75
10
Horizon 96
0.75
Figure 10: Aggregation level sensitivity analysis for Chronos-2 (covariate mode) across three representative datasets – residential household demand [55], EV charging stations [42], and industrial load profiles [53] – evaluated at forecast horizons of 96, 192, and 288 time steps. The x-axis represents the number of aggregated individual time series, ranging from a single profile up to the full available pool. Each box plot summarizes the NRMSE distribution, with the red dashed line indicating the median trend. The decreasing error with increasing aggregation level reflects the smoothing effect of temporal aggregation, characteristic of energy demand patterns described by standard load profiles [76, 77].
27
6. Discussion Figure 2 provides an overview of the wide variation and diverse stakeholder interests within energy-related forecasting. This illustration demonstrates the breadth of the domain and shows that general-purpose benchmarks such as GIFT-EVAL [15] and FEV-Benchmark [16] underrepresent energy-specific challenges by collapsing the domain into a single energy category. Our chosen categorization represents a deliberate trade-off between a datasetlevel view, which would be too fragmented, and such a monolithic energy data category, which obscures distinct stakeholder perspectives and forecasting requirements. Our dataset selection, though limited to available open data, aims to bridge this gap between generalpurpose benchmarks and the energy forecasting view. Future extensions could incorporate additional datasets to achieve broader geographic coverage, finer subdivisions within each data category. In particular, a finer-grained structure would allow to capture the heterogeneity within certain categories more accurately. Nonetheless, the fundamental insights presented here are unlikely to change substantially. 6.1. Model Performance Table 4 demonstrates that TSFMs in covariate and zero-shot settings consistently deliver superior performance across energy data categories. Notably, TSFMs outperform specialized models including XGBoost and random forest, even when these models are optimized taskspecifically using automated hyperparameter tuning and feature engineering. Additional manual feature engineering might further improve specialized model performance for specific datasets, but similar optimization opportunities exist for TSFMs through covariate engineering and fine-tuning. Overall, this zero-shot predictive superiority of covariateinformed TSFMs substantially reduces the need for dataset-specific model architectures and training procedures, enabling rapid deployment and scalability across the energy industry. Further advantages are that (1) no data-specific information can be incorporated in parameters during model training, often an issue for sensitive energy data and that (2) no computationally expensive model updates in the context of changing data distributions that often occur in time series are needed. 6.2. Forecastability and Aggregation Effects Figure 7 establishes the relationship between forecasting performance and the Forecastability Index ϕ, providing practitioners with a heuristic for assessing time series predictability prior to model deployment. Stationary time series exhibit higher ϕ values due to their regularity, correlating with superior forecast performance, while unstable signals show lower ϕ values and reduced predictability. Aggregated load categories – including country-level load data, grid data, and district heat data – consistently exhibit superior forecastability compared to individual residential loads or balancing service activations characterized by high temporal irregularity. The aggregation sensitivity analysis in Figure 10 confirms these findings, indicating an inverse relationship between aggregation level and forecasting error. From an energy systems forecasting perspective, these results suggest prioritizing grid-level or communitylevel coordination over individual asset optimization, as higher aggregation yields more reliable forecasts than single residential household or asset-level approaches. Since forecasts
28
serve as direct inputs to energy optimization workflows, more accurate forecasts typically translate into better optimization outcomes, e.g., in terms of cost savings or revenue. This supports the concept of local energy communities, where clusters of participants (prosumers, industrial and commercial consumers) are coordinated together rather than optimized in isolation, and aligns with established standard load profile concepts [76, 77], where larger consumer aggregations exhibit more predictable consumption patterns. 6.3. Limitations Despite recent advances in machine learning methods, inherent forecast uncertainty persists in energy time series. Certain data categories remain particularly difficult, such as balancing services with their complex and stochastic system dynamics or individual residential loads that are strongly shaped by individual household behavior, reflecting the irreducible uncertainty inherent to the stochastic nature of the system. A first limitation of this work is the reliance on publicly available datasets, which underrepresent several relevant asset types and stakeholder perspectives for which no open data is available, as well as some market designs and regulatory environments. Moreover, our evaluation remains restricted to independent data categories rather than coherent, system-wide compositions. As a result, our findings may not directly transfer to all regional contexts or highly specialized industrial applications, even though the qualitative patterns around aggregation and TSFM performance are likely to be robust. Expanding dataset coverage to include more countries and market structures would provide broader validation, though fundamental insights regarding aggregation benefits and TSFM superiority are unlikely to change with extended coverage. Second, our evaluation focuses on point forecasts and a single class of error metrics. We do not provide a full probabilistic assessment of uncertainty, nor do we study asymmetric cost structures or tail risks in depth. In operational settings, operators should therefore complement point forecast accuracy with scenario analysis or probabilistic methods that explicitly represent residual uncertainty. Finally, while we compare strong baselines and state-of-the-art TSFMs, we do not exhaust the design space of model architectures, fine-tuning strategies, or feature engineering pipelines. There may exist configurations that perform better on specific datasets than those reported here. Consequently, our results should be interpreted as evidence for the competitiveness and practicality of TSFMs in energy forecasting, rather than as a definitive upper bound on achievable performance. 6.4. Recommendations Based on these findings, we outline practical recommendations for practitioners and policymakers. Our results indicate that the most promising practical setup is to use state-ofthe-art TSFMs in the covariate mode for in-context learning with typical exogenous features such as weather variables and temporal features. In practice, this suggests that future deployments should focus on such covariate setups, where there is still substantial feature engineering potential by systematically experimenting with different feature combinations and transformations. Fine-tuning of large models in this domain is still an active research topic, and given the urgent need for acceleration of the energy transition, it seems advisable
29
to wait for more mature evidence and improved fine-tuning algorithms before relying on large-scale fine-tuning in production systems. From a policy perspective, it appears more beneficial to prioritize regulations that explicitly enable energy sharing, energy cells, and aggregation at higher grid levels, rather than predominantly focusing on optimizing individual assets in isolation. By shifting the regulatory focus towards coordinated operation and forecasting at aggregated levels, system operators can exploit the improved forecasting accuracy that modern models provide at these scales, which is likely to yield higher overall socio-economic value. From a broader perspective, these findings raise the question of whether regulatory frameworks should facilitate such coordination and aggregation rather than incentivize isolated single-asset optimization, a direction that the forecasting evidence presented here would support, but whose broader implications go beyond the scope of this work. 7. Conclusion This work demonstrates that time series foundation models are not only viable for diverse energy forecasting applications but frequently outperform specialized models such as XGBoost and random forest regressors, i.e., the current state-of-the-art, across multiple data categories. Critically, TSFMs eliminate the need for extensive model training, requiring only a context window rather than year-long historical datasets. This substantially reduces deployment time and directly addresses a central barrier of data-scarce applications in the energy domain – including newly commissioned renewable generation assets that lack sufficiently long historical records, operator portfolios constrained by organisational data silos arising from unbundling requirements and market regulation, as well as niche applications and small-scale energy assets for which the effort of training dedicated models is typically not justified – thereby unlocking significant scalability potential even in fragmented, data-limited deployment environments. Our analysis establishes spectral entropy as an effective forecastability indicator, enabling practitioners to assess predictability limits prior to deployment. Furthermore, aggregated datasets consistently show better predictability compared to individual time series, with forecast error decreasing with aggregation level. A natural next step would be to evaluate TSFMs on a holistic representation of a regional energy system – jointly covering individual households and industrial sites, lowand medium-voltage distribution grids, and transmission-level loads and generation within a single geographic region – to assess whether a shared forecasting backbone can consistently capture dependencies across aggregation levels instead of forecasting each level in isolation. Future work should also investigate fine-tuning strategies for TSFMs tailored to specific energy data categories or trained across all energy time series collectively, and explore how different foundation models can be combined, for example through simple ensembles or complementary in-context prompts. In addition, more systematic covariate engineering for TSFMs – including the design and evaluation of domain-specific feature sets for weather, markets, and operational constraints – remains an open engineering task. The demonstrated ability of TSFMs to generalize across diverse energy time series data categories without dataset-specific retraining suggests a promising direction for future work, i.e., investigating whether such universal forecasting properties can serve as a key
30
component in emerging dynamic network management schemes. This could be a first step towards fully dynamic flexible connection agreements, where asset-agnostic forecasting across heterogeneous grid-connected assets is a direct operational prerequisite, and in further steps towards fully dynamic grid tariffs that require consistent, portfolio-wide load and generation forecasting across all connected stakeholders, including an individual assessment of each network line. Given the rapid pace of development in this field, with continuously emerging novel TSFM models, ongoing evaluation remains essential; while this study builds on the most recent approaches available at the time, future work should continue to incorporate and assess newly developed models.
31
CRediT Author Statement Marco Obermeier: Conceptualization, Methodology, Software, Visualization, Formal Analysis, Data Curation, Investigation, Writing – Original Draft. Marco Pruckner: Supervision, Writing – Review & Editing. Florian Haselbeck: Supervision, Writing, Funding acquisition – Review & Editing. Andreas Zeiselmair: Supervision, Writing, Funding acquisition – Review & Editing. Declaration of Generative AI and AI-assisted Technologies During the preparation of this work, the authors used AI-assisted tools for language editing and code development. After using these tools, the authors reviewed and edited the content as needed and take full responsibility for the content of the publication. Declaration of Competing Interests The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. Acknowledgements The authors thank the open-source community for providing the tools and libraries this work builds on, including Chronos, TimesFM, TiRex, FlowState, XGBoost, and random forest. We further thank all data providers for making their datasets publicly available, enabling reproducible research in the energy domain. The initial idea for this work emerged during the first author’s prior collaboration with the TiRex development team at Johannes Kepler University Linz (JKU), whose pioneering work on zero-shot time series forecasting provided the key inspiration for this research. The work was subsequently realized and further improved at Weihenstephan-Triesdorf University of Applied Sciences within the smartBattery project, funded by the Deutsche Bundesstiftung Umwelt (DBU) under grant number 40164-01 and co-funded by Bayernwerk Netz GmbH. The smartBattery project investigates AI-based methods for the grid-serving integration of large-scale battery storage systems. Within this context, the present work contributes universal and generalizable forecasting approaches – including envelope-based predictions – as a foundational step toward the implementation of dynamic grid tariffs.
32
References [1] Hossain E, Khan I, Un-Noor F, Sikander SS, Sunny MSH. Application of Big Data and Machine Learning in Smart Grid, and Associated Security Concerns: A Review. IEEE Access 2019; 7:13960–13988. https://doi.org/10.1109/ACCESS.2019.2894819 [2] Rolnick D, Donti PL, Kaack LH, Kochanski K, Lacoste A, Sankaran K, et al. Tackling Climate Change with Machine Learning. ACM Comput Surv 2022; 55(2):42:1–96. https://doi.org/10.1145/3485128
[3] Antonopoulos I, Robu V, Couraud B, et al. Artificial intelligence and machine learning approaches to energy demand-side response: A systematic review. Renewable and Sustainable Energy Reviews 2020; 130:109899. https://doi.org/10.1016/j.rser.2020. 109899
[4] Browell J, van der Meer D, Kälvegren H, et al. The hybrid renewable energy forecasting and trading competition 2024. International Journal of Forecasting 2025. https: //doi.org/10.1016/j.ijforecast.2025.10.005
[5] Pu C, Fan F, Tai N, Liu S, Yu J. A hybrid strategy for probabilistic forecasting and trading of aggregated wind-solar power: Design and analysis in HEFTCom2024. International Journal of Forecasting 2025. https://doi.org/10.1016/j.ijforecast. 2025.11.008
[6] Wahl M, Bayer D, Rausch S, Pruckner M. Benchmarking Transformer and xLSTM for Time-Series Forecasting of Heat Consumption. In: IEEE Conference on Technologies for Sustainability (SusTech) 2026, San Diego. IEEE; 2026. (to appear). [7] Bayer D, Haag F, Pruckner M, Hopf K. Electricity Demand Forecasting in Future Grid States: A Digital Twin-Based Simulation Study. In: 9th International Conference on Smart and Sustainable Technologies (SpliTech) 2024, Split. IEEE; 2024. https: //doi.org/10.23919/SpliTech61897.2024.10612563
[8] Donti PL, Kolter JZ. Machine Learning for Sustainable Energy Systems. Annual Review of Environment and Resources 2021; 46:719–47. https://doi.org/10.1146/ annurev-environ-020220-061831
[9] Aslam S, Herodotou H, Mohsin SM, Javaid N, Ashraf N, Aslam S. A survey on deep learning methods for power load and renewable energy forecasting in smart microgrids. Renewable and Sustainable Energy Reviews 2021; 144:110992. https: //doi.org/10.1016/j.rser.2021.110992
[10] Pan SJ, Yang Q. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering 2010; 22(10):1345–59. https://doi.org/10.1109/TKDE.2009.191 [11] Ditzler G, Roveri M, Alippi C, Polikar R. Learning in Nonstationary Environments: A Survey. IEEE Computational Intelligence Magazine 2015; 10(4):12–25. https://doi. org/10.1109/MCI.2015.2471196
33
[12] Haselbeck F, Grimm DG. EVARS-GPR: EVent-Triggered Augmented Refitting of Gaussian Process Regression for Seasonal Data. In: Edelkamp S, Möller R, Rueckert E, editors. KI 2021: Advances in Artificial Intelligence. Springer International Publishing; 2021. https://doi.org/10.1007/978-3-030-87626-5_11 [13] Ansari AF, Stella L, Turkmen C, Zhang X, Mercado P, Shen H, et al. Chronos: Learning the Language of Time Series. arXiv preprint 2024; arXiv:2403.07815. https: //doi.org/10.48550/arXiv.2403.07815
[14] Ansari AF, Shchur O, Küken J, Zhang X, Zschiegner J, Hoof H, et al. Chronos-2: From Univariate to Universal Forecasting. arXiv preprint 2025; arXiv:2510.15821. https://doi.org/10.48550/arXiv.2510.15821
[15] Aksu T, Woo G, Liu J, Liu X, Liu C, Savarese S, et al. GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluation. arXiv preprint 2024; arXiv:2410.10393. https://doi.org/10.48550/arXiv.2410.10393 [16] Shchur O, Ansari AF, Turkmen C, Zhang X, Mercado P, Shen H, et al. fev-bench: A Realistic Benchmark for Time Series Forecasting. arXiv preprint 2025; arXiv:2509.26468. https://doi.org/10.48550/arXiv.2509.26468
[17] Meyer M, Zapata Gonzalez D, Kaltenpoth S, Müller O. Benchmarking Time Series Foundation Models for Short-Term Household Electricity Load Forecasting. IEEE Access 2025;13:218141–218153. https://doi.org/10.1109/ACCESS.2025.3648056. [18] Sartipi MJ, Hornek A, Tchappi I, Fridgen G. Benchmarking Pre-Trained Time Series Models for Electricity Price Forecasting. Proc 21st Int Conf European Energy Market (EEM) 2025; 1–7. https://doi.org/10.1109/EEM64765.2025.11050326 [19] Simeone L. Time Series Foundation Models for Energy Load Forecasting on Consumer Hardware: A Multi-Dimensional Zero-Shot Benchmark. arXiv preprint 2026; arXiv:2602.10848. https://doi.org/10.48550/arXiv.2602.10848 [20] Ferdaus MM, Dam T, Sarkar MR, Uddin M, Anavatti SG. Foundation Models for Clean Energy Forecasting: A Comprehensive Review. arXiv preprint 2025; arXiv:2507.23147. https://doi.org/10.48550/arXiv.2507.23147
[21] Wu J. Improving the Writing of Research Papers: IMRAD and Beyond. Landscape Ecology 2011; 26(10):1345–49. https://doi.org/10.1007/s10980-011-9674-3 [22] Wirth R, Hipp J. CRISP-DM: Towards a Standard Process Model for Data Mining. Proceedings of the 4th International Conference on the Practical Applications of Knowledge Discovery and Data Mining 2000; 29–39. https://www.semanticscholar. org/paper/48b9293cfd4297f855867ca278f7069abc6a9c24
[23] Weron R. Electricity price forecasting: A review of the state-of-the-art with a look into the future. International Journal of Forecasting 2014; 30(4):1030–1081. https: //doi.org/10.1016/j.ijforecast.2014.08.008
34
[24] Hong T, Fan S. Probabilistic electric load forecasting: A tutorial review. International Journal of Forecasting 2016; 32(3):914–938. https://doi.org/10.1016/j.ijforecast. 2015.11.011
[25] Chen T, Guestrin C. XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2016; 785–794. https://doi.org/10.1145/2939672.2939785 [26] Breiman L. Random Forests. Machine Learning 2001; 45(1):5–32. https://doi.org/ 10.1023/A:1010933404324
[27] Lago J, De Ridder F, De Schutter B. Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms. Applied Energy 2018; 221:386–405. https://doi.org/10.1016/j.apenergy.2018.02.069 [28] Das A, Kong W, Sen R, Zhou Y. TimesFM: A Decoder-Only Foundation Model for Time-Series Forecasting. arXiv preprint 2024; arXiv:2310.10688. https://doi.org/10. 48550/arXiv.2310.10688
[29] Liu C, Aksu T, Liu J, Woo G, Zhang X, Savarese S, et al. Moirai 2.0: When Less Is More for Time Series Forecasting. arXiv preprint 2025; arXiv:2511.11698. https://doi.org/10.48550/arXiv.2511.11698
[30] Graf L, Ortner T, Woźniak S, Pantazi A. FlowState: Sampling Rate Invariant Time Series Forecasting. arXiv preprint 2025; arXiv:2508.05287. https://doi.org/10.48550/ arXiv.2508.05287
[31] Auer A, Podest P, Klotz D, Böck S, Klambauer G, Hochreiter S. TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learning. arXiv preprint 2025; arXiv:2505.23719. https://doi.org/10.48550/arXiv.2505.23719 [32] Beck M, Pöppel K, Spanring M, Auer A, Prudnikova O, Kopp M, et al. xLSTM: Extended Long Short-Term Memory. Advances in Neural Information Processing Systems 2024; 37:107547–603. https://doi.org/10.52202/079017-3417 [33] Grinsztajn L, Flöge K, Key O, Hollmann N, Müller S, Hutter F, et al. TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models. arXiv preprint 2025; arXiv:2511.08667. https://doi.org/10.48550/arXiv.2511.08667 [34] Hoo SB, Müller S, Salinas D, Hutter F. TabPFN-TS: From Tables to Time: How TabPFN-v2 Outperforms Specialized Time Series Forecasting Models. arXiv preprint 2025; arXiv:2501.02945. https://doi.org/10.48550/arXiv.2501.02945 [35] Zhou Z, Lu X, Xiao Y, Zhang Y, Zheng X, Wang C, et al. SDWPF: A Dataset for Spatial Dynamic Wind Power Forecasting Challenge at KDD Cup 2022. Sci Data 2024; 11(1):649. https://doi.org/10.1038/s41597-024-03427-5
35
[36] Meyer M, Kaltenpoth S, Albers H, Zalipski K, Müller O. TS-Arena: A Live Forecast Pre-Registration Platform. arXiv preprint 2025; arXiv:2512.20761. https://doi.org/ 10.48550/arXiv.2512.20761
[37] ENTSO-E, EFET, ebIX. The Harmonised Electricity Market Role Model, Version 2022-01. European Network of Transmission System Operators for Electricity; 2022. https://eepublicdownloads.entsoe.eu/clean-documents/EDI/Library/HRM/ Harmonised_Role_Model_2022-01.pdf (Accessed: 23 November 2025). [38] BDEW Bundesverband der Energie- und Wasserwirtschaft e.V. Energy Flow Diagram Germany 2023. BDEW; 2024. https://www.bdew.de/media/documents/1_ Energieflussbild_Deutschland_2023_TWh_detailliert.svg (Accessed: 29 March 2026). [39] Murza S, Siripanich P, Yakovets A. Holidays: Open World Holidays Framework. Zenodo 2025. https://doi.org/10.5281/zenodo.17944479 [40] European Network of Transmission System Operators for Electricity. Transparency Platform. ENTSO-E; 2025. https://transparency.entsoe.eu/ (Accessed: 29 December 2025). [41] de Bont K, Hoogsteen G, Hurink J, Vaessen P, Morren J. Electric vehicle charging session data of large office parking lot. 4TU.ResearchData; 2024. https://doi.org/10. 4121/80EF3824-3F5D-4E45-8794-3B8791EFBD13.V1
[42] Mobilithek. Mobilitätsdaten Deutschland. Mobilithek; 2025. https://mobilithek.info/ offers/714073450865197056 (Accessed: 29 March 2026). [43] Li H, Qu H, Tan X, You L, Zhu R, Fan W. UrbanEV: An open benchmark dataset for urban electric vehicle charging demand prediction. Sci Data 2025; 12(1):523. https://doi.org/10.1038/s41597-025-04874-4
[44] Department for Transport. Electric chargepoint analysis 2017: domestics. London: Department for Transport; 2025. https://www.data.gov.uk/dataset/5438d88d-695b4381-a5f2-6ea03bf3dcf0/electric-chargepoint-analysis-2017-domestics (Accessed: 29 March 2026). [45] Brudermüller T, Fleisch E, González Vayá M, Staake T. HEAPO – An Open Dataset for Heat Pump Optimization with Smart Electricity Meter Data and On-Site Inspection Protocols. ETH Zurich; 2025. https://doi.org/10.5281/zenodo.15056919 [46] Freißmann J, Fritz M, Tuschy I, Stadtwerke Flensburg GmbH. Network Data of the District Heating System for the City of Flensburg from 2020–2024. Zenodo; 2025. https://doi.org/10.5281/zenodo.17177421
[47] Browell J. Hybrid Energy Forecasting and Trading Competition Data. Zenodo; 2025. https://doi.org/10.5281/zenodo.13950764
36
[48] Clerc A, Lingkan E. Hill of Towie wind farm open dataset. Zenodo; 2025. https: //doi.org/10.5281/zenodo.14870023
[49] Lin Z, Zhou Q, Wang Z, Wang C, Bookhart DB, Leung-Shea M. A High-Resolution Three-Year Dataset Supporting Rooftop Photovoltaics (PV) Generation Analytics. Sci Data 2025;12(1):63. https://doi.org/10.1038/s41597-025-04397-y [50] Kanter M. gridstatus: A Python library for accessing US electricity grid data. Grid Status; 2025. https://github.com/gridstatus/gridstatus (Accessed: 29 March 2026). [51] California ISO. Open Access Same-Time Information System (OASIS). CAISO; 2025. http://oasis.caiso.com (Accessed: 29 March 2026). [52] Huber J, Klempp N, Becker J, Weinhardt C. Electricity consumption of 28 German companies in 15-min resolution. Karlsruhe Institute of Technology; 2023. https: //doi.org/10.35097/1192. [53] Tiemann PH. 5359 Industrial VEA Load Profiles. Zenodo; 2024. https://doi.org/10. 5281/zenodo.13910298. [54] Schlemminger M, Ohrdes T, Schneider E, Knoop M. Dataset on Electrical SingleFamily House and Heat Pump Load Profiles in Germany. Sci Data 2022;9(1):56. https://doi.org/10.1038/s41597-022-01156-1. [55] Tjaden T. Repräsentative elektrische Lastprofile für Wohngebäude in Deutschland auf 1-sekündiger Datenbasis. ResearchGate; n.d. https://doi.org/10.13140/RG.2.1.5112. 0080/1. [56] Netztransparenz.de. Regelzonenübergreifender einheitlicher Bilanzausgleichsenergiepreis (reBAP). Netztransparenz.de; 2025. https://www.netztransparenz.de/ Regelenergie/Ausgleichsenergiepreis/reBAP (Accessed: 29 December 2025). [57] EPEX SPOT SE. Continuous Intraday Market. EPEX SPOT; 2024. https://www. epexspot.com/en/marketdata/intraday (accessed via Montel Analytics). [58] 50Hertz Transmission GmbH. Grid Load in the Control Area. 50Hertz Transmission GmbH; 2025. https://www.50hertz.com/Transparenz/Kennzahlen/Netzdaten/ Netzbelastung (Accessed: 29 December 2025). [59] Bayernwerk Publication
Netz GmbH. Grid Structure Characteristics – Statutory Requirements (Electricity). Bayernwerk Netz GmbH; 2025.
https://www.bayernwerk-netz.de/de/bayernwerk-netz-gmbh/netzinformation/ veroeffentlichungspflichten/strom/netzstrukturmerkmale.html (Accessed:
29
March 2026). [60] Treutlein M, Bothe P, Schmidt M, Fichtner W, Suriyah MR, Leibfried T, et al. RealWorld Energy Data of 200 Feeders from Low-Voltage Grids with Metadata in Germany over Two Years [Dataset]. Zenodo; 2025. https://doi.org/10.5281/zenodo.17831177
37
[61] Treutlein M, Bothe P, Schmidt M, Fichtner W, Suriyah MR, Leibfried T, et al. RealWorld Energy Data of 200 Feeders from Low-Voltage Grids with Metadata in Germany over Two Years. arXiv preprint 2026; arXiv:2602.03521. https://doi.org/10.48550/ arXiv.2602.03521
[62] Netztransparenz.de. Activated Control Reserve. Netztransparenz.de; 2025. https: //www.netztransparenz.de/de-de/Regelenergie/Daten-Regelreserve/AktivierteRegelleistung (Accessed: 29 December 2025).
[63] Open-Meteo. Open-Meteo Weather API. Zenodo; 2024. https://doi.org/10.5281/ zenodo.14582479
[64] Deutscher Wetterdienst (DWD). ICON-D2: High-Resolution Numerical Weather Prediction Model for Germany. DWD; 2025. https://www.dwd.de/EN/ourservices/ nwp_forecast_data/nwp_forecast_data.html (Accessed: 29 December 2025). [65] International Electrotechnical Commission (IEC). IEC 62196-2:2022 – Plugs, SocketOutlets, Vehicle Connectors and Vehicle Inlets: Conductive Charging of Electric Vehicles – Part 2: Dimensional Compatibility Requirements for AC Pin and Contact-Tube Accessories. Geneva: IEC; 2022. https://webstore.iec.ch/en/publication/64364 [66] Obermeier M. FETS Dataset: Foundation Models Outperform Dataset-specific Machine Learning in Energy Time Series Forecasting [Dataset]. Zenodo; 2026. https://doi.org/10.5281/zenodo.19418721. [67] Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is All you Need. Advances in Neural Information Processing Systems 2017; 30. https://papers.nips.cc/paper_files/paper/2017/hash/ 3f5ee243547dee91fbd053c1c4a845aa-Abstract.html
[68] Gu A, Goel K, Ré C. Efficiently Modeling Long Sequences with Structured State Spaces. arXiv preprint 2022; arXiv:2111.00396. https://doi.org/10.48550/arXiv.2111.00396 [69] Smith JTH, Warrington A, Linderman SW. Simplified State Space Layers for Sequence Modeling. arXiv preprint 2023; arXiv:2208.04933. https://doi.org/10.48550/arXiv. 2208.04933
[70] Wang Y, Cheng W, Jin Y, Li J, Yang Y, Hu S. An XGBoost-SHAP Model for Energy Demand Prediction With Boruta-Lasso Feature Selection. IEEE Access 2025; 13:135806–135821. https://doi.org/10.1109/ACCESS.2025.3593558 [71] Wen Y, Guo R, Duan Z, Li J, Yang Y, Hu S, et al. Machine Learning Model Optimization with Optuna for Accurate Prediction of Strength and Crack Behavior in Prestressed Concrete Beams. Sci Rep 2026; 16(1):5822. https://doi.org/10.1038/ s41598-026-36692-y
[72] Zanotti M. On the Retraining Frequency of Global Models in Retail Demand Forecasting. Mach Learn Appl 2025; 22:100769. https://doi.org/10.1016/j.mlwa.2025.100769
38
[73] Shannon, C.E. Prediction and Entropy of Printed English. Bell System Technical Journal, Vol. 30, No. 1, pp. 50–64; 1951. https://doi.org/10.1002/j.1538-7305.1951. tb01366.x
[74] Kang Y, Hyndman RJ, Smith-Miles K. Visualising Forecasting Algorithm Performance Using Time Series Instance Spaces. International Journal of Forecasting 2017; 33(2): 345–358. https://doi.org/10.1016/j.ijforecast.2016.09.004 [75] Karaouli N, Coquenet D, Fromont E, Mermillod M, Reyboz M. Are Time Series Foundation Models Susceptible to Catastrophic Forgetting? arXiv preprint 2025; arXiv:2510.00809. https://doi.org/10.48550/arXiv.2510.00809 [76] VDEW (Verband der Elektrizitätswirtschaft). Repräsentative VDEW-Lastprofile. VDEW Materialien, Frankfurt am Main; 1999. https://www.bdew.de/media/documents/ 1999_Repraesentative-VDEW-Lastprofile.pdf (Accessed: 23 November 2025). [77] BDEW (Bundesverband der Energie- und Wasserwirtschaft). Standardlastprofile Strom. Berlin; 2025. https://www.bdew.de/energie/standardlastprofile-strom/ (Accessed: 29 March 2026).
39
Appendix A. Data Statistics & Model Specifications
Table A.5: Dataset Statistics Overview: Comprehensive characteristics of all time series datasets including sample size (N), temporal resolution (Frequency), coefficient of variation (CV), percentage of negative and positive values, and forecastability index (ϕ). The forecastability index is based on spectral entropy, where values closer to 1 indicate more predictable time series with strong periodic patterns, while values near 0 suggest higher randomness and lower predictability. Dataset
Target
N
Frequency
CV
Neg.%
Pos.%
ϕ
Germany aFRR positiv Area Control Error (NRV Saldo) Germany aFRR negativ TenneT positiv TenneT negativ
348,576 364,303 348,576 383,704 383,704
15min 15min 15min 15min 15min
1.769 9.550 1.734 8.780 11.994
0.0% 45.5% 0.0% 0.0% 0.0%
90.2% 54.5% 92.0% 2.3% 1.4%
0.1428 0.1343 0.1286 0.1095 0.0961
Aggregated Batterys Fossil Hard Coal Fossil Gas
44,352 202,844 202,844
5min (100%), 1.1h (0%) 15min 15min
18.011 0.722 0.562
51.7% 0.0% 0.0%
48.2% 100.0% 100.0%
0.8084 0.6055 0.5916
Active Power Grid Consumption MS Grid Feed-in MS Active Power Active Power Active Power Active Power Active Power UW Wieselbach UW Lauchstädt L472 UW Wieselbach UW Lauchstädt L471 UW Lubmin - OWP Baltic Eagle
70,171 35,136 35,136 69,877 70,150 70,104 70,169 70,173 19,729 19,729 13,057
15min (100%), 45.0min (0%) 15min 15min 15min (100%), 2h (0%) 15min (100%), 1h (0%) 15min (100%), 1h (0%) 15min (100%), 2h (0%) 15min (100%), 1h (0%) 1h 1h 1h
0.343 0.274 0.564 1.642 26.891 4.826 0.482 2.007 0.620 0.652 0.995
0.0% 0.0% 0.0% 18.8% 27.4% 16.5% 0.0% 17.3% 0.0% 0.0% 0.0%
100.0% 100.0% 98.5% 81.2% 72.6% 83.5% 100.0% 82.7% 95.7% 93.4% 97.4%
0.7386 0.6738 0.6706 0.5776 0.5773 0.5263 0.5205 0.4949 0.3671 0.3473 0.2770
Heat Demand Heatpump 971151 Heatpump 818882
43,843 35,616 75,168
1h (100%), 2h (0%) 15min (100%), 1.0d (0%) 15min (100%), 1.0d (0%)
0.565 1.502 1.569
0.0% 0.0% 0.0%
100.0% 99.7% 100.0%
0.8657 0.3718 0.3160
Aggregated Load Load DE Load 2 random loads
44,352 202,844 71,259 35,136
5min (100%), 1.1h (0%) 15min 1h (62%), 15min (38%) 15min
0.189 0.177 0.218 0.560
0.0% 0.0% 0.0% 0.0%
100.0% 100.0% 100.0% 100.0%
0.7487 0.7406 0.6296 0.5909
LMP ZP26 LMP SP15 Day-Ahead Auction LMP NP15 Intraday Continuous reBAP
44,352 44,352 35,136 44,352 35,136 416,160
5min (100%), 1.1h (0%) 5min (100%), 1.1h (0%) 15min 5min (100%), 1.1h (0%) 15min 15min
0.474 0.556 0.810 0.410 1.028 2.827
4.8% 4.6% 5.2% 1.1% 6.7% 18.9%
95.1% 95.3% 94.1% 98.8% 93.3% 81.1%
0.5229 0.4032 0.3755 0.3623 0.2920 0.1215
Total Power Aggregated Profile 107 Total Power 50 Agg Total Power 50 Agg
143,922 17,376 228,179 35,058
15min 15min 15min 15min
2.354 0.387 1.423 1.585
0.0% 0.0% 0.0% 0.0%
44.9% 100.0% 66.7% 36.1%
0.6301 0.4608 0.3955 0.2278
Aggregated Solar Solar generation_kwh_UG Hall4 Solar Solar Solar_MWh_credit Wind Onshore Wind Offshore total_MWh_credit Wind_MWh_credit active_power
44,352 202,844 55,577 71,293 50,660 61,505 202,844 202,844 61,505 61,505 58,434
5min (100%), 1.1h (0%) 15min 15min 1h (62%), 15min (38%) 1h 30min (100%), 1h (0%) 15min 15min 30min (100%), 1h (0%) 30min (100%), 1h (0%) 15min (100%), 30min (0%)
1.295 1.537 1.624 1.439 1.759 1.631 0.802 0.686 0.667 0.761 1.166
48.4% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 0.0% 17.2%
51.3% 72.6% 47.9% 60.5% 84.6% 52.0% 100.0% 99.9% 97.7% 94.3% 82.7%
0.8273 0.7628 0.6574 0.6342 0.6138 0.5749 0.4695 0.4189 0.3973 0.3672 0.3617
10 random aggregated households NO_PV_SFH31_P_TOT random_household_1 random_household_0 WITH_PV_SFH15_P_TOT NO_PV_SFH10_P_TOT random_household_2
35,040 88,425 35,040 35,040 69,210 89,630 35,040
15min 15min 15min 15min 15min 15min 15min
0.511 1.231 0.879 0.938 2.390 0.677 1.602
0.0% 0.0% 0.0% 0.0% 10.6% 0.0% 0.0%
100.0% 99.9% 100.0% 100.0% 89.4% 99.9% 100.0%
0.4222 0.2295 0.2256 0.2102 0.2020 0.1527 0.1339
Balancing services aFRR Germany Balancing Data Germany aFRR Germany mFRR Germany mFRR Germany Dispatchable Generation California Caiso ENTSO-E Germany ENTSO-E Germany Grid Data Netze BW LV, Feeder 37 Bayernwerk Bayernwerk Netze BW LV, Feeder 132 Netze BW LV, Feeder 97 Netze BW LV, Feeder 63 Netze BW LV, Feeder 160 Netze BW LV, Feeder 33 50Hertz Line Power 50Hertz Line Power 50Hertz Line Power Heat Data Heat Grid Flensburg HEAPO: Household Zurich Area HEAPO: Household Zurich Area Load California Caiso DE Power FR Power Industrial VEA 2 Agg Profiles Market Data California Caiso California Caiso ENTSO-E Germany California Caiso ENTSO-E Germany ENTSO-E Germany Mobility Data NL Office EV Park UrbanEV China Charging Station Mobilitaet Public Charging Station UK Residential Charging Station Non-Dispatchable Generation California Caiso DE Power PV Hong Kong FR Power DK Power Energy Forecasting Competition PV Cluster DE Power DE Power Energy Forecasting Competition Wind+PV Energy Forecasting Competition Windpark Hill of Towie Wind Residential Load HTW Berlin Households Household Lower Saxony HTW Berlin Households HTW Berlin Households Household Lower Saxony Household Lower Saxony HTW Berlin Households
40
Table A.6: Model Specifications. Hyperparameter search spaces and configuration for trained models. For XGBoost and Random Forest, Optuna TPE sampler is used with n = 250 trials. SHAP-based feature selection and automatic lag selection are enabled for both tree-based models.
Parameter
Chronos-2
XGBoost
Random Forest
– [0.1, 0.5, 0.9]
250 [0.1, 0.5, 0.9]
250 [0.1, 0.5, 0.9]
– – –
✓ 100 20
✓ 100 20
– – – –
[3, 6, 12, 24, 48, 96] mean, std, min, max ✓ 50
[3, 6, 12, 24, 48, 96] mean, std, min, max ✓ 50
[100, 1000] (int) [3, 10] (int) [0.01, 0.2] (log) [0.3, 1.0] [0.2, 1.0] – – – –
[100, 1000] (int) [3, 30] (int) – – – [2, 20] (int) [1, 10] (int) {sqrt, log2, 0.5, 0.7, 1.0} {true, false}
– – – – – – – – –
– – – – – – – – –
General HPO Trials Quantiles Lag Selection Auto Lag Selection Max Lags to Test Top-k Lags Selected Feature Engineering Rolling Windows Rolling Features SHAP Feature Selection SHAP Top-k Features
Hyperparameter Search Space n_estimators max_depth learning_rate subsample colsample_bytree min_samples_split min_samples_leaf max_features bootstrap
– – – – – – – – –
Fine-Tuning (Chronos-2 only) Num Steps Learning Rate Batch Size Window Overlap LoRA Rank LoRA Alpha LoRA Dropout LoRA Target Modules Checkpoint
10 000 5 × 10−4 32 75% 1 1 0.15 {q} chronos-2
41
Appendix B. Extended Results This section extends the benchmark results: Figure B.11 shows an example prediction for one specific experimental setting, representative of the many configurations evaluated as described above. Tables B.7, B.8 and B.9 report the extended per-dataset results, which are summarized in Table 4. Historical Data Actual Values
Model Forecast Baseline Forecast
Uncertainty (10%-90%)
Forecast Start 2.6
Load [GW]
2
1.3
0.7
0
Covariates (normalized)
Context
Horizon
Shortwave Radiation Mean
Direct Radiation Mean
1 0.5 0
0
1
2
3
4
5
6
7
8
Time [days]
Figure B.11: Forecast evaluation for Bayernwerk MV Grid feed-in [59]: Historical data (blue), seasonal naive baseline forecast (orange), model forecast (red dashed), 10%-90% uncertainty interval (red shaded), and actual values (green). Model: Chronos-2 (covariate) | MASE: 0.4259 | CRPS: 0.2119 | NRMSE: 0.0677 | CORR: 0.9733 | SUM_RATIO: 1.0126
0.0000
All
Overall
Summary (Best Med)
0.2054 0.3236 0.2586 0.2762 0.1468 0.3307 0.3445
0.0161 0.1075 0.1438 0.0506 0.2945 0.1006 0.0317 0.1583 0.0545
0.5654 0.1317 0.9490 0.0590
0.0457 0.0434 0.0401 0.0514 0.0783 0.3008
0.0046 0.0075 0.0600
0.6061 0.5774 0.0682
0.5802 0.2538 0.2602 0.0122 0.0221 0.1300 0.1216 0.1943 0.0910 0.2152 0.1946
0.0370 0.0681 0.0758
1.1102 1.5004 1.6232 0.0000 0.0000
Min
10 random aggregated households random_household_0 random_household_1 random_household_2 NO_PV_SFH10_P_TOT NO_PV_SFH31_P_TOT WITH_PV_SFH15_P_TOT
Aggregated Solar Wind Offshore Wind Onshore Solar Solar_MWh_credit total_MWh_credit Wind_MWh_credit active_power generation_kwh_UG Hall4
Total Power 50 Agg Total Power Total Power 50 Agg Aggregated Profile 107
LMP NP15 LMP SP15 LMP ZP26 Day-Ahead Auction Intraday Continuous reBAP
Aggregated Load Load 2 random loads
Heatpump 818882 Heatpump 971151 Heat Demand
UW Lubmin - OWP Baltic Eagle UW Wieselbach UW Lauchstädt L471 UW Wieselbach UW Lauchstädt L472 Grid Consumption MS Grid Feed-in MS Active Power Active Power Active Power Active Power Active Power Active Power
Aggregated Batterys Fossil Gas Fossil Hard Coal
Area Control Error (NRV Saldo) Germany aFRR negativ Germany aFRR positiv TenneT negativ TenneT positiv
Target
HTW Berlin Households HTW Berlin Households HTW Berlin Households HTW Berlin Households Household Lower Saxony Household Lower Saxony Household Lower Saxony
Residential Load
California Caiso DE Power DE Power DK Power Energy Forecasting Competition PV Cluster Energy Forecasting Competition Wind+PV Energy Forecasting Competition Windpark Hill of Towie Wind PV Hong Kong
Non-Dispatchable Generation
Mobilitaet Public Charging Station NL Office EV Park UK Residential Charging Station UrbanEV China Charging Station
Mobility Data
California Caiso California Caiso California Caiso ENTSO-E Germany ENTSO-E Germany ENTSO-E Germany
Market Data
California Caiso FR Power Industrial VEA 2 Agg Profiles
Load
HEAPO: Household Zurich Area HEAPO: Household Zurich Area Heat Grid Flensburg
Heat Data
50Hertz Line Power 50Hertz Line Power 50Hertz Line Power Bayernwerk Bayernwerk Netze BW LV, Feeder 132 Netze BW LV, Feeder 160 Netze BW LV, Feeder 33 Netze BW LV, Feeder 37 Netze BW LV, Feeder 63 Netze BW LV, Feeder 97
Grid Data
California Caiso ENTSO-E Germany ENTSO-E Germany
Dispatchable Generation
Balancing Data Germany aFRR Germany aFRR Germany mFRR Germany mFRR Germany
Balancing Services
Dataset
0.2609
0.3102 0.7465 0.6193 1.1444 0.6390 0.7541 0.5665
0.1162 0.4405 0.4033 0.2810 0.6543 0.3403 0.4138 0.8881 0.4527
0.6784 0.3461 1.1148 0.2363
0.1604 0.1667 0.1418 0.2251 0.2135 0.5410
0.0171 0.0190 0.1575
0.8169 0.7656 0.1198
0.9613 0.5332 0.5038 0.0377 0.1065 0.3315 0.1762 0.4366 0.1124 0.6085 0.5068
0.2285 0.2366 0.3403
1.2367 1.9190 2.0210 9.9275 9.6732
Q25
7
0.5893
0.3513 0.8370 0.7681 1.3852 0.7346 0.8631 0.7981
0.3005 0.6191 0.5281 0.4378 0.9547 0.4641 0.5880 1.1473 0.7291
0.7732 0.5930 1.2195 0.3355
0.2879 0.2889 0.2526 0.3472 0.3366 0.7263
0.0307 0.0261 0.2376
0.9101 0.8273 0.1468
1.1269 0.6545 0.6460 0.0577 0.1519 0.4864 0.1947 0.5671 0.1253 0.9207 0.7182
0.4098 0.3256 0.5463
1.2720 2.2437 2.2147 >1 × 106 16.9706
Med
Q75
0.9799
0.4194 0.9183 0.8798 1.6087 0.8177 0.9787 1.0181
0.6896 0.8377 0.7156 0.5857 1.4541 0.6485 0.8019 1.5984 1.0829
0.8859 1.6968 1.3409 0.3973
0.4324 0.4820 0.3787 0.6108 0.6553 1.0369
0.0652 0.0385 0.3660
1.0925 0.8797 0.2087
1.3174 0.8129 0.8213 0.0875 0.2044 0.6434 0.2247 0.8047 0.1365 1.1432 0.9688
0.8917 0.4705 0.8292
1.3029 2.5947 2.3711 >1 × 106 >1 × 106
TimesFM
0.2144 0.3208 0.2757 0.2629 0.1513 0.3016 0.3217 0.0037
>1 × 106
0.0166 0.0860 0.0959 0.0420 0.2967 0.0649 0.0200 0.2446 0.0316
0.5436 0.1261 0.9283 0.0570
0.0435 0.0394 0.0369 0.0525 0.0669 0.2901
0.0037 0.0070 0.0397
0.3972 0.4960 0.0608
0.6880 0.2522 0.2549 0.0145 0.0298 0.1099 0.1216 0.1741 0.0893 0.1763 0.1675
0.0725 0.0680 0.0584
1.1452 1.4674 1.5813 5.0241 3.3430
Min
0.6060 1.4139 1.1060 2.0290 1.1985 1.2615 1.9725
10.7367 9.4488 2.8656 2.9561 4.0228 1.6414 5.5621 17.2201 9.4185
1.1034 >1 × 106 2.4936 0.9378
2.8132 2.8098 2.6519 7.9391 6.6634 3.7046
0.1746 0.2153 1.1253
1.9188 1.2598 0.5123
6.6974 2.1792 >1 × 106 0.2864 0.4697 1.2505 0.3479 1.5728 0.1982 2.2688 2.0410
5.1636 2.5190 3.0735
1.5922 3.9192 3.0295 >1 × 106 >1 × 106
Max
0.2496
0.3094 0.7438 0.6082 1.1363 0.6463 0.7151 0.5644
0.0853 0.4434 0.3964 0.2653 0.6316 0.3347 0.3962 0.9286 0.3231
0.6817 0.3489 1.1075 0.2261
0.1474 0.1685 0.1378 0.2277 0.2211 0.5432
0.0173 0.0191 0.1409
0.8005 0.7342 0.1205
0.9931 0.5443 0.5123 0.0358 0.1072 0.3014 0.1687 0.4015 0.1092 0.5238 0.3939
0.2318 0.2417 0.3127
1.2379 1.9179 2.0153 9.9727 9.7985
Q25
18
0.5754
0.3432 0.8249 0.7568 1.3790 0.7344 0.8554 0.7827
0.2142 0.6564 0.5072 0.4306 0.9131 0.4604 0.5701 1.2873 0.6935
0.7613 0.6374 1.2151 0.3145
0.2761 0.2951 0.2393 0.3718 0.3420 0.7057
0.0324 0.0274 0.2179
0.9079 0.7958 0.1535
1.1552 0.6624 0.6257 0.0617 0.1605 0.4558 0.1897 0.5440 0.1178 0.8486 0.6460
0.3840 0.3524 0.5126
1.2665 2.2559 2.1776 >1 × 106 17.0547
Med
Q75
0.9770
0.3943 0.8992 0.8704 1.5857 0.8222 0.9844 1.0048
0.6824 0.8930 0.7119 0.5846 1.4562 0.6492 0.8238 1.5871 1.1679
0.8860 1.6653 1.3291 0.3801
0.4015 0.4806 0.3652 0.6143 0.7047 1.0661
0.0653 0.0440 0.3061
1.0721 0.8734 0.2077
1.3330 0.8029 0.8164 0.1135 0.2264 0.6016 0.2106 0.7311 0.1287 1.1577 0.8761
0.7890 0.4816 0.8153
1.2977 2.5909 2.3586 >1 × 106 >1 × 106
Chronos-2
>1 × 106
0.5817 1.4158 1.1241 2.0357 0.9829 1.3166 1.4651
9.6076 4.1004 1.8734 2.4240 15.2554 1.6452 5.2720 8.1392 9.5096
1.0959 >1 × 106 2.9098 0.8690
1.7042 2.3125 1.8290 5.4755 4.2370 3.2393
0.1390 0.2547 0.9225
2.0255 1.4189 0.4943
5.7702 1.9118 >1 × 106 0.2605 0.5650 1.2908 0.3483 1.9702 0.1903 2.8368 2.6173
5.2918 1.3009 3.3689
1.6553 3.9434 2.9942 >1 × 106 >1 × 106
Max
0.0085
0.2136 0.3354 0.2479 0.2964 0.1559 0.3132 0.3393
0.2160 0.0437 0.0617 0.0480 0.3601 0.0846 0.0219 0.3924 0.0332
0.5308 0.1039 0.8428 0.0705
0.0381 0.0509 0.0421 0.0450 0.0725 0.3018
0.0131 0.0085 0.0547
0.5454 0.5142 0.0770
0.5589 0.2759 0.2642 0.0142 0.0198 0.1064 0.1293 0.2068 0.0885 0.2193 0.1902
0.2523 0.0486 0.0812
1.1002 1.3761 1.5732 5.0237 3.3416
Min
0.2693
0.2960 0.7274 0.6025 1.0959 0.6485 0.7083 0.5764
1.1188 0.4282 0.3900 0.2583 0.6117 0.3557 0.3954 0.9053 0.3284
0.6766 0.2840 1.0536 0.2333
0.1778 0.2065 0.1731 0.2001 0.2010 0.5271
0.0640 0.0182 0.1454
0.8250 0.7589 0.1271
0.9829 0.5520 0.5415 0.0334 0.1020 0.3327 0.1695 0.3989 0.1095 0.6545 0.4912
1.0166 0.2258 0.3276
1.2408 1.9080 1.9847 9.9760 9.7980
Q25
22
0.6124
0.3355 0.8097 0.7450 1.3382 0.7406 0.8277 0.7964
1.5730 0.6182 0.5614 0.4493 0.9638 0.4751 0.5927 1.1877 0.6297
0.7593 0.3965 1.1602 0.3078
0.3319 0.3094 0.2735 0.3336 0.3448 0.6962
0.0916 0.0246 0.2131
0.9436 0.8156 0.1547
1.1274 0.6824 0.6773 0.0551 0.1480 0.4460 0.1887 0.5298 0.1195 0.9052 0.6556
1.1642 0.3203 0.4507
1.2802 2.2475 2.1786 >1 × 106 31 076.3775
Med
FlowState
1.0372
0.3760 0.8918 0.8498 1.5532 0.8217 0.9529 1.0292
1.7675 0.8066 0.7443 0.6141 1.5438 0.6477 0.8137 1.5354 1.1071
0.8828 0.7210 1.2908 0.3923
0.5009 0.5612 0.4748 0.5938 0.6775 1.0369
0.1114 0.0339 0.3310
1.1038 0.8982 0.2228
1.3398 0.8327 0.8457 0.0798 0.2029 0.6841 0.2114 0.6799 0.1330 1.1607 0.9241
1.3004 0.4455 0.6805
1.3221 2.6100 2.3292 >1 × 106 >1 × 106
Q75
>1 × 106
0.5712 1.3971 1.1222 2.0444 0.9799 1.3098 1.4454
48.7086 4.2213 2.1291 3.3211 5.6379 1.8692 6.4125 7.0019 9.4934
1.0892 >1 × 106 3.1986 0.9540
3.1510 3.0968 3.0873 4.3833 4.1995 4.6700
0.2245 0.1628 0.7569
1.9389 1.6680 0.5272
7.6498 1.9322 >1 × 106 0.1807 0.4646 1.2517 0.3118 1.3660 0.1958 3.0774 2.7005
4.1418 2.1359 3.2897
1.9195 3.9422 3.0791 >1 × 106 >1 × 106
Max
0.0063
0.2020 0.3177 0.2774 0.2655 0.1516 0.3205 0.3347
0.0327 0.1554 0.0825 0.0649 0.3420 0.0703 0.0173 0.1660 0.0535
0.5595 0.1468 0.9233 0.0635
0.0604 0.0429 0.0507 0.0772 0.0924 0.2835
0.0063 0.0087 0.0723
0.4709 0.5597 0.0617
0.6119 0.2857 0.2608 0.0154 0.0433 0.1526 0.1245 0.2068 0.0911 0.2307 0.1863
0.0578 0.0746 0.0903
1.1047 1.5063 1.6454 5.0243 3.3414
Min
0.2646
0.3060 0.7403 0.6235 1.1505 0.6471 0.7524 0.5609
0.1038 0.4420 0.4021 0.2868 0.6122 0.3218 0.3872 0.9571 0.3935
0.6843 0.4851 1.1131 0.2352
0.1743 0.1702 0.1500 0.2393 0.2080 0.5182
0.0208 0.0247 0.1668
0.8367 0.7867 0.1225
0.9495 0.5245 0.5116 0.0459 0.1213 0.3340 0.1758 0.4325 0.1102 0.6025 0.4953
0.2680 0.2601 0.3023
1.2351 1.9684 2.0255 9.9718 9.7974
Q25
4
0.5905
0.3441 0.8317 0.7695 1.3804 0.7408 0.8589 0.7847
0.2193 0.6638 0.5275 0.4499 0.8650 0.4461 0.5814 1.1982 0.7196
0.7721 0.9513 1.2077 0.3192
0.2936 0.3029 0.2563 0.3706 0.3346 0.7193
0.0350 0.0365 0.2431
0.9771 0.8495 0.1529
1.1292 0.6407 0.6277 0.0717 0.1854 0.4573 0.2023 0.5895 0.1215 0.9090 0.6647
0.4593 0.3825 0.5658
1.2684 2.2692 2.2273 >1 × 106 85.6549
Med
TiRex
1.0019
0.3918 0.8967 0.8742 1.6014 0.8195 1.0032 1.0217
0.5696 0.8779 0.7230 0.5881 1.4393 0.6478 0.8395 1.5971 1.1508
0.8838 1.9453 1.3427 0.3778
0.4524 0.4973 0.3941 0.6125 0.7065 1.0016
0.0681 0.0548 0.3610
1.1372 0.9434 0.2146
1.3062 0.7847 0.7884 0.1148 0.2404 0.6265 0.2293 0.8681 0.1349 1.1201 0.9285
0.9531 0.5111 0.8641
1.3054 2.6453 2.3765 >1 × 106 >1 × 106
Q75
>1 × 106
0.6088 1.4037 1.1206 2.0325 0.9799 1.3367 1.4385
12.8219 5.4859 1.8420 2.5152 3.9177 1.6997 5.1944 9.8058 9.0453
1.0824 >1 × 106 2.4881 0.9186
2.2280 2.5378 2.1347 2.8122 4.3876 4.1459
0.1935 0.2142 1.0022
2.0890 1.4010 0.4705
4.4055 1.6158 >1 × 106 0.2408 0.5969 1.1951 0.3042 1.9930 0.1899 2.4372 2.2710
3.2916 1.1806 3.6839
1.7118 3.9375 3.0233 >1 × 106 >1 × 106
Max
Table B.7: Results Univariate Benchmark: Statistics (Min, Q25, Median, Q75, Max) over multiple forecast horizons and context lengths; best median per row highlighted. Overall row aggregates globally across all datasets, targets, horizons, and context lengths. Values > 106 are treated as diverged, unusable forecasts and displayed as > 106 .
42
All
Overall
Summary (Best Med)
10 random aggregated households random_household_0 random_household_1 random_household_2 NO_PV_SFH10_P_TOT NO_PV_SFH31_P_TOT WITH_PV_SFH15_P_TOT
Aggregated Solar Solar Wind Offshore Wind Onshore Solar Solar_MWh_credit total_MWh_credit Wind_MWh_credit Solar active_power generation_kwh_UG Hall4
Total Power 50 Agg Total Power Total Power 50 Agg Aggregated Profile 107
LMP NP15 LMP SP15 LMP ZP26 Day-Ahead Auction Intraday Continuous reBAP
Aggregated Load Load DE Load 2 random loads
Heatpump 818882 Heatpump 971151 Heat Demand
UW Lubmin - OWP Baltic Eagle UW Wieselbach UW Lauchstädt L471 UW Wieselbach UW Lauchstädt L472 Grid Consumption MS Grid Feed-in MS Active Power Active Power Active Power Active Power Active Power Active Power
Aggregated Batterys Fossil Gas Fossil Hard Coal
Area Control Error (NRV Saldo) Germany aFRR negativ Germany aFRR positiv TenneT negativ TenneT positiv
Target
HTW Berlin Households HTW Berlin Households HTW Berlin Households HTW Berlin Households Household Lower Saxony Household Lower Saxony Household Lower Saxony
Residential Load
California Caiso DE Power DE Power DE Power DK Power Energy Forecasting Competition PV Cluster Energy Forecasting Competition Wind+PV Energy Forecasting Competition Windpark FR Power Hill of Towie Wind PV Hong Kong
Non-Dispatchable Generation
Mobilitaet Public Charging Station NL Office EV Park UK Residential Charging Station UrbanEV China Charging Station
Mobility Data
California Caiso California Caiso California Caiso ENTSO-E Germany ENTSO-E Germany ENTSO-E Germany
Market Data
California Caiso DE Power FR Power Industrial VEA 2 Agg Profiles
Load
HEAPO: Household Zurich Area HEAPO: Household Zurich Area Heat Grid Flensburg
Heat Data
50Hertz Line Power 50Hertz Line Power 50Hertz Line Power Bayernwerk Bayernwerk Netze BW LV, Feeder 132 Netze BW LV, Feeder 160 Netze BW LV, Feeder 33 Netze BW LV, Feeder 37 Netze BW LV, Feeder 63 Netze BW LV, Feeder 97
Grid Data
California Caiso ENTSO-E Germany ENTSO-E Germany
Dispatchable Generation
Balancing Data Germany aFRR Germany aFRR Germany mFRR Germany mFRR Germany
Balancing Services
Dataset
All
Cal DE Cal DE Cal DE Cal DE Cal DE Cal DE Cal DE
Weather NP15, SP15, ZP26 PV scaled Weather Wind scaled Weather Wind scaled Weather DK Weather UK Weather Competition UK Weather Competition UK Weather Competition FR Weather Hill of Towie Weather Weather HK
DE Cal NL Cal UK Cal CN Cal
Weather NP15, Cal California Weather SP15, Cal California Weather ZP26, Cal California DE Weather + Calendar DE Weather + Calendar DE Weather + DE Cal
Weather NP15, SP15, ZP26, Cal California DE Weather + Calendar FR Weather DE Calendar
Zurich Weather + CH Cal Zurich Weather + CH Cal Weather + DE Cal
DE Weather + DE Cal DE Weather + DE Cal DE Weather + DE Cal DE Weather + Bayern Cal Bayern Weather + Bayern Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal
Weather NP15, SP15, ZP26, Cal California Wind + DE Weather + Cal Wind Weather + Calendar
DE Weather + Calendar DE Weather + Calendar DE Weather + Calendar DE Weather + Calendar DE Weather + Calendar
Covariates
0.0035
0.2118 0.3208 0.2753 0.2567 0.1522 0.2790 0.3080
0.0174 0.0284 0.0992 0.0492 0.2110 0.2330 0.0490 0.0168 0.0327 0.3068 0.0305
0.5398 0.1197 0.9279 0.0574
0.0416 0.0327 0.0411 0.0505 0.0665 0.2855
0.0035 0.0061 0.0072 0.0424
0.4433 0.4835 0.0629
0.3302 0.1848 0.1822 0.0113 0.0193 0.1143 0.1226 0.1784 0.0863 0.1628 0.1577
0.0789 0.0692 0.0606
1.1098 1.3804 1.5208 5.0220 3.3236
Min
0.1979
0.3170 0.7413 0.6186 1.1526 0.6449 0.7219 0.5587
0.0990 0.1035 0.2770 0.1366 0.3068 0.4612 0.1942 0.2196 0.1510 0.6157 0.1359
0.6739 0.3538 1.1149 0.2346
0.1594 0.1748 0.1391 0.1670 0.1988 0.4842
0.0156 0.0183 0.0181 0.1737
0.8110 0.7200 0.0965
0.5073 0.3841 0.3815 0.0354 0.0724 0.2264 0.1734 0.3801 0.1113 0.3864 0.3259
0.2549 0.1691 0.2965
1.2179 1.8931 2.0237 9.9662 9.7887
Q25
37
0.4212
0.3471 0.8305 0.7705 1.3937 0.7351 0.8577 0.7880
0.2338 0.1321 0.4284 0.1969 0.3595 0.6743 0.2693 0.2779 0.2034 0.8685 0.1976
0.7592 0.6365 1.2195 0.3225
0.2832 0.2931 0.2457 0.3076 0.2969 0.6818
0.0305 0.0245 0.0282 0.2465
0.9274 0.7784 0.1115
0.6144 0.4736 0.4555 0.0501 0.1122 0.2831 0.1911 0.4739 0.1216 0.5104 0.4365
0.3983 0.2341 0.4705
1.2641 2.2568 2.2174 >1 × 106 78.1965
Med
Q75
0.8390
0.4055 0.9067 0.8793 1.6018 0.8238 1.0074 1.0084
0.4379 0.1843 0.6102 0.2580 0.4751 0.9504 0.3840 0.4485 0.2584 1.1990 0.2738
0.8796 1.8206 1.3216 0.3987
0.4116 0.4813 0.3823 0.5176 0.5639 0.9786
0.0578 0.0355 0.0415 0.3913
1.0783 0.8235 0.1324
0.7413 0.6003 0.5696 0.0877 0.1568 0.3566 0.2201 0.6706 0.1381 0.6944 0.5757
0.7060 0.3183 0.7310
1.3029 2.6075 2.3556 >1 × 106 >1 × 106
Chronos-2
0.2264 0.3203 0.2859 0.2620 0.1632 0.4089 0.3170 0.0000
>1 × 106
0.1136 0.1384 0.1116 0.0509 0.1936 0.2544 0.0452 0.0122 0.1224 0.2516 0.0578
0.5411 0.1177 0.9341 0.0669
0.0445 0.0405 0.0405 0.0531 0.0812 0.3065
0.0085 0.0095 0.0294 0.0587
0.6089 0.4259 0.0527
0.1988 0.1736 0.1557 0.0123 0.0296 0.1121 0.1189 0.1878 0.0940 0.1915 0.1748
0.1091 0.0702 0.0884
1.1379 1.3242 1.4692 0.0000 0.0000
Min
0.6301 1.4163 1.1368 2.0393 0.9838 1.3404 1.4574
18.6959 0.5220 4.6673 0.8178 1.6605 5.7510 1.0916 2.0507 0.4520 5.4437 3.5576
1.0975 >1 × 106 2.7509 0.9393
1.9699 2.7238 4.6056 8.2622 4.1438 3.2507
0.1963 0.1773 0.1428 1.3553
2.0027 1.4320 0.4317
3.3675 1.6340 >1 × 106 0.2632 0.3775 1.2024 0.3471 1.8187 0.3119 1.2427 1.2360
4.2281 0.8428 3.3620
1.9846 3.9204 3.0173 >1 × 106 >1 × 106
Max
0.2292
0.3175 0.7567 0.6309 1.1797 0.6453 0.7657 0.5723
0.2621 0.2346 0.3043 0.1728 0.3032 0.4565 0.1999 0.2310 0.2187 0.7393 0.1816
0.6856 0.3519 1.1374 0.2522
0.1745 0.1746 0.1623 0.1585 0.2037 0.4980
0.0334 0.0268 0.0584 0.1790
0.8396 0.7545 0.1101
0.4781 0.3582 0.3392 0.0440 0.0880 0.2502 0.1799 0.3835 0.1127 0.4351 0.3578
0.3034 0.2008 0.2897
1.2311 1.9183 2.0053 10.0158 9.7845
Q25
15
0.4321
0.3498 0.8520 0.7714 1.4024 0.7410 0.9043 0.8065
0.3809 0.2856 0.4423 0.2146 0.3514 0.6598 0.2799 0.3325 0.2559 0.8834 0.2647
0.7770 0.5326 1.2423 0.3208
0.3230 0.3023 0.2655 0.2698 0.2746 0.6616
0.0528 0.0373 0.0742 0.2536
1.0034 0.8225 0.1338
0.5887 0.4557 0.4266 0.0674 0.1163 0.3311 0.2084 0.4721 0.1259 0.6159 0.4808
0.4689 0.2616 0.4278
1.2579 2.2365 2.2074 >1 × 106 17.5545
Med
TabPFN
0.8644
0.4038 0.9321 0.8860 1.6316 0.8258 1.0480 1.0373
0.9197 0.3740 0.5820 0.2627 0.4050 0.9509 0.3677 0.4773 0.3021 1.2185 0.3395
0.9019 0.9336 1.3663 0.3833
0.5090 0.5134 0.4469 0.4549 0.5450 0.9779
0.0780 0.0604 0.0948 0.3468
1.1804 0.8921 0.1723
0.7621 0.5872 0.5508 0.0997 0.1689 0.4262 0.2340 0.6485 0.1388 0.7839 0.6302
0.8494 0.3402 0.6374
1.2956 2.5840 2.3478 >1 × 106 >1 × 106
Q75
>1 × 106
0.5969 1.4116 1.1350 2.0394 0.9974 1.3889 1.4635
38.2988 0.8041 9.1248 0.5602 0.7409 5.2923 1.3726 2.0645 0.6066 11.2605 0.9689
1.0944 >1 × 106 2.5417 0.8975
3.4605 3.2643 3.2078 6.0116 3.9922 6.1900
0.1960 0.1916 0.1718 1.0180
2.2095 1.4935 0.4897
3.6510 1.7189 >1 × 106 0.2780 0.4761 1.0457 0.3475 1.4162 0.1980 1.3098 1.2514
3.9088 1.0426 3.6606
1.7726 3.8796 2.9707 >1 × 106 >1 × 106
Max
0.0000
0.2295 0.3129 0.2955 0.3147 0.1517 0.3271 0.3368
0.0892 0.0450 0.1312 0.0712 0.2200 0.1597 0.1022 0.1083 0.0760 0.2655 0.0657
0.5774 0.1271 0.9457 0.0595
0.0544 0.0466 0.0534 0.0508 0.1010 0.2706
0.0055 0.0149 0.0151 0.0737
0.6044 0.5281 0.0650
0.4069 0.2000 0.1444 0.0181 0.0265 0.1130 0.1287 0.1955 0.0945 0.2861 0.2347
0.1170 0.1081 0.1078
0.9381 1.3694 1.3803 0.0000 0.0000
Min
0.2660
0.3269 0.7692 0.6913 1.2217 0.6664 0.7491 0.6552
0.4256 0.1386 0.2967 0.1601 0.3263 0.4574 0.2282 0.2600 0.2059 0.6836 0.1865
0.7253 0.3736 1.1342 0.2736
0.2412 0.2377 0.2103 0.2427 0.2416 0.5999
0.0415 0.0321 0.0418 0.2141
0.8153 0.7557 0.1248
0.5379 0.3669 0.3708 0.0557 0.1044 0.2854 0.1945 0.4687 0.1211 0.5207 0.4099
0.4267 0.2330 0.3833
1.2563 2.0425 2.0278 11.9349 14.3196
Q25
2
0.5226
0.3830 0.8572 0.8166 1.4907 0.7658 0.8843 0.9587
0.6999 0.1714 0.4076 0.2048 0.3745 0.6441 0.2931 0.3463 0.2517 0.9159 0.2558
0.8326 0.5916 1.2531 0.3727
0.3816 0.3850 0.3299 0.4244 0.3861 0.8504
0.0724 0.0472 0.0587 0.3289
0.9790 0.8154 0.1717
0.6558 0.4839 0.4503 0.1000 0.1480 0.3558 0.2202 0.5888 0.1374 0.6592 0.5113
0.7053 0.3200 0.6537
1.3574 2.5674 2.3083 >1 × 106 207.0945
Med
TimesFM
1.0152
0.4636 1.0138 0.9885 1.7835 0.8686 1.0615 1.3614
1.3935 0.2389 0.5787 0.2654 0.4451 0.8880 0.3926 0.4705 0.3311 1.8321 0.3119
0.9860 1.5772 1.5306 0.5817
0.6337 0.5624 0.5684 0.7662 0.8238 1.6566
0.1082 0.1624 0.0815 0.5885
1.2495 0.9126 0.2632
0.8383 0.6464 0.5802 0.1981 0.2607 0.4502 0.2719 0.8555 0.1701 0.8654 0.6913
1.2384 0.5256 1.3464
1.6917 3.1353 2.7310 >1 × 106 >1 × 106
Q75
>1 × 106
2.8461 4.6902 9.7114 8.4683 5.8021 5.1621 13.9566
921.9849 0.6714 10.8124 1.0604 0.9651 4.5963 1.1025 2.9401 0.8309 19.7730 1.2802
6.9783 >1 × 106 11.1042 8.1760
2.2865 2.4969 7.9338 10.6721 13.8733 12.1920
0.5212 1.4407 0.2987 4.7434
4.7754 3.9889 0.7748
4.0308 2.1113 >1 × 106 0.9098 1.7904 5.0338 3.2251 15.6559 2.4933 6.4892 4.4615
7.8946 4.1642 14.0379
4.8600 13.0484 22.8176 >1 × 106 >1 × 106
Max
Table B.8: Results Covariate Benchmark: Statistics (Min, Q25, Median, Q75, Max) over multiple forecast horizons and context lengths; best median per row highlighted. Overall row aggregates globally across all datasets, targets, horizons, and context lengths. Values > 106 are treated as diverged, unusable forecasts and displayed as > 106 .
43
All
Overall
Summary (Best Med)
10 random aggregated households random_household_0 random_household_1 random_household_2 NO_PV_SFH10_P_TOT NO_PV_SFH31_P_TOT WITH_PV_SFH15_P_TOT
Aggregated Solar Solar Wind Offshore Wind Onshore Solar Solar_MWh_credit total_MWh_credit Wind_MWh_credit Solar active_power generation_kwh_UG Hall4
Total Power 50 Agg Total Power Total Power 50 Agg Aggregated Profile 107
LMP NP15 LMP SP15 LMP ZP26 Day-Ahead Auction Intraday Continuous reBAP
Aggregated Load Load DE Load 2 random loads
Heatpump 818882 Heatpump 971151 Heat Demand
UW Lubmin - OWP Baltic Eagle UW Wieselbach UW Lauchstädt L471 UW Wieselbach UW Lauchstädt L472 Grid Consumption MS Grid Feed-in MS Active Power Active Power Active Power Active Power Active Power Active Power
Aggregated Batterys Fossil Gas Fossil Hard Coal
Area Control Error (NRV Saldo) Germany aFRR negativ Germany aFRR positiv TenneT negativ TenneT positiv
Target
HTW Berlin Households HTW Berlin Households HTW Berlin Households HTW Berlin Households Household Lower Saxony Household Lower Saxony Household Lower Saxony
Residential Load
California Caiso DE Power DE Power DE Power DK Power Energy Forecasting Competition PV Cluster Energy Forecasting Competition Wind+PV Energy Forecasting Competition Windpark FR Power Hill of Towie Wind PV Hong Kong
Non-Dispatchable Generation
Mobilitaet Public Charging Station NL Office EV Park UK Residential Charging Station UrbanEV China Charging Station
Mobility Data
California Caiso California Caiso California Caiso ENTSO-E Germany ENTSO-E Germany ENTSO-E Germany
Market Data
California Caiso DE Power FR Power Industrial VEA 2 Agg Profiles
Load
HEAPO: Household Zurich Area HEAPO: Household Zurich Area Heat Grid Flensburg
Heat Data
50Hertz Line Power 50Hertz Line Power 50Hertz Line Power Bayernwerk Bayernwerk Netze BW LV, Feeder 132 Netze BW LV, Feeder 160 Netze BW LV, Feeder 33 Netze BW LV, Feeder 37 Netze BW LV, Feeder 63 Netze BW LV, Feeder 97
Grid Data
California Caiso ENTSO-E Germany ENTSO-E Germany
Dispatchable Generation
Balancing Data Germany aFRR Germany aFRR Germany mFRR Germany mFRR Germany
Balancing Services
Dataset
All
Cal DE Cal DE Cal DE Cal DE Cal DE Cal DE Cal DE
Weather NP15, SP15, ZP26 PV scaled Weather Wind scaled Weather Wind scaled Weather DK Weather UK Weather Competition UK Weather Competition UK Weather Competition FR Weather Hill of Towie Weather Weather HK
DE Cal NL Cal UK Cal CN Cal
Weather NP15, Cal California Weather SP15, Cal California Weather ZP26, Cal California DE Weather + Calendar DE Weather + Calendar DE Weather + DE Cal
Weather NP15, SP15, ZP26, Cal California DE Weather + Calendar FR Weather DE Calendar
Zurich Weather + CH Cal Zurich Weather + CH Cal Weather + DE Cal
DE Weather + DE Cal DE Weather + DE Cal DE Weather + DE Cal DE Weather + Bayern Cal Bayern Weather + Bayern Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal Weather + BW Cal
Weather NP15, SP15, ZP26, Cal California Wind + DE Weather + Cal Wind Weather + Calendar
DE Weather + Calendar DE Weather + Calendar DE Weather + Calendar DE Weather + Calendar DE Weather + Calendar
Covariates
0.0058
0.1843 0.3497 0.2313 0.2365 0.1404 0.1782 0.2480
0.0338 0.0614 0.1341 0.0769 0.2350 0.2458 0.0668 0.0176 0.0626 0.3141 0.0400
0.5464 0.1004 0.9021 0.0641
0.0660 0.0642 0.0627 0.0610 0.0643 0.2596
0.0090 0.0078 0.0058 0.0614
0.3477 0.4382 0.0703
0.5020 0.1997 0.1956 0.0134 0.0278 0.0999 0.1135 0.1629 0.0779 0.1457 0.1684
0.1359 0.0626 0.0665
1.0315 1.4073 1.3608 5.0229 3.3259
Min
0.2709
0.3157 0.7288 0.6303 1.1679 0.6399 0.7175 0.5280
0.2789 0.1832 0.5583 0.4018 0.4508 0.5786 0.2901 0.3563 0.1881 0.9834 0.2456
0.6772 1.0896 1.1697 0.2503
0.1941 0.2017 0.1899 0.2547 0.1981 0.4879
0.0567 0.0656 0.0432 0.3358
0.7575 0.7157 0.1157
0.8638 0.4998 0.4955 0.0736 0.1186 0.2410 0.1630 0.5655 0.1147 0.3689 0.3366
0.3762 0.2890 0.4131
1.1861 1.9114 2.0143 9.9741 9.8012
Q25
27
0.6168
0.4002 0.8287 0.8058 1.4445 0.7276 0.8593 0.7220
1.5877 0.2711 0.6953 0.5518 0.5359 0.8674 0.4680 0.5664 0.2631 1.3252 0.6515
0.7499 1.7093 1.2738 0.3430
0.2989 0.3178 0.2736 0.3912 0.3466 0.6601
0.1265 0.1653 0.0951 0.5213
0.8539 0.7934 0.1376
1.1033 0.6297 0.6307 0.1541 0.2176 0.3585 0.1965 0.8624 0.1410 0.5901 0.4983
1.6562 0.4785 0.7066
1.2369 2.2529 2.2225 >1 × 106 >1 × 106
Med
Q75
1.0564
0.4820 0.9361 0.9107 1.6705 0.8177 0.9921 1.0056
3.4043 0.3740 0.9130 0.7187 0.7082 1.3596 0.6257 0.8407 0.3839 1.5607 1.0307
0.8678 2.9204 1.3781 0.4351
0.6299 0.6935 0.5647 0.5668 0.6223 1.0332
0.1703 0.1971 0.1220 0.6792
0.9913 0.8931 0.1818
1.3126 0.7664 0.7676 0.2218 0.3083 0.4758 0.2268 1.1525 0.1638 0.8592 0.7090
2.3452 0.6659 1.0668
1.2706 2.5930 2.3546 >1 × 106 >1 × 106
Chronos-2
0.2361 0.3838 0.2985 0.8318 0.3376 0.6037 0.3021 0.0000
>1 × 106
0.0148 0.1271 0.1170 0.0961 0.2687 0.2017 0.0309 0.0110 0.1088 0.4215 0.1094
0.5327 0.1854 0.9485 0.0767
0.0634 0.0625 0.0365 0.0448 0.1805 0.3047
0.0336 0.0136 0.0175 0.0612
0.6341 0.7755 0.0734
0.2779 0.2631 0.2624 0.0290 0.0676 0.1617 0.1572 0.2383 0.0960 0.3419 0.2453
0.1919 0.1180 0.0552
1.1397 1.2130 1.3778 4.9390 0.0000
Min
0.7512 1.4130 1.2085 2.0409 0.9810 1.3005 1.5282
2316.4590 0.9214 16.9366 1.9142 1.5437 4.5811 1.3451 4.6669 0.7947 3.7004 6.7483
1.0676 >1 × 106 2.5616 1.0110
5.0033 3.8426 5.4946 12.3767 12.7509 3.1974
0.3396 0.2583 0.1743 1.8948
1.5154 1.3936 0.4630
4.6604 1.3424 >1 × 106 0.3023 0.5613 0.9973 0.3228 2.4649 0.2131 1.4526 1.3556
9.1685 1.3783 7.2209
1.3583 3.9312 3.0507 >1 × 106 >1 × 106
Max
0.3434
0.3515 0.8677 0.6808 1.1716 0.7891 1.0496 0.6526
0.7148 0.3544 0.4288 0.4424 0.4652 0.4619 0.3021 0.2989 0.3075 0.8503 0.2528
0.7866 0.5778 1.2088 0.2927
0.2097 0.2193 0.2045 0.4049 0.3843 0.5182
0.0896 0.0298 0.0518 0.2031
0.9581 0.9249 0.1430
0.4770 0.4983 0.5066 0.1094 0.2194 0.4220 0.2163 0.4734 0.1669 0.9572 0.6103
1.0401 0.3353 0.4194
1.2369 1.9432 1.9034 142.3116 148.7303
Q25
7
0.6587
0.3908 1.0435 0.7886 1.3281 0.9168 1.2947 0.8822
1.2632 0.5098 0.6644 0.6136 0.6271 0.6849 0.3739 0.4213 0.4436 1.1840 0.3338
0.8876 0.8431 1.3660 0.3653
0.3946 0.3706 0.3515 0.6568 0.5748 0.7205
0.1171 0.0394 0.0792 0.2578
1.2076 0.9968 0.1800
0.5969 0.6309 0.6535 0.1791 0.2980 0.5869 0.2469 0.7544 0.2232 1.2188 0.8908
1.3271 0.4174 0.6393
1.2683 2.5026 2.1612 >1 × 106 9930.4413
Med
Q75
1.1655
0.4405 1.2834 0.8736 1.5237 1.0180 1.8288 1.0913
1.7622 0.7321 0.9835 0.8085 0.7893 0.8503 0.5070 0.6446 0.6368 1.7246 0.4909
1.0695 1.8656 1.5732 0.4800
0.6250 0.6073 0.5761 1.1737 0.8878 1.2983
0.1467 0.0667 0.1059 0.3890
1.3976 1.0789 0.2977
0.7257 0.8446 0.8735 0.2818 0.4136 0.8725 0.3005 1.0632 0.2583 1.4733 1.1614
1.7499 0.5283 0.9879
1.3020 3.4147 2.4650 >1 × 106 >1 × 106
RandomForest
>1 × 106
0.6296 2.3120 1.1610 3.6669 1.6981 3.7198 2.8475
66.2516 1.7325 4.6994 2.6016 1.5862 2.9353 1.1862 3.2346 0.8720 9.1513 1.1939
1.7092 >1 × 106 3.2447 1.1299
3.1464 3.9737 3.1484 14.2649 7.5323 10.7840
0.2796 0.1886 0.2086 0.9809
2.1057 1.7813 2.6712
2.3695 3.3814 >1 × 106 0.5127 0.6520 1.3095 0.4917 2.3041 0.3439 2.3061 1.6359
4.0102 1.0413 3.9918
1.3900 7.7331 7.3007 >1 × 106 >1 × 106
Max
0.0083
0.2436 0.3674 0.3192 0.8694 0.5834 0.6875 0.3883
0.0396 0.0893 0.1164 0.1062 0.2729 0.2392 0.0413 0.0148 0.0608 0.2429 0.0934
0.5522 0.1955 1.0137 0.0986
0.0777 0.1008 0.0923 0.0900 0.1688 0.2770
0.0083 0.0106 0.0153 0.0841
0.6904 0.7573 0.0607
0.2636 0.2085 0.1991 0.0252 0.0709 0.1314 0.1425 0.1990 0.0905 0.3351 0.1893
0.0816 0.0778 0.0794
1.1210 1.2115 1.3966 4.9793 3.1876
Min
0.3193
0.3516 0.8112 0.7678 1.3797 0.8467 1.2372 0.7696
0.3925 0.2674 0.4116 0.2998 0.4497 0.4822 0.2745 0.2951 0.2314 0.6525 0.2379
0.7667 0.5120 1.2614 0.2969
0.2910 0.3463 0.2979 0.3674 0.4937 0.5561
0.0375 0.0248 0.0412 0.1994
0.9181 0.9419 0.1051
0.4751 0.4238 0.4047 0.1025 0.1803 0.3284 0.2136 0.4029 0.1186 0.7865 0.5170
0.3672 0.2762 0.3546
1.2303 1.9635 1.9324 10.4132 16.4038
Q25
20
0.6026
0.3955 0.9997 0.8661 1.6437 0.9113 1.5531 0.9611
0.9598 0.4077 0.6479 0.3839 0.5842 0.6810 0.3450 0.4409 0.3219 0.8158 0.3017
0.8642 0.7511 1.3316 0.3662
0.5032 0.5333 0.4986 0.5571 0.9295 0.7663
0.0624 0.0330 0.0607 0.2518
1.1972 0.9900 0.1336
0.6041 0.5665 0.5438 0.1727 0.2616 0.4820 0.2436 0.4887 0.1301 0.9904 0.6475
0.5876 0.3470 0.5346
1.2616 2.6146 2.1804 >1 × 106 >1 × 106
Med
Q75
1.0996
0.4546 1.3161 0.9524 1.9906 0.9679 2.0152 1.1948
1.6078 0.5640 0.9185 0.4896 0.7546 0.8785 0.4345 0.5813 0.4625 1.1684 0.4115
1.0344 1.2441 1.4493 0.4738
0.9329 0.8073 0.7651 1.1785 1.5435 1.5230
0.0877 0.0422 0.0909 0.4050
1.4055 1.0441 0.2140
0.7319 0.8102 0.7998 0.2741 0.4785 0.6543 0.2806 0.6449 0.1460 1.2351 0.7822
0.9264 0.4435 0.8458
1.2918 3.7036 2.6241 >1 × 106 >1 × 106
XGBoost
>1 × 106
1.0291 2.3555 1.5626 5.7324 1.3373 4.6220 2.2769
1720.7720 1.0320 4.6151 1.1258 1.5366 2.8173 1.3514 1.9037 0.7720 10.8274 1.2580
1.6603 >1 × 106 2.1444 1.0347
20.5536 5.6083 4.6540 7.4026 23.2747 13.5733
0.2416 0.0991 0.2323 1.1366
2.2991 1.5257 1.1000
2.8345 3.1807 >1 × 106 0.4663 0.8030 0.9683 0.4565 1.2441 0.1959 1.9582 1.5450
4.0855 0.7188 2.7132
1.4931 11.2826 7.5942 >1 × 106 >1 × 106
Max
Table B.9: Results Training Benchmark: Statistics (Min, Q25, Median, Q75, Max) over multiple forecast horizons and context lengths; best median per row highlighted. Overall row aggregates globally across all datasets, targets, horizons, and context lengths. Values > 106 are treated as diverged, unusable forecasts and displayed as > 106 .
44