Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning Jiazhe Wanga,1 , Zhiquan Huangb,1 , Linjing Xuea , Ming Liua , Meiwen Lia and Ruijuan Zhengb,∗ a School of Software, Henan University of Science and Technology, Luoyang, 471000, Henan, China
arXiv:2608.19966v1 [cs.AI] 20 Aug 2026
b School of Information Engineering, Henan University of Science and Technology, Luoyang, 471023, Henan, China
ARTICLE INFO
ABSTRACT
Keywords: Multivariate time series forecasting Semantic structured partitioning Transfer entropy graph Importance aware routing
Multivariate time series forecasting (MTSF) is a fundamental task in many real world applications. Existing patch based forecasting methods generally fall into three categories: fixed partitioning, multi-scale partitioning, and extendable partitioning. Fixed partitioning often breaks meaningful temporal boundaries, multi-scale partitioning may introduce redundant representations across scales, and extendable partitioning improves flexibility but still lacks an explicit mechanism for organizing semantic structure and modeling interactions among heterogeneous temporal patterns. To address these limitations, we propose SCPaT, a Transformer based framework built on semantic structured partitioning. SCPaT first decomposes input sequences into semantically consistent units through adaptive semantic unit generation, then constructs a dynamic semantic graph to model directed dependencies among these units and organize them into higher order semantic blocks. Based on these structured representations, an importance aware routing mechanism adaptively dispatches different semantic blocks to different experts for customized modeling. Extensive experiments on 12 real world datasets demonstrate the effectiveness of SCPaT.
1. Introduction Multivariate time series forecasting (MTSF) plays an important role in various domains (Qiu et al., 2024), including electricity load forecasting (Gasparin et al., 2022), weather forecasting (Karevan and Suykens, 2020), and traffic flow forecasting (Lippi et al., 2013). Recent advances in deep learning have led to a wide range of forecasting architectures for MTSF (Huang et al., 2025). Among them, patch based modeling has emerged as an effective paradigm for capturing complex temporal dependencies (Cao et al., 2025). By partitioning long sequences into temporal patches, these methods reduce modeling complexity while preserving fine grained local patterns (Zhang and Yan, 2023a). However, the effectiveness of these models hinges critically on how the input sequence is partitioned, a design choice that, as we will show, has profound implications for semantic preservation. Consequently, the design of patch partitioning strategies has become a key consideration in patch based Multivariate time series forecasting . Existing patch partitioning strategies can be broadly categorized into three types: fixed partitioning (Nie et al., 2023), multi-scale partitioning (Wu et al., 2022), and extendable partitioning (Huang et al., 2024). Among these strategies, fixed partitioning is the most widely adopted in patch based forecasting. It divides a time series into equal length segments and treats each segment as an input unit, ∗ Corresponding author
231451080320@stu.haust.edu.cn (J. Wang); zqhuang@stu.haust.edu.cn (Z. Huang); ljxue@stu.haust.edu.cn (L. Xue); liuming@haust.edu.cn (M. Liu); mwli@stu.haust.edu.cn (M. Li); zhengruijuan@haust.edu.cn (R. Zheng) ORCID (s): 1 These authors contributed equally to this work.
Page 1 of 13
Fixed
Multi-Scale
(a)
(b)
Extendable
Semantic-Structured Spike Trend
(c)
Seasonal
(d)
Figure 1: Comparison of four patch based schemes: fixed partitioning, multi-scale partitioning, extendable partitioning, and the proposed semantic structured partitioning.
thereby reducing the effective sequence length and simplifying the modeling process. As illustrated in Figure 1(a), this design is computationally efficient and performs well on time series with regular and predictable patterns. However, because it relies on uniform segmentation, fixed partitioning often fails to align with meaningful temporal boundaries in nonstationary sequences, particularly in the presence of trend shifts or abrupt events (Kazemi et al., 2020). This limitation restricts its ability to represent complex temporal dynamics and motivates the development of more flexible partitioning strategies. To overcome the limited flexibility of fixed partitioning, researchers have proposed multi-scale partitioning. This strategy partitions the time series at multiple levels of granularity, so that scale specific representations can be modeled separately and then integrated. As shown in Figure 1(b), this strategy provides a richer characterization of temporal dynamics by capturing both local short term fluctuations
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning
and global long term trends (Ye and Ma, 2023). However, when similar temporal patterns are captured at multiple granularities, the corresponding representations may overlap substantially across scales, thereby introducing redundancy during cross scale integration (Hu et al., 2025; Liu et al., 2025b). Such redundancy may in turn encourage the model to learn superfluous features. This problem becomes more pronounced in datasets with complex and overlapping dependencies, where heterogeneous dynamic patterns are more difficult to disentangle. These limitations motivate the development of more adaptive partitioning mechanisms. Extendable partitioning further increases flexibility by allowing the length of each temporal segment to vary according to data characteristics (Zhang et al., 2025; Liu et al., 2025a). By adapting segment granularity to local dynamics, this strategy better preserves temporal boundary information and captures local semantic patterns. As illustrated in Figure 1(c), such adaptive partitioning provides greater flexibility for modeling the diversity and complexity of temporal variations. Nevertheless, existing extendable partitioning methods typically determine segmentation granularity using heuristic rules, which limits their ability to handle complex higher order dependencies. In scenarios characterized by strong nonlinear dependencies or multiple coexisting temporal patterns, these methods often struggle to model interactions among heterogeneous patterns, which results in suboptimal forecasting performance. These observations suggest that improving partition flexibility alone is insufficient for modeling the semantic structure underlying complex temporal dynamics. Despite the advances achieved by existing methods, a critical research gap remains fundamentally unaddressed: none of the current partitioning strategies explicitly accounts for the intrinsic semantic coherence of temporal segments, nor do they model the higher order structural interactions among heterogeneous temporal patterns. In essence, all these approaches treat patch generation as a geometric preprocessing step rather than as an integral semantic modeling task. This deficiency is particularly detrimental when trends, periodicities, and abrupt fluctuations coexist in the same time series, as the model lacks a principled and feasible mechanism to disentangle these diverse components and establish structured relationships among them. Therefore, we argue that the core challenge of patch-based forecasting lies not in pursuing greater partition flexibility, but in constructing a representation system that embeds semantic structure. Based on the above analysis, we propose SCPaT, a Transformer based framework for MTSF that models dynamic semantic structure through semantic structured partitioning. Specifically, SCPaT extracts fundamental temporal components from raw time series and organizes them into hierarchical semantic blocks, which provide multilevel semantic abstractions for forecasting. These semantic blocks are then incorporated into the attention mechanism through an importance aware routing module, which enables the model to emphasize informative representations and capture Page 2 of 13
dependencies across different semantic types. Extensive experiments on multiple benchmarks show that SCPaT achieves state of the art results in both long term and short term forecasting tasks. The main contributions of this work are summarized as follows: • Systematic Analysis. We present a systematic analysis of three representative patch partitioning strategies for time series forecasting and show that their limitations reflect the lack of an explicit semantic structured partitioning mechanism. • Innovative Framework. We propose SCPaT, a Transformer based framework that integrates hierarchical semantic blocks and an importance aware routing mechanism into attention, enabling more effective modeling of key dependencies in MTSF. • Extensive Evaluations. Extensive experiments on long term and short term forecasting benchmarks demonstrate that SCPaT achieves state of the art performance across a wide range of datasets.
2. Related Work 2.1. Transformer based Time Series Forecasting Transformer-based models have become widely used in MTSF due to their strong parallel modeling capability and ability to capture long-range dependencies (Qiu et al., 2026; Liu et al., 2022). Representative methods have improved forecasting performance from different perspectives. For instance, iTransformer (Liu et al., 2024) enhances crossvariable dependency modeling by reorganizing tokens along the variable dimension. Pathformer (Chen et al., 2024) captures both local and global temporal contexts using multiscale patch partitioning with an adaptive path strategy. Fredformer (Piao et al., 2024) mitigates high-frequency bias through frequency debiasing. However, these methods are still limited in their ability to explicitly characterize heterogeneous dynamics within patches and capture interactions across different temporal patterns (Yang et al., 2025). This limitation becomes particularly evident when trends, periodicity, and abrupt fluctuations coexist in the same time series. Such scenarios require mechanisms that can distinguish local semantic differences and model complex dependencies more effectively.
2.2. Patch Based Time Series Forecasting Patch based methods have become an important direction in time series forecasting, with early studies primarily relying on fixed partitioning strategies (Wu et al., 2025; Chen et al., 2024). PatchTST (Nie et al., 2023), for example, segments time series into equal length patches to improve representation efficiency. However, fixed partitioning often fails to preserve meaningful temporal boundaries, which may lead to the loss of salient local patterns and semantic inconsistency within patches. To address this issue, subsequent studies have explored multi-scale
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning
𝑥1 𝑥2 𝑥3
𝑢𝑖
𝑢𝑖
𝑢𝑖
Directed Information Flow
TE Computation τ+1 τ ෫ TE ; ui uτj i→j ∝ I uj
Multivariate time series 𝐗 ∈ 𝑅 𝐶×𝐿
𝑢1 𝑢2 𝑢3
𝑥1 𝑥2 𝑥3
Sparsify
Output Layer
𝑢𝑖
𝑢𝑖
𝑢𝑖
𝑢𝑖
𝑢𝑖
High order Semantic Blocks
𝑏1
𝑒1
𝑏2
Importance aware Routing
Abrupt
𝑏3
TE Graph Constructor Graphs
Input Layer
𝑥1 𝑥2 𝑥3
Seasonal
? ? ? ?
m 𝑠𝑖out 𝑠𝑗in 1 𝑄 𝒞 = 𝑊𝑖𝑗′ − 𝟏 𝑐𝑖 = 𝑐𝑗 𝒲 𝒲
𝑖,𝑗
(b) Transfer Entropy Graph Constructor Fusion
Local Features
Kernel 1
Local Features
𝑢𝑖 Semantic Enc. 𝑢𝑖 Semantic Unit
Scale 3
Unit Generation
Kernel 3 k−1
𝑬𝒙𝒑𝒆𝒓𝒕𝟐
𝑬𝒙𝒑𝒆𝒓𝒕𝟑 SelfAttn
Transformer -Seasonal
2 𝑠𝑚
𝑛
3 𝑠𝑚
Importance aware Routing
𝑢2
k,d k,d h෪ zc,t c,t = αc
𝒵 = z k,d
zt k,d = wj k,d ⋅ hc,t−jd
Transformer -Abrupt
1 𝑠𝑚
𝑢1
Fusion
Kernel 2
Scale 2 ? ?
Graphs
Multi scale Temporal Conv
SelfAttn
𝑒3
i∈b
Scale 1
Transformer -Trend
em = ωi ui
Sparsify
Semantic Vector Encoder
SelfAttn
Trend
𝑒2
Transformer Experts
Global Prediction 𝑌global Transformer-based Experts
𝑬𝒙𝒑𝒆𝒓𝒕𝟏
Clustering Sparsify
𝑢𝑖
(c) Importance aware Routing
k, d ∈ 𝒮
where 𝒮 = { k m , dm }M m=1
j=0
k,d ∈𝒮
uc,i = ϕ2 W2ϕ1 W1 hc,i + b1 + b2
𝑢3
(a) Semantic Vector Encoder
e = 𝑊e em + 𝑊s sm + 𝑊n . Agg {en : n ∈ 𝑁(𝑚)} + 𝑏𝑒
Multivariate time series 𝐗 ∈ 𝑅 𝐶×𝐿
Figure 2: SCPaT architecture consists of: (a) Semantic Vector Encoder, which encodes time series into semantic units; (b) Transfer Entropy Graph Constructor, quantifies directed dependencies and constructs a dynamic semantic graph; and (c) Importance aware Routing, allocates customized processing strategies to different semantic blocks for effective modeling.
partitioning strategies. For instance, TimesNet (Wu et al., 2022) models temporal patterns across different scales, while FEDformer (Zhou et al., 2022) integrates local and global trends under a frequency domain decomposition framework. Extendable partitioning has further emerged as a flexible alternative, with HDMixer (Huang et al., 2024) introducing length adaptive patches that dynamically adjust segment boundaries, improving semantic integrity and modeling flexibility. Despite these advances, existing patch based methods remain limited in their ability to explicitly capture fine grained semantic variation and higher order temporal dependencies. All of them formulate patch generation as a geometric partitioning problem, whereas our SCPaT redefines it from a semantic structure perspective.
3. Proposed Methodology 3.1. Preliminaries In multivariate time series forecasting, the input is denoted by 𝐗 = {𝐱1 , 𝐱2 , … , 𝐱𝐶 } ∈ ℝ𝐶×𝐿 , where 𝐶 is the number of variables and 𝐿 is the length of the historical lookback window. Here, 𝐱𝑐 ∈ ℝ𝐿 denotes the historical observations of the 𝑐-th variable. The goal is to learn a forecasting function 𝑓Θ (⋅) that maps the historical sequence to future values 𝐘̂ ∈ ℝ𝐶×𝐻 , where 𝐻 is the prediction length. Formally, 𝐘̂ = 𝑓Θ (𝐗). We partition the historical sequence of each variable into 𝑁 = ⌊𝐿∕𝑠⌋ non overlapping temporal patches, where 𝑠 denotes the patch size. These patches are then embedded into a hidden space of dimension Page 3 of 13
𝑑ℎ , yielding patch level representations. Based on these representations, we further construct semantic units, semantic graphs, and block wise routed experts to model structured dependencies for forecasting.
3.2. Semantic Vector Encoder The semantic vector encoder maps the input sequence 𝐗 ∈ ℝ𝐶×𝐿 into a set of local semantic representations. It extracts temporal patterns at multiple scales, adaptively fuses the resulting features, and organizes the fused sequence into semantic units.
3.2.1. Multi scale Temporal Convolution To capture local temporal variations at different resolutions, we apply multi scale temporal convolutions to the projected feature sequence. For the 𝑐-th variable, let 𝐡𝑐 = {𝐡𝑐,𝑡 }𝐿 denote its projected feature sequence, where 𝑡=1 𝑑 ℎ 𝐡𝑐,𝑡 ∈ ℝ is the hidden representation at time step 𝑡. For a temporal branch with kernel size 𝑘 and dilation factor 𝑑, the output at time step 𝑡 is defined as: (𝑘,𝑑) 𝐳𝑐,𝑡 =
𝑘−1 ∑
𝑤(𝑘,𝑑) 𝐡𝑐,𝑡−𝑗𝑑 , 𝑗
(1)
𝑗=0 (𝑘,𝑑) where 𝐳𝑐,𝑡 ∈ ℝ𝑑ℎ denotes the feature extracted at scale
(𝑘, 𝑑), 𝑤(𝑘,𝑑) is the 𝑗-th kernel coefficient, and zero padding 𝑗 is applied when 𝑡 − 𝑗𝑑 < 1. The corresponding branch output in compact form is: 𝐙(𝑘,𝑑) = 𝐖(𝑘,𝑑) ∗ 𝐇𝑐 , 𝑐
(2)
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning
where ∗ denotes temporal convolution, 𝐇𝑐 = [𝐡𝑐,1 , … , 𝐡𝑐,𝐿 ], and 𝐖(𝑘,𝑑) is the convolution kernel associated with scale (𝑘, 𝑑). The effective receptive field of this branch is defined as 𝑟(𝑘,𝑑) = 1 + (𝑘 − 1)𝑑, which is determined by the kernel size 𝑘 and dilation factor 𝑑. To capture temporal patterns at multiple granularities, we introduce a set of temporal branches = {(𝑘𝑚 , 𝑑𝑚 )}𝑀 , 𝑚=1 where 𝑀 is the number of branches. The resulting multi scale feature set is defined as: { } 𝑐 = 𝐙(𝑘,𝑑) ∣ (𝑘, 𝑑) ∈ . (3) 𝑐
3.2.2. Adaptive Multi scale Fusion To integrate temporal patterns captured at different scales, we perform adaptive multi scale fusion over the branch set . The fused hidden vector at time step 𝑡 is defined as: ∑ (𝑘,𝑑) ̃𝐡𝑐,𝑡 = 𝛼𝑐(𝑘,𝑑) 𝐳𝑐,𝑡 , (4) (𝑘,𝑑)∈
where ̃𝐡𝑐,𝑡 ∈ ℝ𝑑ℎ denotes the fused representation of variable 𝑐 at time step 𝑡, and 𝛼𝑐(𝑘,𝑑) denotes the fusion weight assigned to branch (𝑘, 𝑑). The fusion weights are obtained by normalizing learnable branch scores: ( ) exp 𝛾𝑐(𝑘,𝑑) (𝑘,𝑑) (5) =∑ 𝛼𝑐 ( (𝑘′ ,𝑑 ′ ) ) , (𝑘′ ,𝑑 ′ )∈ exp 𝛾𝑐 where 𝛾𝑐(𝑘,𝑑) is the trainable score associated with scale pair (𝑘, 𝑑) for variable 𝑐. This formulation allows the encoder to adaptively emphasize more informative temporal scales for each variable. For convenience, we denote the fused ̃ 𝑐 = [̃𝐡𝑐,1 , ̃𝐡𝑐,2 , … , ̃𝐡𝑐,𝐿 ]. sequence of variable 𝑐 by 𝐇
determined as: { min 𝛿𝑖 , if 𝛿𝑖 ≠ ∅, 𝑙𝑖 = 𝐿max , otherwise.
(7)
where 𝛿 is a threshold controlling the sensitivity to local variation. This rule assigns longer units to locally stable regions and shorter units to rapidly changing regions. The variance criterion determines adaptive structural boundaries, while the semantic content is encoded by the learned multi scale representation. Because the segment length 𝑙𝑖 varies across units, we first map each segment to a fixed dimensional summary ∑𝑖+𝑙 −1 vector via mean pooling, i.e., ̄𝐡𝑐,𝑖 = 𝑙1 𝑡=𝑖𝑖 ̃𝐡𝑐,𝑡 . The 𝑖 semantic unit representation is then computed as: ( ( ) ) 𝐮𝑐,𝑖 = 𝜙2 𝐖2 𝜙1 𝐖1̄𝐡𝑐,𝑖 + 𝐛1 + 𝐛2 , (8) where 𝐖1 and 𝐖2 are learnable projection matrices, and 𝐛1 and 𝐛2 are learnable bias vectors. Since the number of semantic units 𝑁𝑐 may vary across variables, establishing correspondences among units from different variables is essential for the subsequent Transfer Entropy modeling. For each timestamp 𝑡, we take the semantic unit that covers 𝑡 from each variable as the aligned unit set at that time step. This yields a sequence of aligned unit tuples across the temporal axis, enabling consistent dependency modeling among variables in the TE graph construction. For variable 𝑐, this procedure yields a unit sequence 𝑐 = {𝐮𝑐,1 , 𝐮𝑐,2 , … , 𝐮𝑐,𝑁𝑐 }, where 𝑁𝑐 is the number of extracted units. All units are then re indexed into ∑ 𝑁𝑢 a unified set = {𝐮𝑛 }𝑛=1 , where 𝑁𝑢 = 𝐶 𝑐=1 𝑁𝑐 . Each unit 𝐮𝑛 is associated with its variable identity and temporal span for subsequent dependency modeling.
3.3. Transfer Entropy Graph Constructor 3.2.3. Semantic Unit Generation ̃ 𝑐 , we partition each Based on the fused sequence 𝐇 variable into non overlapping semantic units and encode each unit into a compact representation. Specifically, a unit starting at position 𝑖 with length 𝑙𝑖 spans [𝑖, 𝑖 + 𝑙𝑖 − 1], and the next unit starts at position 𝑖 + 𝑙𝑖 . To adapt the partition to local temporal variation, the unit length is selected from a candidate set = {1, … , 𝐿max }, where 𝐿max is the maximum unit length. For a candidate ̃ 𝑐 [𝑖 ∶ 𝑖 + 𝑙′ − 1], we compute a scalar activation segment 𝐇 ∑𝑑ℎ ̃ ℎ𝑐,𝑡,𝑟 , where ℎ̃ 𝑐,𝑡,𝑟 at each time step as 𝑎𝑐,𝑡 = 𝑑1 𝑟=1 ℎ denotes the 𝑟-th dimension of ̃𝐡𝑐,𝑡 . The local variance of the candidate segment is then defined as: ′
𝑖+𝑙 ∑−1 ( ( ) )2 ̃ 𝑐 [𝑖 ∶ 𝑖 + 𝑙′ − 1] = 1 Var 𝐇 𝑎𝑐,𝑡 − 𝑎̄𝑐,𝑖,𝑙′ , (6) ′ 𝑙 𝑡=𝑖
∑ ′ −1 where 𝑎̄𝑐,𝑖,𝑙′ = 𝑙1′ 𝑖+𝑙 𝑎𝑐,𝑡 is the segment mean. 𝑡=𝑖 𝛿 ′ ̃ 𝑐 [𝑖 ∶ 𝑖 + 𝑙′ − 1]) > 𝛿} denote Let 𝑖 = {𝑙 ∈ ∣ Var(𝐇 the admissible length set at position 𝑖. The unit length is then Page 4 of 13
The transfer entropy graph constructor quantifies directed information flow among semantic units to build a dynamic semantic graph, which subsequently supports the formation of higher order semantic blocks. This design captures nonlinear and asymmetric dependency structures beyond simple correlation based relations.
3.3.1. Transfer Entropy Computation. Traditional correlation based measures are often insufficient for modeling directed nonlinear dependencies, as they are typically symmetric and do not capture conditional information flow. We therefore introduce a differentiable transfer entropy inspired surrogate for directed conditional dependence between semantic units. Specifically, for two semantic units 𝐮𝑖 and 𝐮𝑗 , we use the following conditional dependence target: ( ) 𝜏 𝜏 ̃ 𝑇 𝐸 𝑖→𝑗 ∝ 𝐼 𝐮𝜏+1 (9) 𝑗 ; 𝐮𝑖 ∣ 𝐮𝑗 , where 𝐼(⋅; ⋅ ∣ ⋅) denotes conditional mutual information, and 𝜏 indexes valid aligned unit transitions. This target captures
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning
the additional predictive information provided by 𝐮𝜏𝑖 beyond the self history 𝐮𝜏𝑗 . To obtain a practical differentiable surrogate, we use 𝜏 for the aligned unit level step within a sample and 𝑏 for the sample index in the mini batch. For each ordered pair (𝑖, 𝑗), let Ω𝑖𝑗 denote the set of valid aligned transitions (𝑏, 𝜏) in
node, we retain only the Top-𝐾𝑔 outgoing edges with the largest weights, where 𝐾𝑔 = ⌈𝛼 ⋅ 𝑁⌉ and 𝑁 is the total number of semantic units: { 𝑊𝑖𝑗 , 𝑗 ∈ TopK 𝑔𝑖 (𝑊𝑖⋅ ), ′ 𝑊𝑖𝑗 = (13) 0, otherwise,
the current mini batch for which 𝐮(𝑏,𝜏) , 𝐮(𝑏,𝜏) , and 𝐮(𝑏,𝜏+1) 𝑖 𝑗 𝑗 all exist, and let 𝑀𝑖𝑗 = |Ω𝑖𝑗 |. We then define the directed dependency surrogate as: ( ) ∑ 1 (𝑏,𝜏) (𝑏,𝜏) ̂ 𝜓 𝐮(𝑏,𝜏+1) , 𝐮 , 𝐮 , (10) 𝑇 𝐸 𝑖→𝑗 = 𝑗 𝑖 𝑗 𝑀𝑖𝑗 (𝑏,𝜏)∈Ω
where 𝑊𝑖⋅ denotes the 𝑖-th row of 𝑊 . This step reduces graph density and suppresses noisy or marginal interactions. For subsequent aggregation, we normalize the sparse adjacency matrix by row:
𝑖𝑗
where 𝜓(⋅) is a learnable sample level scoring function. In practice, 𝜓(⋅) is instantiated as a 3-layer MLP with hidden dimensions [3𝑑ℎ , 𝑑ℎ , 1], where the input is the concatenation of 𝐮(𝑏,𝜏+1) , 𝐮(𝑏,𝜏) , and 𝐮(𝑏,𝜏) , and the output is 𝑗 𝑖 𝑗 a scalar dependency score. This network contains approximately 3𝑑ℎ2 + 𝑑ℎ parameters, accounting for less than 1% of the total model and incurring negligible inference overhead. For each valid transition (𝑏, 𝜏) ∈ Ω𝑖𝑗 , we form a triplet representation 𝐪(𝑏,𝜏) by concatenating 𝐮(𝑏,𝜏+1) , 𝐮(𝑏,𝜏) , and 𝑖𝑗 𝑗 𝑖 𝐮(𝑏,𝜏) , and compute its score using MLP𝜓 (𝐪(𝑏,𝜏) 𝑗 𝑖𝑗 ), where MLP𝜓 outputs a scalar and is shared across all ordered pairs (𝑖, 𝑗). To characterize the stability of the estimated dependency, we further compute its sample standard deviation over the same valid transition set: √ √ √ 𝜎 ̂𝑖→𝑗 = √
∑
1 𝑀𝑖𝑗 − 1 (𝑏,𝜏)∈Ω
(
(
)
̂ MLP𝜓 𝐪(𝑏,𝜏) −𝑇 𝐸 𝑖→𝑗 𝑖𝑗
)2
,
𝑖𝑗
(11) where larger 𝜎 ̂𝑖→𝑗 indicates less stable directed dependency. The scoring network MLP𝜓 is trained jointly with the forecasting backbone in an end to end manner and is used only to produce relative dependency scores for graph construction, rather than to perform explicit density estimation.
3.3.2. Graph Construction with Sparsification Based on the estimated directed dependency values, we construct a dynamic semantic graph 𝐺 = (𝑉 , 𝐸, 𝑊 ), where 𝑉 is the semantic unit set, 𝐸 denotes the directed edge set, and 𝑊 ∈ ℝ|𝑉 |×|𝑉 | is the weighted adjacency matrix. The edge weight from node 𝑖 to node 𝑗 is defined as: ( ) ̂ 𝑊𝑖𝑗 = max 0, 𝑇 𝐸 𝑖→𝑗 − 𝜂 𝜎 ̂𝑖→𝑗 , (12) where 𝜂 is a significance coefficient used to suppress weak or unstable dependencies. Since the weighted adjacency matrix can become dense as the number of semantic units grows, we further sparsify the graph to improve robustness and efficiency. Sparsification is applied after computing all pairwise TE scores. Although this does not reduce the pairwise computation complexity, it reduces the cost of subsequent graph-based operations. Specifically, for each Page 5 of 13
𝑊̄ 𝑖𝑗 = ∑
𝑊𝑖𝑗′ ′ 𝑗 ′ 𝑊𝑖𝑗 ′ + 𝜖
,
(14)
where 𝜖 is a small positive constant for numerical stability.
3.3.3. Graph Clustering for Higher order Semantic Blocks After obtaining the sparse semantic graph, we perform graph clustering to identify higher order semantic blocks. Let 𝑐 ∶ 𝑉 → {1, 2, … , 𝐾𝑏 } denote the cluster assignment function, where 𝐾𝑏 is the number of semantic blocks. The optimal partition is obtained by maximizing directed weighted modularity, i.e., ∗ = arg max 𝑄(), with [ ] in 𝑠out 𝑖 𝑠𝑗 1 ∑ ′ 𝑊𝑖𝑗 − 𝟏(𝑐𝑖 = 𝑐𝑗 ), (15) 𝑄() = 𝑖,𝑗 ∑ ∑ ∑ ′ in ′ ′ where 𝑠out = 𝑗 𝑊𝑖𝑗 , 𝑠𝑗 = 𝑖 𝑊𝑖𝑗 , = 𝑖,𝑗 𝑊𝑖𝑗 , 𝑖 and 𝟏(⋅) is the indicator function. In practice, clustering is performed online on the current sparse graph during each forward pass. The resulting assignments are treated as discrete structural decisions and are not backpropagated through.This decoupling does not affect global optimization since the clustering step contains no learnable parameters and receives no gradient signals, with all trainable parameters updated solely through the routing outputs, thereby avoiding non-smoothness in the loss landscape. Each cluster defines a semantic block, denoted by 𝑏𝑚 = {𝐮𝑖 ∣ 𝑐𝑖 = 𝑚} for 𝑚 = 1, 2, … , 𝐾𝑏 . To obtain a block level representation, we aggregate the units within each block using attention weights: ( ) exp 𝜙𝑤 (𝐮𝑖 ) 𝑖 ∈ 𝑏𝑚 , (16) 𝜔𝑖 = ∑ ( ), 𝑗∈𝑏𝑚 exp 𝜙𝑤 (𝐮𝑗 ) where 𝜙𝑤 (⋅) is a lightweight scoring function. The corre∑ sponding block embedding is defined as 𝐞𝑚 = 𝑖∈𝑏𝑚 𝜔𝑖 𝐮𝑖 . In addition, we define a block statistic vector 𝐬𝑚 ∈ ℝ𝑑𝑠 to summarize coarse structural properties of block 𝑚, including its normalized size, average incoming strength, average outgoing strength, and average temporal span. These low dimensional statistics provide auxiliary cues for routing beyond the content embedding 𝐞𝑚 . To capture inter block context, we construct a block neighborhood graph induced by the sparse unit graph. Two
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning
blocks 𝑚 and 𝑛 are considered neighbors if there exists at least one edge in 𝑊 ′ linking a unit in 𝑏𝑚 to a unit in 𝑏𝑛 . The neighborhood of block 𝑚 is denoted by (𝑚), and neighboring block embeddings are summarized by mean aggregation: ( ) Agg {𝐞𝑛 ∶ 𝑛 ∈ (𝑚)} =
∑ 1 𝐞𝑛 , | (𝑚)| 𝑛∈ (𝑚)
(17)
where the aggregation is defined as the zero vector if (𝑚) = ∅. This design enables the higher order semantic structure to adapt to changing representations while maintaining stable and efficient optimization.
3.4. Importance Aware Routing Semantic blocks in MTSF can exhibit diverse temporal characteristics. Slowly varying blocks tend to depend more on long range patterns, whereas rapidly varying blocks rely more on local structure. To accommodate this heterogeneity, we introduce an importance aware routing mechanism that routes semantic blocks to different experts.
3.4.1. Expert Network Given the 𝑚-th semantic block, we first construct its routing representation by jointly incorporating block content, block level statistics, and neighborhood context: ( ) 𝐞̃ 𝑚 = 𝐖𝑒 𝐞𝑚 +𝐖𝑠 𝐬𝑚 +𝐖𝑛 Agg {𝐞𝑛 ∶ 𝑛 ∈ (𝑚)} +𝐛𝑒 , (18) where 𝐖𝑒 , 𝐖𝑠 , and 𝐖𝑛 are projection matrices, and 𝐛𝑒 is a bias term. We further introduce a semantic bias vector: ) ( (19) 𝐕𝑚 = 𝐕0 + 𝛽 ⋅ tanh 𝐖𝑣 𝐞̃ 𝑚 + 𝐛𝑣 , where 𝐕0 is a globally learnable base bias, 𝛽 is a scaling coefficient, and 𝐖𝑣 and 𝐛𝑣 are learnable parameters. We use 𝑅 experts, denoted by {Expert 𝑘 }𝑅 , each pa𝑘=1 rameterized independently. For computation, each semantic block 𝑏𝑚 is represented by its ordered unit sequence 𝐔𝑚 = [𝐮𝑚,1 , 𝐮𝑚,2 , … , 𝐮𝑚,|𝑏𝑚 | ], where the units are sorted by their temporal positions within the block. The 𝑘-th expert applies a block encoder 𝑓𝑘 (⋅) to this ordered sequence and produces an expert specific block representation: (𝑘) 𝐲𝑚 = Expert 𝑘 (𝑏𝑚 ; 𝐕𝑚 ) = 𝑓𝑘 (𝐔𝑚 ) + 𝐔𝑘 𝐕𝑚 ,
(20)
where 𝑓𝑘 (⋅) may be instantiated as a lightweight Transformer encoder or another sequence encoder, 𝐔𝑘 is a learnable projection matrix, and 𝐕𝑚 is the semantic bias vector associated with block 𝑚.
3.4.2. Routing Mechanism The router computes expert assignment scores from the routing embedding of each semantic block. Specifically, the pre softmax routing score is 𝐬̃ 𝑚 = MLP𝑟 (̃𝐞𝑚 ), where 𝐬̃ 𝑚 = (𝑅) [𝑠̃(1) 𝑚 , … , 𝑠̃𝑚 ] denotes the score vector over all experts. The normalized routing probability of expert 𝑘 is then given by: 𝑠(𝑘) 𝑚 = ∑ Page 6 of 13
exp(𝑠̃(𝑘) 𝑚 ) (𝑘′ ) 𝑅 𝑘′ =1 exp(𝑠̃𝑚 )
.
(21)
Instead of using a fixed Top-𝐾 routing rule, we adopt Top-𝑃 routing so that the number of active experts adapts to the concentration of the routing distribution. When the distribution is concentrated, fewer experts are selected; when it is more diffuse, more experts are retained. Specifically, the experts are first sorted in descending order according to 𝑅 , and we select the smallest expert set such that {𝑠(𝑘) 𝑚 } 𝑚 ∑ 𝑘=1(𝑘) 𝑠 ≥ 𝑃 , where 𝑃 ∈ (0, 1]. 𝑘∈𝑚 𝑚 Based on the selected set, the sparsified routing weight is defined as: ⎧ 𝑠(𝑘) 𝑚 , ⎪ ∑ (𝑘′ ) 𝑠̂(𝑘) = ⎨ 𝑘′ ∈𝑚 𝑠𝑚 𝑚 ⎪ ⎩0,
𝑘 ∈ 𝑚 ,
(22)
otherwise,
where 𝑠̂(𝑘) 𝑚 denotes the normalized responsibility of expert 𝑘 for semantic block 𝑚 after Top-𝑃 selection. Finally, the outputs of the selected experts are aggregated to obtain the block level representation: 𝐲𝑚 =
𝑅 ∑
(𝑘) 𝑠̂(𝑘) 𝑚 𝐲𝑚 .
(23)
𝑘=1
After processing all semantic blocks, the final forecast( 𝐾𝑏 ) ing result is generated by 𝐘̂ = Readout {𝐲𝑚 }𝑚=1 , where Readout(⋅) denotes the regression head for final prediction.
3.5. Computational Complexity Analysis The overall complexity of SCPaT is governed by three main components. For an input with 𝐶 variables and sequence length 𝐿, let 𝑁𝑐 denote the number of semantic units per variable, and let 𝑑ℎ be the hidden dimension. The Semantic Vector Encoder performs multi-scale convolutions with complexity (𝐶 ⋅ 𝐿 ⋅ 𝑑ℎ ). The Transfer Entropy Graph Constructor computes pairwise dependency surrogates among semantic units, which scales as (𝐶 2 ⋅ 𝑁𝑐2 ⋅ 𝑑ℎ ). To manage the cost of subsequent operations, we apply static sparsification (Eq. (13)) to retain only the top𝐾𝑔 edges per node, reducing the complexity of the routing and aggregation steps from (𝐶 2 𝑁𝑐2 ) to (𝐾𝑔 𝐶𝑁𝑐 ). The routing module operates on 𝐾𝑏 semantic blocks with 𝑅 experts, contributing (𝐾𝑏 ⋅ 𝑅 ⋅ 𝑑ℎ2 ). In our typical settings (𝐾𝑔 = 𝛼𝐶𝑁𝑐 with 𝛼 = 0.1), the TE computation adds approximately 15%.
4. Experiment 4.1. Experimental Setup 4.1.1. Datasets We conducted experiments on 12 widely used benchmark datasets. For long-term forecasting, we considered four ETT datasets, ETTh1, ETTh2, ETTm1, and ETTm2 (Zhou et al., 2021), which record electricity transformer temperature and load at hourly and minute-level resolutions. We also included Weather (Wu et al., 2021), which contains 21 meteorological variables, Traffic, which records road
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning Table 1 Summary of the 12 datasets used in our forecasting experiments, including the prediction horizons, data dimensionality, sampling frequency, and total number of time points. Task Type
Dataset
Prediction Horizons
Time Point
Dimension
Frequency
Long-term Forecasting
ETTh1 ETTh2 ETTm1 ETTm2 Weather Traffic Electricity Solar
{96,192,336,720} {96,192,336,720} {96,192,336,720} {96,192,336,720} {96,192,336,720} {96,192,336,720} {96,192,336,720} {96,192,336,720}
17420 17420 69680 69680 52603 17451 26211 52179
7 7 7 7 21 862 321 137
Hourly Hourly 15 min 15 min 10 min Hourly Hourly 10 min
Short-term Forecasting
PEMS03 PEMS04 PEMS07 PEMS08
{12,24,48} {12,24,48} {12,24,48} {12,24,48}
26208 16992 28224 17856
358 307 883 170
5 min 5 min 5 min 5 min
occupancy rates on California freeways, Electricity, which tracks hourly electricity consumption for 321 households, and Solar, which contains solar power production records from photovoltaic plants. For short-term forecasting, we adopted four standard benchmarks from the PEMS collection, namely PEMS03, PEMS04, PEMS07, and PEMS08 (Zheng et al., 2020). These datasets consist of traffic flow measurements collected by road sensors. Table 1 provides detailed statistics for all datasets.
4.1.2. Baselines. We compare the proposed method with nine representative baselines covering the main patch modeling strategies introduced above. These baselines include five Transformerbased models, PatchTST (Nie et al., 2023), iTransformer (Liu et al., 2024), DUET (Qiu et al., 2025), MSPatch (Cao et al., 2025), and Crossformer (Zhang and Yan, 2023b); one CNN-based model, TimesNet (Wu et al., 2022); one GNN-based model, MSGNet (Cai et al., 2024); one MLP-based model, HDMixer (Huang et al., 2024); and LSTM(Hochreiter and Schmidhuber, 1997). This selection allows us to evaluate the proposed method across different patch partitioning strategies and backbone architectures. 4.1.3. Implementation Details. All baseline models and the proposed SCPaT are implemented in PyTorch 2.1.2 and evaluated under a unified experimental protocol on a single NVIDIA RTX 4090D GPU with 24 GB memory. For fair comparison, we retrained all baselines on our dataset splits using their optimal hyperparameters as reported in the original papers, and performed grid search when unavailable. We follow the standard long-term forecasting setting and evaluate predictive performance at four representative forecasting horizons, 𝐻 ∈ {96, 192, 336, 720}. For SCPaT, we perform a grid search (Pedregosa et al., 2011) over the semantic bias parameters to select the best configuration. Mean squared error (MSE) and mean absolute error (MAE) are reported as the evaluation metrics (Hyndman and Koehler, 2006). Page 7 of 13
4.2. Main Results 4.2.1. Long-term Forecasting. Table 2 reports the long-term forecasting results of all compared methods. SCPaT achieves the best or second-best performance on the majority of datasets and forecasting horizons, demonstrating strong robustness across diverse long-term forecasting scenarios. Compared with representative methods based on fixed partitioning, multi-scale partitioning, and extendable partitioning, namely PatchTST, TimesNet, and HDMixer, SCPaT consistently yields lower prediction errors. These results support our central claim that semantic structured partitioning provides a more effective way to model complex temporal dynamics by preserving semantic consistency and capturing higher-order dependencies among heterogeneous temporal patterns. On the four ETT benchmarks, SCPaT reduces the average MSE by 4.6%, 7.1%, and 4.1% relative to PatchTST, TimesNet, and HDMixer, respectively. Moreover, compared with Crossformer, SCPaT also achieves consistently lower prediction errors across the long-term forecasting benchmarks.
4.2.2. Short-term Forecasting. Table 3 presents the short-term forecasting results of all compared methods. SCPaT achieves the best or secondbest performance on most datasets and forecasting horizons, indicating that the proposed framework generalizes well beyond the long-term forecasting setting. Although semantic structured partitioning is primarily introduced to address semantic inconsistency in long-horizon prediction, it also appears beneficial for short-term forecasting, where accurate modeling of local trend, periodic, and abrupt patterns remains important. These results suggest that organizing local segments into semantically meaningful units and emphasizing informative dependencies can also improve shortterm prediction. Therefore, SCPaT consistently achieves lower prediction errors across the four PEMS benchmarks and attains the best overall performance.
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning Table 2 Multivariate long-term forecasting results over four prediction horizons, 𝐻 ∈ {96, 192, 336, 720}, with the input length fixed at 𝐿 = 96. The best and second-best results are marked in bold red and blue underline, respectively. Models
SCPaT
MSPatch
DUET
iTransformer
MSGNet
HDMixer
PatchTST
TimesNet
CrossFormer
LSTM
(Ours)
(2025)
(2025)
(2024)
(2024)
(2024)
(2023)
(2023)
(2023)
(1997)
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
96
0.370
0.392
0.372
0.395
0.384
0.402
0.386
0.405
0.390
0.411
0.386
0.401
0.414
0.419
0.384
0.402
0.423
0.448
1.044
0.773
192
0.418
0.422
0.428
0.426
0.437
0.429
0.441
0.436
0.442
0.442
0.441
0.430
0.460
0.445
0.446
0.439
0.471
0.474
1.217
0.832
336
0.452
0.440
0.484
0.452
0.477
0.453
0.465
0.445
0.487
0.458
0.458
0.443
0.501
0.466
0.491
0.469
0.570
0.546
1.259
0.841
720
0.449
0.458
0.480
0.473
0.486
0.475
0.503
0.491
0.494
0.488
0.512
0.484
0.500
0.488
0.521
0.500
0.653
0.621
1.271
0.838
96
0.288
0.338
0.292
0.344
0.298
0.351
0.297
0.349
0.328
0.371
0.293
0.338
0.302
0.348
0.340
0.374
0.745
0.584
2.522
1.278
192
0.373
0.396
0.383
0.402
0.374
0.394
0.380
0.400
0.402
0.414
0.379
0.396
0.388
0.400
0.402
0.414
0.877
0.656
3.312
1.384
336
0.408
0.427
0.417
0.431
0.417
0.431
0.428
0.432
0.435
0.443
0.426
0.444
0.426
0.433
0.452
0.452
1.043
0.731
3.291
1.388
720
0.430
0.444
0.422
0.446
0.427
0.442
0.430
0.445
0.441
0.444
0.429
0.447
0.431
0.446
0.462
0.468
1.104
0.763
3.257
1.357
96
0.320
0.360
0.324
0.363
0.329
0.361
0.334
0.368
0.323
0.366
0.340
0.368
0.329
0.367
0.338
0.375
0.404
0.426
0.863
0.664
192
0.362
0.383
0.367
0.385
0.364
0.385
0.377
0.391
0.376
0.397
0.382
0.386
0.367
0.385
0.374
0.387
0.450
0.451
1.113
0.776
336
0.389
0.402
0.390
0.404
0.396
0.408
0.426
0.420
0.417
0.422
0.403
0.411
0.399
0.410
0.410
0.411
0.532
0.515
1.267
0.832
720
0.456
0.436
0.454
0.437
0.469
0.437
0.491
0.459
0.481
0.458
0.473
0.439
0.454
0.439
0.478
0.450
0.666
0.589
1.324
0.858
96
0.173
0.258
0.175
0.260
0.179
0.262
0.180
0.264
0.181
0.262
0.183
0.266
0.181
0.259
0.187
0.267
0.287
0.366
2.041
1.073
192
0.238
0.300
0.239
0.302
0.240
0.300
0.250
0.309
0.247
0.307
0.247
0.307
0.241
0.302
0.249
0.309
0.414
0.492
2.249
1.112
336
0.297
0.339
0.297
0.340
0.302
0.341
0.311
0.348
0.312
0.346
0.305
0.345
0.305
0.343
0.321
0.351
0.597
0.543
2.568
1.238
720
0.394
0.394
0.396
0.397
0.399
0.397
0.412
0.407
0.414
0.403
0.406
0.400
0.402
0.406
0.408
0.403
1.730
1.042
2.720
1.287
96
0.163
0.208
0.165
0.209
0.167
0.209
0.174
0.214
0.169
0.212
0.174
0.223
0.177
0.218
0.172
0.220
0.171
0.230
0.369
0.406
192
0.209
0.250
0.211
0.252
0.212
0.254
0.221
0.254
0.218
0.255
0.225
0.264
0.225
0.259
0.219
0.261
0.226
0.277
0.416
0.435
336
0.266
0.292
0.268
0.294
0.269
0.297
0.278
0.296
0.272
0.299
0.277
0.301
0.278
0.297
0.280
0.306
0.272
0.335
0.455
0.454
720
0.345
0.349
0.342
0.345
0.348
0.347
0.358
0.349
0.350
0.348
0.349
0.347
0.354
0.348
0.365
0.359
0.398
0.418
0.535
0.520
96
0.393
0.247
0.460
0.295
0.395
0.256
0.395
0.268
0.605
0.344
0.529
0.353
0.544
0.359
0.593
0.321
0.522
0.290
0.843
0.453
192
0.425
0.259
0.466
0.300
0.420
0.266
0.417
0.276
0.613
0.359
0.535
0.361
0.540
0.354
0.617
0.336
0.530
0.293
0.847
0.453
336
0.454
0.270
0.484
0.306
0.458
0.272
0.461
0.283
0.642
0.376
0.541
0.361
0.551
0.358
0.629
0.336
0.558
0.305
0.853
0.455
720
0.489
0.291
0.510
0.323
0.499
0.288
0.497
0.302
0.702
0.401
0.591
0.389
0.586
0.375
0.640
0.350
0.589
0.328
1.500
0.805
96
0.139
0.233
0.158
0.257
0.148
0.236
0.149
0.240
0.165
0.274
0.163
0.275
0.195
0.285
0.168
0.272
0.219
0.314
0.375
0.437
192
0.155
0.248
0.171
0.268
0.164
0.249
0.162
0.253
0.184
0.292
0.186
0.281
0.195
0.285
0.184
0.289
0.231
0.322
0.442
0.473
336
0.168
0.263
0.184
0.283
0.178
0.265
0.178
0.269
0.195
0.302
0.199
0.295
0.215
0.305
0.198
0.300
0.246
0.337
0.439
0.473
720
0.200
0.293
0.223
0.308
0.206
0.303
0.225
0.317
0.231
0.332
0.231
0.321
0.256
0.337
0.220
0.320
0.280
0.363
0.980
0.814
96
0.202
0.234
0.204
0.237
0.205
0.217
0.203
0.237
0.208
0.243
0.207
0.244
0.234
0.286
0.250
0.292
0.310
0.331
0.663
0.697
192
0.228
0.258
0.231
0.260
0.231
0.239
0.233
0.261
0.258
0.281
0.245
0.273
0.267
0.310
0.296
0.318
0.734
0.725
0.686
0.743
336
0.239
0.270
0.240
0.273
0.243
0.242
0.248
0.273
0.293
0.311
0.263
0.285
0.290
0.315
0.319
0.330
0.750
0.735
0.713
0.785
720
0.250
0.278
0.250
0.275
0.255
0.256
0.260
0.280
0.290
0.315
0.288
0.299
0.289
0.317
0.338
0.337
0.769
0.765
0.775
0.812
1st Count
28
24
5
1
0
7
1
0
0
0
0
1
1
0
0
0
0
0
0
0
Solar
Electricity
Traffic
Weather
ETTm2
ETTm1
ETTh2
ETTh1
Metric
0.40
0.35
0.35
We analyze the routing behavior of the Importance Aware Router by averaging the expert assignment probabilities over all semantic blocks extracted from the test set, as reported in Table 4. Expert 1 captures trend-dominated blocks, Expert 2 specializes in periodic patterns, and Expert 3 handles high-frequency fluctuations. The results reveal a clear dataset-dependent allocation pattern. For ETTh1 and ETTm1, the routing weights are more evenly distributed across the three experts (0.62/0.21/0.17 and 0.51/0.25/0.24, respectively), suggesting that these datasets require complementary modeling of multiple dependency patterns. In contrast, for Weather, the routing probability is concentrated on Expert 1 (0.81), while Expert 2 and Expert 3 receive much smaller weights. This difference indicates that the router adapts its allocation strategy to dataset characteristics, providing empirical support for the effectiveness of the proposed routing mechanism.
0.30
Page 8 of 13
0.25
ETTm1 ETTh2 ETTh1 Weather
0.20 0.15
0.0 0.1
0.3
0.5
0.7
0.9 1.0
MSE
0.40
MSE
4.3. Model Analysis 4.3.1. Routing Analysis.
0.30 0.25
ETTm1 ETTh2 ETTh1 Weather
0.20 0.15
0.0
0.3
Top-p
0.5
0.7
Figure 3: Sensitivity analysis of the hyperparameters 𝛼 and Top-P on ETTm1, ETTh1, ETTh2, and Weather, with both the input length and prediction horizon fixed at 96.
4.3.2. Hyperparameter Sensitivity We further analyze the sensitivity of SCPaT to the static sparsification ratio 𝛼 and the routing threshold Top-P, as shown in Figure 3. SCPaT remains stable across a broad range of hyperparameter values. For 𝛼, the optimal value varies across datasets: ETTh1 and ETTh2 perform best at 𝛼 = 0.1, ETTm1 at 𝛼 = 0.3, and Weather at 𝛼 = 0.1. This suggests that datasets with stronger local fluctuations or
Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured Partitioning Table 3 Multivariate short-term forecasting results over three prediction horizons, 𝐻 ∈ {12, 24, 48}, with the input length fixed at 𝐿 = 96. The best and second-best results are marked in bold red and blue underline, respectively. Models
PEMS03
PEMS04
PEMS07
PEMS08
MSPatch
DUET
iTransformer
MSGNet
HDMixer
TimesNet
PatchTST
(Ours)
(2025)
(2025)
(2024)
(2024)
(2024)
(2023)
(2023)
CrossFormer (2023)
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
12
0.066
0.169
0.074
0.179
0.071
0.176
0.071
0.174
0.083
0.197
0.076
0.184
0.085
0.192
0.099
0.216
0.090
0.203
24
0.086
0.195
0.097
0.200
0.089
0.197
0.093
0.201
0.097
0.217
0.095
0.210
0.118
0.223
0.142
0.259
0.121
0.240
48
0.122
0.235
0.131
0.244
0.118
0.229
0.125
0.236
0.135
0.241
0.122
0.245
0.155
0.260
0.211
0.319
0.202
0.317
12
0.073
0.176
0.075
0.185
0.076
0.179
0.078
0.183
0.082
0.187
0.084
0.188
0.087
0.195
0.105
0.224
0.098
0.218
24
0.091
0.199
0.093
0.201
0.097
0.203
0.095
0.205
0.128
0.241
0.097
0.210
0.103
0.215
0.153
0.257
0.131
0.256
48
0.124
0.237
0.134
0.244
0.119
0.239
0.126
0.240
0.192
0.315
0.134
0.253
0.136
0.250
0.229
0.339
0.205
0.326
12
0.058
0.153
0.066
0.162
0.059
0.166
0.067
0.165
0.087
0.191
0.074
0.182
0.082
0.181
0.095
0.207
0.094
0.200
24
0.074
0.174
0.083
0.189
0.079
0.183
0.088
0.190
0.135
0.241
0.089
0.197
0.101
0.204
0.150
0.262
0.139
0.247
48
0.102
0.207
0.112
0.217
0.106
0.211
0.110
0.215
0.297
0.351
0.124
0.217
0.134
0.238
0.253
0.340
0.311
0.369
12
0.070
0.173
0.079
0.175
0.077
0.177
0.079
0.182
0.159
0.208
0.098
0.193
0.112
0.212
0.168
0.232
0.165
0.214
24
0.085
0.187
0.094
0.211
0.098
0.201
0.115
0.219
0.210
0.251
0.108
0.223
0.141
0.238
0.224
0.281
0.215
0.260
48
0.112
0.220
0.150
0.232
0.139
0.227
0.186
0.235
0.311
0.358
0.167
0.247
0.198
0.283
0.321
0.354
0.315
0.335
9
11
0
0
3
1
0
0
0
0
0
0
0
0
0
0
0
0
st
1 Count