1
Joint Optimization for Federated Learning and Transmission over Unreliable Wireless Networks with Heterogeneous Data
arXiv:2609.14246v1 [cs.DC] 13 Sep 2026
Changheng Wang, Student Member, IEEE, Xianchao Zhang, Member, IEEE, Zhiqing Wei, Member, IEEE, Lingzhu Zhao, Zhongming Yang, and Zhiyong Feng, Senior Member, IEEE
Abstract—In wireless federated learning (FL), data heterogeneity and multiple local updates induce client drift, degrading model convergence. It is further affected by unreliable wireless links, as transmission errors may invalidate model updates. To address these challenges, we propose a federated random walk averaging (FedRW) framework, which is a variant of federated averaging (FedAvg) that mitigates data heterogeneity by updating models along random walk (RW) paths and aggregating them at the server. Model parameters are transmitted in packets with retransmission support to improve training quality by mitigating wireless errors along RW paths. Meanwhile, wireless transmission delays hinder the exploration of FedRW. To this end, we formulate a joint optimization problem that integrates learning, RW path selection, and transmission parameter tuning, aiming to minimize the training loss under delay constraints. By deriving an upper bound on the expected convergence of FedRW over unreliable wireless networks, we reduce the problem to a general form agnostic to task type and model architecture. A distributed solution is then proposed, in which the server or clients optimize packet size and maximum number of retransmissions locally, and efficiently select reliable and expandable next-hop nodes via a resilience-aware beam search with dynamic pruning. Simulation results show that FedRW achieves 2.26%–9% higher accuracy than state-of-the-art baselines under high data heterogeneity. Furthermore, the jointly optimized FedRW yields at least 2.78% higher accuracy and faster convergence compared to baselines. Index Terms—Federated learning, random walk, wireless networks, transmission optimization, convergence analysis.
I. I NTRODUCTION A. Motivation
F
EDERATED learning (FL) is a distributed training framework that balances computational and communication overhead by performing multiple local training and exchanging model parameters instead of raw data. It supports applications in resource-constrained environments such as unmanned aerial vehicle (UAV) networks, industrial Internet of Things (IIoT),
Changheng Wang, Zhiqing Wei, and Zhiyong Feng are with the Key Laboratory of Universal Wireless Communications, Ministry of Education, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China (e-mail: ch [email protected]; [email protected]; [email protected]). Xianchao Zhang is with the Provincial Key Laboratory of Multimodal Perceiving and Intelligent Systems, Jiaxing University, Jiaxing 314001, China (e-mail: [email protected]). Lingzhu Zhao is with the School of Electronics and Information, Northwestern Polytechnical University, Xi’an 710000, China (email: [email protected]). Zhongming Yang is with the School of Information Science and Engineering, Southeast University, Nanjing 210096, China (email: [email protected]).
and emergency response networks, encompassing key tasks such as object detection and recognition, equipment monitoring, task allocation and path planning [1]. A key challenge in FL is data heterogeneity, as client data are typically non-independent and identically distributed (Non-IID) due to differences in location, usage, and device configurations, leading to client drift [2]. While multiple local updates reduce communication, they can amplify divergence [3]. In wireless FL, this problem becomes more severe. Since model parameters are transmitted over wireless channels, the instability of wireless links (due to fading, interference, and noise) can cause bit errors, rendering some of model unusable. This weakens the quality of local updates and global aggregation. As a result, data heterogeneity and the unreliability of wireless transmission constitute the two core challenges that significantly impact FL convergence. In response to Non-IID data distributions, random walk (RW) learning gradually traverses clients via communication links, reducing client drift through distributed updates [4]. However, its sequential nature limits efficiency. Inspired by [5], we propose a parallel federated random walk averaging (FedRW) framework. Multiple chains run simultaneously, each traversing clients independently. Upon completing local RW updatas, chains send updated models to the server for global aggregation, without relying on complex aggregation mechanisms. Although this approach introduces additional communication overhead compared to traditional FL, the cost is justified by access to richer and potentially more representative data samples. In essence, it extends the core idea of FL by trading increased computation for reduced communication complexity. In unreliable wireless networks, parallel RW methods face greater challenges than traditional FL due to their reliance on hop-by-hop model transmission. A single transmission error may cause the entire chain’s update to be discarded, leading to wasted resources and slower convergence. Existing mainstream approaches such as [6], [7] often transmit the entire model as a single packet without supporting retransmissions, which can limit training efficiency in unreliable transmission. To address this, we divide model parameters into multiple packets and introduce a retransmission mechanism. If a packet is in error, only that packet is retransmitted, reducing the risk of updated model loss and lowering communication overhead. To accommodate varying wireless conditions, system error tolerance, and model sizes, transmission parameters such as packet size and maximum retransmissions should be
2
dynamically adjusted. Moreover, since RW path delay and reliability directly affect training efficiency, jointly optimizing path selection and transmission configuration is essential for improving performance in wireless FL settings. The optimization problem is an integer nonlinear program with high complexity. A centralized solution, where the server handles scheduling, becomes inefficient and impractical for large-scale systems. Therefore, we decompose the problem for local resolution. Each client makes autonomous decisions based on its own state and local link information, enabling a scalable and efficient distributed optimization approach. B. Related Work We begin by reviewing two key challenges that affect FL convergence: data heterogeneity and deployment over wireless networks, both central to this work. A systematic summary and comparison of the related work is provided in Table I. To address data heterogeneity, prior studies have proposed various excellent strategies. Regularization and constraintbased methods [3], [7], [8], [9] aim to reduce client drift by modifying the local objective, supported by strong theoretical convergence guarantees. However, improper tuning may lead to overfitting or underfitting, and constraint-based variants can incur extra computation. Several studies [10], [11], [12] propose clustering clients based on local features or model update differences, training specialized models per cluster. Clustered FL demonstrates potential in multi-modal tasks by achieving smaller theoretical generalization error. However, they rely on server-side clustering using limited information, which may yield unstable similarity measures, and suffer from cold-start issues for new clients [13]. Meta-learning methods [14], [15], [16] aim to build adaptable global models using few-shot local updates, mitigating cold-start and heterogeneity. However, their reliance on Hessian computations and nested structures increases complexity. Semi-federated learning (SFL) [17] adjusts the learning structure to better handle non-IID data, but requires more fine-tuning to effectively balance client-specific updates and global model adaptation. Datacentric approaches [18], [19] attempt to align distributions by sharing or synthesizing auxiliary data. While effective, they compromise privacy and introduce additional bias and overhead [20]. RW learning offers an alternative by structuring cross-client update paths, exposing the training process to diverse data distributions without sharing raw data [4], [21], [22], [23]. This helps reduce convergence bias with moderate communication cost. To improve training efficiency and fault tolerance, recent work explores parallel RW [5], [24], where multiple chains aggregate updates periodically or at intersection points to accelerate convergence. However, such decentralized aggregation is inherently complex and lacks global coordination, leading to redundant updates and interchain interference that compromise convergence stability. In wireless FL, some excellent studies [37], [38], [39], [40] have addressed key challenges such as client scheduling and efficient resource allocation, including bandwidth and energy optimization, over reliable wireless networks. However, practical deployments often suffer from unreliable wireless links, leading to model transmission errors [41], which can
TABLE I T ECHNICAL C OMPARISON OF R ELATED M ETHODOLOGIES . Methodology
Core Mechanism
Limitation / Gap
Data Heterogeneity Solutions Regularization [3], [7]–[9] Clustered FL [10]–[13] Meta-learning [14]–[16] SFL [17] Data-centric [18]–[20] RW Learning [4], [5], [21]–[24]
Local objective constraint Similarity-based grouping Few-shot adaptability Centralized-Fed hybrid Distribution alignment Sequential distribution traversal
Hyperparameter sensitivity Cold-start & high overhead Hessian-based complexity Paradigm-specific tuning Privacy & bias concerns Ideal link assumption
Wireless Deployment Optimization Physical Layer [25], [26] Resource optimization [6], [7], [27]–[31] Reliability Control [32]–[36]
Signal quality enhancement Communication and computing resource Retransmission & packet sizing
Hardware reliance Coarse-grained update
Proposed FedRW
Joint FL and transmission optimization
Bridging RW topology and wireless reliability
Decoupled from FL theory
disrupt the training process. Given limited wireless resources and client capabilities, such errors are frequently unavoidable. To address this, Ni et al. [25] exploited over-the-air computation (AirComp) and reconfigurable intelligent surface (RIS) technologies to enhance the signal transmission quality at the physical layer, effectively minimizing errors in model aggregation. They further extended this approach to a multi-RISassisted FL system by jointly optimizing the grouping, phase shift configurations, and transmission power to collaboratively minimize the training loss [26]. In contrast, another line of research focuses on designing robust resource allocation and intelligent retransmission mechanisms at the algorithmic and network protocol levels, to actively tolerate and address transmission errors. Chen et al. [6], [27] jointly optimized learning, resource allocation, and user selection under packet errors to reduce convergence time and training loss. Zheng et al. [7] enhanced convergence by optimizing power control and client selection. Liu et al. [28] proposed a joint communication, sensing, and computing framework to improve data processing in UAV-based FL. Salari et al. [29] examined the trade-off between coding rate, convergence time, and accuracy, while Khan et al. [30] aimed to mitigate model degradation by reducing packet errors and delays. Ren et al. [31] analyzed the joint impact of pruning and transmission errors, providing a closed form solution for optimizing pruning and bandwidth allocation. However, these methods treat each model update as a single packet, which is discarded entirely if errors occur. This severely degrades convergence performance, particularly in FedRW. Introducing fine grained packet segmentation and retransmission mechanisms can mitigate this issue. For example, Song et al. [32] allowed retransmissions until successful decoding and optimized client participation to minimize average convergence time. Motamedi et al. [33] designed a twophase scheme, where retransmissions are triggered based on the correlation between local and global gradients. In addition, several studies have explored adaptive packet sizing strategies. Razi et al. [34] adjusted packet size based on channel error rates and communication load to minimize delay and improve
3
energy efficiency. Huang et al. [35] optimized packet sizes according to system state to minimize long-term communication and control cost. Zhao et al. [36] jointly optimized packet size and transmission scheduling to reduce collision probability and delay. Despite these advances, none of these works establish an explicit theoretical link between transmission parameters (e.g., packet size and maximum number of retransmissions) and FL convergence performance, especially in multi-hop structures with spatially correlated wireless links. C. Contribution and Organization This paper proposes a new FL framework to resist data heterogeneity, using RW updates instead of local iterative updates. And jointly consider learning performance, RW path and wireless transmission parameters, enabling the proposed method to operate effectively over unreliable wireless networks. The main contributions are summarized as follows. • Wireless FedRW framework for data heterogeneity: We propose a federated averaging scheme based on parallel RWs, where local models are forwarded along RW chains and updated at each visited client. The final model from each chain is aggregated at the server. Each model update is segmented into multiple packets with retransmission support. Since convergence depends on the quality of RW paths, effective path exploration is crucial. • Joint learning and transmission optimization: Over unreliable wireless networks, transmission parameters affect exploration efficiency and transmission reliability. We formulate a joint optimization problem of RW path selection, packet size, and maximum number of retransmissions to minimize training loss under delay constraints. • Convergence guarantee and general loss optimization: We derive the expected convergence bound of FedRW under packet errors using the Polyak-Łojasiewicz (PŁ) condition, a widely studied assumption in non-convex optimization. Our analysis establishes an explicit relationship among RW paths, transmission parameters, and learning performance. Based on this, we reformulate the loss minimization into a general optimization problem independent of task type or model structure. • Distributed path and transmission coordination: We develop a distributed solution where the server and each client independently optimize local transmission parameters, and propose a dynamic pruning beam search strategy to efficiently select reliable and expandable next-hop. We evaluate FedRW on MNIST, Fashion-MNIST, CIFAR10, and CIFAR-100. Under high data heterogeneity, FedRW improves accuracy over FedAvg, Fedprox and FedNova by 2.26%–9%. Additional experiments over unreliable wireless networks demonstrate that jointly optimizing RW paths and transmission parameters yields at least 2.78% accuracy gain and accelerates convergence. We further verified that optimized FedRW is always optimal across diverse system and transmission settings. The rest of this paper is organized as follows. Section II introduces the system model. Section III presents FedRW and the joint optimization problem over unreliable wireless
networks. Section IV analyzes convergence and reformulates the problem. Section V details the distributed solution. Section VI reports experimental results, and Section VII concludes. II. S YSTEM M ODEL A. Learning Objective Consider a wireless network consisting of a set of clients U = {1, 2, . . . , U } that participate in a distributed learning task, along with a central server. Clients may share their local models with each other or with the server. The server is responsible for collecting local models and coordinating the aggregation of a consensus global model. Suppose that each client i ∈ U holds a local dataset of size b, denoted by Di = ξi,θ := (xi,θ , yi,θ ) ∈ Rd × R for θ ∈ [b] . The goal ofP each client i is to minimize the empirical risk fi (wi ) = b 1 θ=1 f (wi ; ξi,θ ) over its local dataset, where wi is the local b model of client i. The global learning objective is [42] U
min F (w) :=
w∈W
1 X fi (wi ) , U i=1
(1)
where w ∈ W ⊆ Rd is the global model aggregated by the server, and W is a closed and bounded feasible set. The optimal global model is defined as w∗ ∈ arg minw∈W F (w). B. Network and Transmission Model The wireless network adopts a device-to-device (D2D) communication architecture. Although the server performs the logical role of aggregation, all nodes (including the server and clients1 ) are treated equally in terms of link modeling and transmission parameter optimization. Distributed collaboration is achieved through direct inter-node communication, without reliance on centralized coordination. We model the D2D network as a directed graph G = (V, E), where V = {1, 2, . . . , U, U + 1} represents the set of U clients and one server. The edge set E contains directed links, where a directed edge (i, j) ∈ E indicates that node i can successfully transmit to node j, but not necessarily vice versa, thus capturing potential asymmetries in wireless communication. For each node i ∈ V, its out-neighbor set Ni is defined as the set of nodes to which i can directly transmit information. Each node can independently adjust its transmission parameters, such as packet size and maximum number of retransmissions, based on local information (e.g., link quality). This autonomy enhances communication efficiency and improves overall system robustness under unreliable wireless conditions. To mitigate mutual interference among the M parallel chains, the system adopts an orthogonal frequency allocation strategy where each chain operates on a dedicated subchannel. Intra-chain collisions are avoided through the sequential nature of model updates within each chain, while inter-chain interference is eliminated through frequency domain isolation. The rate of node i transmitting its FL model parameters to node j is given by [32] P |hi,j |2 ri,j = B · Ehi,j log2 1 + , (2) BN0 1 For clarity, we refer to both the server and clients as nodes.
4
where hi,j = oi,j d−2 i,j is the channel gain, di,j is the distance from node i to j, and oi,j ∼ CN (0, 1) is the Rayleigh fading parameter with E[|oi,j |2 ] = 1. P is the transmission power, B is the bandwidth of the allocated orthogonal subchannel, and N0 is the noise power spectral density. To enhance reliable model transmission, we divide the model wi (or w), of total size m0 bits, into multiple packets. Specifically, wi is segmented into βi,j = ⌈ ζmi,j0 ⌉ packets for transmission from node i to node j, where each packet carries a payload of ζi,j bits and incurs a fixed overhead of e bits. The resulting packet size is ni,j = ζi,j + e, and the transmission delay per packet is ni,j δi,j = . (3) ri,j Given the unreliability of wireless links, transmitted packets may suffer from bit errors. Assuming a bit error rate (BER) of ϵ, the corresponding packet error rate (PER) can be expressed as [34] ϱi,j = 1 − (1 − ϵ)ni,j . (4) To improve transmission reliability, we adopt a packet retransmission scheme. When a packet fails, only that packet is retransmitted, up to a maximum of Ri,j attempts. The expected number of transmissions per packet is [34] Ri,j +1
E [Ri,j ] =
X
R
i,j r ·ϱr−1 i,j (1 − ϱi,j )+(Ri,j + 1)·ϱi,j
+1
. (5)
r=1
Accordingly, the expected delay to transmit the model wi over the wireless link from node i to j is given by τi,j = βi,j δi,j · E [Ri,j ] .
(6)
This highlights the trade-off between packet size and maximum number of retransmissions. Increasing ni,j reduces the number of packets βi,j , which helps decrease τi,j , but also raises ϱi,j . To compensate for the higher PER, a larger Ri,j is required, which introduces additional retransmission delays. Therefore, selecting appropriate values for ni,j and Ri,j is critical to balancing transmission delay and reliability. C. Data Heterogeneity Client data in FL is often statistically heterogeneous, leading to inconsistencies between local and global objectives. These discrepancies can negatively affect optimization, causing the global model to drift and reducing its generalization performance. To quantify this bias, we adopt the dissimilarity metric proposed in [4], [8], which measures the gap between local and global objectives. Definition 1. A local loss function fi is said to be (α, σ)locally dissimilar at wi if 2
∥∇fi (wi )∥ ≤ α2 + σ 2 ∥∇F (w)∥2 ,
(7)
for α ≥ 0 and σ ≥ 1. The case α = 0, σ = 1 corresponds to the IID setting. The norm ∥ · ∥ denotes the Euclidean norm, and ∇fi (wi ) is the gradient at client i.
Aggregation
Server w
w
w 2,3
w 1,3
w
w t +1 =
1 M t w m ,Q M m =1
w 3,3
Local Update
Client w 2,1
w 3,2
ˆ f (w t )) w tm,q = Π (w tm,q −1 − im ,q m , q −1
w 3,1
w 1,1
Download model
w 2,2
Random walk update
w 1,2
Upload model
Fig. 1. Illustration of the FedRW structure over a reliable wireless network with M = 3 RW chains and Q = 3 clients per chain.
III. P ROPOSED F ED RW AND P ROBLEM F ORMULATION A. Federated Random Walk Averaging To attain favorable training outcomes in Non-IID settings, we propose FedRW, a distributed learning algorithm designed to mitigate the impact of data heterogeneity. Unlike FedAvg, which suffers from a communication bottleneck at the server [41], FedRW replaces local updates with a random walk update scheme. This approach shifts a portion of the communication burden from server-client links to the D2D layer. Although the number of transmission hops increases, FedRW accelerates convergence by distilling and aggregating heterogeneous data features along the RW chains. Consequently, FedRW achieves higher accuracy and lower loss than FedAvg under the same total system communication overhead, as empirically validated in Fig. 2. The training process of FedRW can be formulated as the following optimization problem. M
1 X fm (wm ; Dm ) wm ,m∈M M m=1 min s.t.
wi = w, i ∈ U,
(8) (8a)
where M = {1, 2, . . . , M } is the set of RW chains, Dm is the union of local datasets along the m-th chain, and fm (wm ; Dm ) denotes the loss of m-th RW chain. Constraint (8a) ensures that all clients share a consistent model upon convergence. To solve (8), the server sends the global model w at the beginning of each round to the initial client of each selected RW chain. After each chain completes Q steps, the server collects the updated local models from the final clients and aggregates them to update the global model. The structure of FedRW is illustrated in Fig. 1. We use stochastic gradient descent (SGD) for RW model updates. In round t, the local update of the q-th client on the m-th chain im,q is given by t t t ˆ i wm,q = ΠW wm,q−1 − λ∇f wm,q−1 , (9) m,q t where wm,q−1 is the model parameters received by client im,q ˆ i from the previous node in round t. ∇f denotes unbiased m,q gradient estimation of fim,q , and λ is the learning rate. ΠW projects the updated model onto the feasible set W. The client t im,q then transmits the updated model wm,q to its neighbor im,q+1 ∈ Nm,q for the next local update.
5
this, we divide each model into β packets and enable packet retransmission, which significantly improves reliability while keeping delays within acceptable limits, thereby preserving training efficiency. We use the cyclic redundancy check (CRC) to detect errors in model received over the wireless channel and apply automatic repeat request (ARQ) to retransmit any erroneous packets. In the presence of transmission errors, the actual number of successfully received chains at the server may be less than M . The global model aggregation (10) under packet errors can be rewritten as M P Q t Cm,k wm,Q m=1 k∈S m , (11) wt+1 (S, R, n) = M P Q Cm,k
Algorithm 1: Federated Random Walk Averaging Input: λ, M , Q Output: wT Server executes: 0 1 Initialize global model w ; 2 for t = 0, 1, 2, . . . do 3 Randomly select initial clients for M RW chains and broadcast wt to them; 4 for m = 1, 2, . . . , M in parallel do t 5 wm,Q ← RWUpdate(m, wt ); 6 Aggregate wt+1 via (10). RWUpdate(m, wt ): 7 for q = 1, 2, . . . , Q do t 8 Client im,q updates wm,q via (9); t 9 Send wm,q to a random neighbor im,q+1 ∈ Nm,q ; 10
m=1 k∈Sm
t return wm,Q to server;
When the server receives updated models from M chains, it performs centralized aggregation using the following scheme to obtain the global model wt+1 . M
wt+1 =
1 X t w , M m=1 m,Q
(10)
t where Q is the length of the RW chain, and wm,Q represents the local model update from the final client of the m-th chain in round t. During training, the server and clients collaboratively optimize their models to minimize the loss function in (8). The complete FedRW training procedure is summarized in Algorithm 1. Moreover, many techniques developed for FedAvg such as [2], [3], [6]–[9], [14], [27], [43] as well as optimization strategies from RW learning, such as client sampling [4] and adaptive optimizers [21], [23], [24] can be naturally extended to FedRW. This flexibility makes FedRW particularly suitable for heterogeneous federated environments. Furthermore, emerging computing paradigms such as quantum computing are expected to further enhance parallelism and potentially enable exponential speedups [44].
B. Wireless FedRW Learning Procedure During FedRW training process, all models transmit over wireless links. These include the server sending the global model to clients, clients forwarding updates along the RW chains, and sending the final local models back to the server. Due to the unreliability of wireless channels, transmitted models may contain erroneous symbols. Unlike standard FL with local iterations, FedRW involves more frequent model exchanges due to its chain-based structure, making it more vulnerable to transmission errors. Simply discarding a corrupted model can interrupt the training chain, degrade convergence, and waste both computation and communication resources. For instance, if client im,q fails to deliver its model to im,q+1 due to transmission errors, the chain terminates prematurely, invalidating q local updates and q+1 transmissions. To address
where Sm denotes the path selection of the m-th RW chain, which consists of Q+1 wireless links, including the server-toclient link, client-to-client links, and the client-to-server link. The set S = [S1 , S2 , . . . , SM ] represents the paths of M RW chains. R = [Rm,k ]M ×|Sm | and n = [nm,k ]M ×|Sm | are the matrices that record the maximum number of retransmissions and the packet size for each hop in all RW chains, respectively. Cm,k = {0, 1} is an indicator variable that represents whether the model is successfully transmitted over the k-th wireless link of the m-th chain (with packet size nm,k and up to Rm,k retransmissions allowed). Specifically, Cm,k = 1 indicates a successful transmission, and Cm,k = 0 indicates a failure. The probability of successful transmission for each packet on the k-th wireless link of the m-th RW chain is [45] R
pm,k = 1 − (ϱm,k ) m,k
+1
.
(12)
Since βm,k packets are transmitted independently, Cm,k can be defined as β Cm,k ∼ Bernoulli (pm,k ) m,k , (13) where the Bernoulli distribution models the probability that Cm,k = 1 as (pm,k )βm,k , meaning all βm,k packets are successfully transmitted. The probability that at least one packet fails (i.e., Cm,k = 0) is 1 − (pm,k )βm,k . In (11), the transmission success rate Q of the entire RW chain Sm is determined by the product k∈Sm Cm,k , which combines the transmission outcomes of all wireless links along Q the chain. If k∈Sm Cm,k = 1, the model updated along the m-th RW chain is successfully delivered to the server; otherwise, a failure on Q any link causes the entire update to be discarded, i.e., k∈Sm Cm,k = 0. The sum of these PM Q success indicators over all M chains m=1 k∈Sm Cm,k reflects the transmission reliability of FedRW under the current RW path selection S, packet size n, and maximum number of retransmissions R. The server only aggregates the local t models wm,Q from successfully transmitted RW chains. Additionally, unlike [6], [42], our strategy (11) adopts unweighted aggregation. In the sequential structure of FedRW, weighting a chain’s final model by its total data size, chain length, or unique client count would be inappropriate. This is because client contributions are non-linear and dependent
6
on the position within the chain, as later updates iteratively refine previous ones. The final client of a chain effectively integrates prior updates, inherently reflecting the chain’s cumulative contribution. Furthermore, by employing multiple RWs with diverse paths, FedRW naturally achieves broad client coverage and balanced information propagation. Our empirical results confirm that unweighted aggregation provides robust convergence without added complexity or potential biases. Consequently, we maintain unweighted aggregation as an efficient default, leaving the exploration of specialized aggregation strategies for future research. C. Problem Formulation According to (13), the data packet size and maximum number of retransmissions jointly determine the model transmission success rate along the RW chains, which in turn affects the global model aggregation in (11). To jointly optimize the transmission parameters and the learning performance of FedRW under wireless networks, we formulate an optimization problem that aims to minimize the training loss. This problem integrates RW path selection with the configuration of packet size and maximum number of retransmissions, achieving a trade-off between algorithm performance and communication efficiency. M
1 X fm (w (S, R, n) ; Dm ) S,R,n M m=1
(14)
s.t. |Sm | = Q + 1, ∀m ∈ M,
(14a)
min
+
nm,k ∈ N , Rm,k ∈ N, ∀m ∈ M, ∀k ∈ Sm , (14b) τm,k ≤ γτ , ∀m ∈ M, ∀k ∈ Sm ,
(14c)
m0 ≤ Λm,k ≤ m0 + nm,k , ∀m ∈ M, ∀k ∈ Sm , (14d) Rm,k ≤ γR , ∀m ∈ M, ∀k ∈ Sm ,
(14e)
where fm (w(S, R, n); Dm ) denotes the loss of m-th RW chain on the global model w. (14a) specifies the number of wireless links in each RW chain. (14b) defines the feasible domains for the packet size and the maximum number of retransmissions. (14c) imposes a delay limit γτ on model transmission over each wireless link. (14d) ensures that the total number of bits transmitted Λm,k = nm,k βm,k is sufficient to cover the entire model size m0 without redundancy. (14e) limits the maximum number of retransmissions of any single packet by γR . IV. F ED RW C ONVERGENCE A NALYSIS AND P ROBLEM S IMPLIFICATION OVER U NRELIABLE W IRELESS L INKS Different task types and model architectures can lead to different forms of the loss function fm (w(S, R, n); Dm ) in problem (14). To establish a general formulation, we first analyze the convergence upper bound of FedRW over unreliable wireless networks, in order to understand how the choice of RW paths, packet size, and maximum number of retransmissions affects the convergence performance. Based on this analysis, we then simplify the optimization problem in (14) using the convergence bound as a surrogate objective.
Since the global model update process is influenced by the instantaneous maximum signal-to-noise ratio (SNR), we focus on the expected convergence bound. A. Convergence Upper Bound Over Unreliable Wireless Networks We begin by stating the assumptions required for deriving the expected convergence bound. These assumptions are commonly used in theoretical analyses of FL [9], [11], [40]. Compared to typical FL analyses, our framework employs weaker and more realistic assumptions. First, it does not rely on the bounded gradient dissimilarity assumption [7], [12], [31], allowing for more robust convergence guarantees in highly heterogeneous networks. Second, recognizing that the loss landscape of neural networks is non-convex in general [46], [47], [48], our analysis utilizes the PŁ condition [49], [50]. This property is empirically validated in neural network training and enables strong convergence guarantees in nonconvex settings. Finally, our analysis dispenses with secondorder differentiability or bounded Hessian assumptions [6], requiring only L-smoothness to establish the convergence bound. These relaxed assumptions make our theoretical guarantees more applicable to practical FL involving complex neural network models. Assumption 1. The function F (w) is differentiable and satisfies the µ-PŁ property with constant µ > 0. For any w ∈ W, 2 let F (w∗ ) = inf w∈W F (w), it holds that 21 ∥∇F (w)∥ ≥ ∗ µ (F (w) − F (w )). Assumption 2. The function F (w) is L-smooth with Lipschitz constant L > 0. For any w, w′ ∈ W, it holds that ∥∇F (w) − ∇F (w′ )∥ ≤ L ∥w − w′ ∥. We define the global gradient as 1 X t ∇fim,Q wm,Q−1 ∇F wt = , ψ
(15)
m∈Ψ
where Ψ denotes the set of all ψ possible RW paths, determined by the number of clients U and the chain length Q. When U and Q are large, the size of Ψ grows exponentially, making direct search for the optimal path set S computationally intractable. To address this challenge, we decompose the RW path selection into sequential decisions at each node along the chain. Specifically, each decision selects the next node from neighbors, thereby avoiding the infeasibility of solving a large-scale centralized problem and enabling distributed decision-making. Based on (11), the global model w at round t is aggregated as Q M Q P
wt+1 = wt − λ
P
m=1 q=0 i∈Nm,q
i t aim,q Cm,q ∇fim,Q wm,Q−1
Q M Q P
,
P
m=1 q=0 i∈Nm,q
i aim,q Cm,q
(16) where the node im,0 , ∀m ∈ M is the server, and Nm,Q contains only the server. This indicates that in each chain, the model is sent from the server to the client at the first step and returned to the server at the final step. The binary variable
7
aim,q = 1 indicates that node i ∈ Nm,q is selected at step q of chain m for the next local update; otherwise, aim,q = 0. Let w∗ denote the optimal global model obtained under an ideal setting with no packet error, using all possible RW paths. Under Assumptions 1, 2 and Definition 1, we provide the convergence upper bound of FedRW in unreliable wireless networks as stated in the following theorem. Theorem 1. Given a set of M random walk paths S, packet size n, maximum number of retransmissions R, and learning rate λ = L1 , the expected convergence rate is upper bounded by E F wt+1 − F (w∗ ) ≤ J t E F w0 − F (w∗ ) ! Q M Y X X (17) 2α2 1−Jt i + ψ− aim,q Em,q , ψL 1 − J m=1 q=0 i∈Nm,q
where ! Q M Y X X µ 4σ 2 µ i i am,q Em,q , (18) J = 1− + ψ− L ψL m=1 q=0 i∈Nm,q
i βm,q
i . E(·) is the expectation over the = (pim,q ) and Em,q randomness in packet error.
Proof. Please refer to Appendix A. Remark 1. Theorem 1 shows that the expected gap between the global loss F (wt+1 ) at round t + 1 and the optimal loss F (w∗ ) consists of two parts: 1) an exponentially decaying term related to the initial model error; 2) an error term caused by the unreliability of the wireless links. Since it does not converge when J ≥ 1, we focus on the case where J < 1. When t becomes large, the exponential term J t tends to zero, and the convergence behavior is dominated 2α2 by the error term. This term is given by ψL(1−J ) (ψ − PM QQ P i i m=1 q=0 i∈Nm,q am,q Em,q ), and depends on the nexthop selection a and the packet success rates p. Based on (4) and (12), for a given ϵ, the p is determined solely by the packet size n and the maximum number of retransmissions R. Therefore, optimizing a, R, and n can effectively reduce the impact of the error term on the convergence upper bound, thus improving the convergence performance of FedRW. To ensure convergence in Theorem 1 (i.e., J < 1), the variance σ 2 must be properly bounded, as follows. Proposition 1. Under the same assumptions and settings as Theorem 1, to ensure the convergence of Theorem 1, it is necessary to satisfy 1 ≤ σ2 <
ψ Q P Q max 4 1− R,n
m∈ψ
. P
q=0 i∈Nm,q
i aim,q Em,q
(19)
Proof. For a worst-case estimate of the upper bound on σ 2 , which always guarantees the convergence bound in Theorem 1 under any RW chain, we make all ψ chains participate in the aggregation, i.e., M = ψ. Since FedRW converges 2 µ P µ only when J < 1, we have 1 − L + 4σ m∈ψ (1 − ψL QQ P i i q=0 i∈Nm,q am,q Em,q ) < 1. Since µ > 0, and L >
0, the shift gives σ 2 < 4 P
m∈ψ (1−
q=0
ψ P
i i i∈Nm,q am,q Em,q )
.
To ensure convergence for all choices of n and R, take ψ Q P σ 2 < max 4 P . Meanwhile, ai E i ) (1− Q R,n
m∈ψ
by Definition 1, σ 2 ≥ 1.
q=0
i∈Nm,q
m,q
m,q
Remark 2. Proposition 1 reveals a coupling between wireless communication reliability and data heterogeneity. Specifically, as the heterogeneity level σ 2 increases, the higher model transmission reliability P system QQ requires P i i m∈ψ q=0 i∈Nm,q am,q Em,q to ensure convergence. This highlights that the convergence behavior of FedRW under Non-IID data is highly sensitive to wireless link quality. However, communication reliability cannot be improved simply by reducing the packet size n. Although a smaller n lowers the PER ϱ, it increases the number of packets β. Moreover, increasing R can enhance the success probability but at the cost of higher communication overhead and delay. Therefore, achieving robust convergence under high data heterogeneity requires a joint optimization of n, R, and β, to improve communication quality and enhance the system’s tolerance to larger σ 2 . Based on Theorem 1, we derive the convergence bound under ideal conditions. Lemma 1. Under the same assumptions as Theorem 1, with learning rate λ = L1 , the convergence upper bound without considering packet errors and RW chain selection is given by µ t E F wt+1 − F (w∗ ) ≤ 1 − E F w0 − F (w∗ ) . L (20) Proof. In the ideal case, all M RW chains are selected and transmitted successfully. From (17), we have PM Q Q P i E i = M , and ψ = M . Thus, a m=1 PM q=0QQ i∈N Pm,q m,q im,q i ψ − m=1 q=0 i∈Nm,q am,q Em,q = 0. Remark 3. According to Lemma 1, FedRW achieves gapfree convergence to the optimal global model when RW path selection and packet transmission errors are not considered. This result aligns with traditional FL with local updates [6], since both approaches utilize all available clients in each training round. This consistency is expected, as the idealized FedRW setting essentially reduces to conventional full client participation FL. B. Problem Simplification Based on Theorem 1, the impact of wireless factors on the error term of FedRW’s convergence bound can be minimized by optimizing the node selection matrix a of RW chains, the packet size n, and the maximum number of retransmissions R. By simplifying the error term, we have ! Q M Y X X 2α2 i i ψ− am,q Em,q ψL(1 − J ) m=1 q=0 i∈Nm,q PM QQ P i 2α2 ψ − m=1 q=0 i∈Nm,q aim,q Em,q . = PM QQ P i ψµ − 4σ 2 µ ψ − m=1 q=0 i∈Nm,q aim,q Em,q (21)
8
Since ψµ > 0, σ 2 µ > 0, and α2 ≥ 1, it is evident that minimizing PM QQ the P error term is i equivalent to minimizing ψ − m=1 q=0 i∈Nm,q aim,q Em,q , which in turn correPM QQ P i sponds to maximizing m=1 q=0 i∈Nm,q aim,q Em,q . We define Q = {0, 1, . . . , Q} and denote the server by is . Therefore, the original optimization problem in (14) can be reformulated in the following general form. Q M Y X X
max
a,R,n
i aim,q Em,q
(22)
m=1 q=0 i∈Nm,q
s.t. aim,q ∈ {0, 1}, ∀m ∈ M, ∀q ∈ Q, ∀i ∈ Nm,q , (22a) X aim,q = 1, ∀m ∈ M, ∀q ∈ Q, (22b) i∈Nm,q Q M X X
aim,q ≤ 1, ∀i ∈ U,
(22c)
im,0 = is , Nm,Q = {is }, ∀m ∈ M,
(22d)
m=1 q=0
(14b) − (14e), where (22a) and (22b) ensure that each RW chain selects exactly one node at each step, and (22c) ensures that each client is selected at most once across all RW chains. (22d) guarantees that both the initial and final nodes of each chain correspond to the server is . The original constraints on S are equivalently reformulated using the binary decision variables a, enabling a more tractable formulation. The objective of optimization problem (22) is to maximize the overall wireless link reliability across M chains, thereby reducing the upper bound of the global training loss and accelerating model convergence. V. J OINT RW PATH S ELECTION AND T RANSMISSION PARAMETER O PTIMIZATION In FedRW, centralized optimization is impractical due to the high communication cost of coordinating global information at the server. Instead, each node must make local decisions independently. To reduce computational complexity and avoid delays caused by slow nodes, we decompose the original problem in (22) into three distributed subproblems, each solvable locally using only neighbor information. First, for a fixed maximum number of retransmissions, we determine the optimal packet size for each wireless link in the RW chain. Based on the resulting packet sizes, we compute the corresponding optimal maximum number of retransmissions. Finally, we identify the RW path that minimizes the overall training loss while ensuring reliable communication. A. Optimal Packet Size Since the packet size nm,q only affects the transmission performance of its own wireless link, we can determine it independently. Given a fixed R ∈ NM ×|Sm | with R ≤ [γR ]M ×|Sm | , the subproblem of selecting the optimal packet size for transmitting the model from node im,q to a neighbor im,q+1 ∈ Nm,q can be formulated as βm,q R+1 max 1 − (1 − (1 − ϵ)nm,q ) (23) nm,q
s.t. (14c), (14d), im,q+1 ∈ Nm,q , ∀m ∈ M, ∀q ∈ Q, +
nm,q ≤ γn , nm,q ∈ N , ∀m ∈ M, ∀q ∈ Q,
(23a) (23b)
1−p
where γn = ⌊− log( ϵ ϱ )⌋ is used to limit the upper bound of PER pϱ . The delay constraint implicitly enforces a lower bound on packet size to avoid low transmission efficiency. Since β changes in a stepwise manner as n increases, direct optimization requires handling a discrete and non-smooth objective, which is computationally challenging. To address this, we adopt a logarithmic sampling strategy for β, as the marginal gain in packet success probability diminishes when packets are short. m0 0 For ⌈ m γn ⌉ ≤ β ≤ ⌈ nτ ⌉, where nτ is the minimum packet size imposed by the delay constraint, we logarithmically sample ϕ values of β. For each sampled β, the corresponding optimal packet size n∗ is determined using Proposition 2, yielding a set of feasible (n∗ , β) pairs. These pairs are then checked in descending order of β. Since larger β corresponds to smaller n∗ , if a given β satisfies the delay constraint, all smaller β will also satisfy it. Finally, we select the feasible (n∗ , β ∗ ) pair that maximizes the objective. This approach leverages the fact that the objective is nonmonotonic in n because n affects β. However, once β is fixed, the objective increases as n decreases. Therefore, the optimal strategy is to choose the smallest feasible n for each β under the delay constraint. The following proposition provides the method to determine the optimal n for a given β. Proposition 2. Given a total model size m0 , a fixed number of packets β, and a maximum number of retransmissions R, the optimal packet size n∗ (β) is given by m0 ∗ +e , (24) n (β) = max min {n∆ , γn } , β wherePn∆ is the packet size such that τ (n∆ , β) = R+1 n∆ β r−1 (n∆ )(1 − ϵ)n∆ + (R + 1)ϱR+1 (n∆ )) is r=1 rϱ r ( closest to γτ and satisfies τ (n∆ , β) ≤ γτ . Proof. For given m0 , R, and β, the objective in (23) is strictly decreasing in n, so the smallest feasible n maximizes it. The delay constraint τ (n) ≤ γτ imposes a lower bound on n, as too small a value would violate it. Thus, n∆ is the smallest n that strictly satisfies the delay constraint without exceeding γn , ensuring the PER remains acceptable. Additionally, n must satisfy the constraint in (14d), which requires the payload ζ of each packet to be no less than ⌈ mβ0 ⌉. Remark 4. Proposition 2 shows that n∗ (β) for a given β is determined by ϵ and model size m0 . The objective favors smaller n∗ (β) to improve transmission success under the delay constraint τ (n∗ (β)) ≤ γτ . However, this preference faces two key trade-offs: 1) A larger m0 increases the total bits to transmit. To meet the delay constraint, n∗ (β) must increase to achieve higher data rates, but this also raises packet failure probability, reducing reliability. 2) A worse channel (e.g., larger ϵ) favors smaller n∗ (β) for better packet ∗ reliability (1 − ϵ)n (β) , but this leads to more packets and may degrade training performance. Moreover, since n∗ (β) ≤ γn ,
9
a small pϱ imposes a tighter n bound. If no feasible n satisfies delay constraint, the link is deemed unavailable. While retransmissions can mitigate high error rates, overly conservative pϱ values risk unnecessary link exclusion.
To enable efficient node selection in wireless FedRW, we propose a resilience-aware beam search with dynamic pruning strategy. This strategy considers both current link reliability and the extendibility of the path. For node im,q , the set of next-hop nodes is defined as
B. Optimal Maximum Number of Retransmissions
Zm,q+1 = {im,q+1 ∈ χm,q | im,q+1 ∈ / A, χm,q ⊆ Nm,q } , (28) where χm,q denotes the set of neighbors filtered by (23) and (25) to exclude nodes that cannot satisfy the delay constraint even with optimized transmission parameters. A denotes the set of clients already selected by RW chains in the current round to satisfy constraint (22c). Given a beam size ρ, we select the top-ρ candidate nodes Xm,q+1 = i1m,q+1 , i2m,q+1 , . . . , iρm,q+1 from Zm,q+1 with the highest link reliability, where the nodes are sorted in descending order of reliability. The core idea of dynamic pruning is to restrict beam expansion to only the most promising candidates based on current network conditions. The next-hop node selection rule is n o ∗ ξ ξ ∗ i , if ∃ξ = min ξ : N = ρ , m,q+1 m,q+1 † ξ ξ ∗ † im,q+1 , if ∄ξ , ∃ξ = arg max Nm,q+1 , im,q+1 = ξ ξ:Nm,q+1 >0 ∅, otherwise, (29) ξ where ξ = {1, 2, . . . , ρ}, and Nm,q+1 is the number of available neighbors of iξm,q+1 for the ξ-th node in Xm,q+1 . The selection function (29) first searches the candidate set Xm,q+1 in descending order of link reliability to find the most reliable node that can expand to ρ neighbors. If none is found, it selects the one with the largest number of available neighbors. If no candidates have any valid next-hop neighbors, the path is terminated. Once a node is selected, all other candidates in the same beam are pruned to reduce branching overhead. While the selection in (29) is deterministic per decision instant, the process remains a random walk as the neighbor set and link reliability are stochastic observations of random topologies and fading channels. By adapting to these dynamic inputs, the algorithm generates a path that is a stochastic realization of the evolving network state. Algorithm 2 summarizes the joint RW path selection and transmission parameter optimization algorithm over unreliable wireless networks.
Based on the optimal (n∗ , β ∗ ) pairs from (23), the subproblem of determining the optimal maximum number of retransmissions for transmitting the model from node im,q to neighbor im,q+1 ∈ Nm,q is formulated as β ∗ max 1 − ϱRm,q +1 n∗m,q m,q (25) Rm,q
s.t. (14c), (14e), im,q+1 ∈ Nm,q , ∀m ∈ M, ∀q ∈ Q,
(25a)
Rm,q ∈ N, ∀m ∈ M, ∀q ∈ Q.
(25b)
We determine the optimal maximum number of retransmissions for per wireless link using the following proposition. Proposition 3. Given the optimal n∗ and β ∗ , the optimal maximum number of retransmissions R∗ is given by R∗ = min {R∆ , γR } ,
(26)
where R∆ is the largest R∗ satisfying τ (R∆ ) ≤ γτ and closest ∗ PR +1 ∗ ∆ rϱr−1 (n∗ )(1 − ϵ)n + to γτ , with τ (R∆ ) = n rβ ( r=1 (R∆ + 1)ϱR∆ +1 (n∗ )). Proof. Since ϵ ∈ (0, 1), the objective in (25) increases monotonically with R. Thus, the largest R that satisfies τ (R) ≤ γτ maximizes the objective while respecting the delay constraint and the bound in (14e). Remark 5. Proposition 3 shows that the optimal R∗ depends on both ϵ and the amount of transmitted data n∗ β ∗ . A larger n∗ β ∗ tightens the delay constraint, potentially requiring a smaller R∗ , which increases the risk of transmission failure. Conversely, a larger ϵ requires more retransmissions to offset higher packet error. Therefore, selecting optimal (n∗ , β ∗ ) pair and R∗ reflects a fundamental trade-off among transmission efficiency, channel reliability, and training loss over unreliable wireless networks. C. Optimal RW Path Selection Based on the optimal n∗ , β ∗ and R∗ , the optimization problem in (22) can be simplified as max a
Q M Y X X
i aim,q Em,q
(27)
m=1 q=0 i∈Nm,q
s.t. (22a) − (22d). Formally, this problem resembles a maximum weight bipartite matching or a minimum cost flow problem. However, the objective involves nonlinear products across multiple hops, making matching or flow-based solutions inapplicable. Moreover, in sparse wireless topologies with local link constraints, centralized coordination would incur excessive communication overhead and delay. Therefore, we develop a more scalable distributed solution.
D. Implementation and Complexity In wireless FedRW, each node estimates the SNR to its neighbors and computes the transmission rate. Given the delay bound γτ , retransmission limit γR , and packet error constraint pϱ , the optimal transmission parameters (n∗ , β ∗ ) and R∗ are determined. Wireless links that violate the delay constraint are removed, resulting in the feasible neighbor set χ. The server maintains a global set A to track selected clients. After each local update, the current node sends the next client identifier to the server. If no direct link exists, this information is relayed through reverse chaining. For next-hop selection, each node uses χ and A to construct the candidate set Z and selects
10
Algorithm 2: Proposed FedRW Over Unreliable Wireless Networks Input: λ, M , Q, γτ , γR , pϱ , ϕ, ρ Output: wT Server executes: 0 1 Initialize global model w ; 2 for t = 0, 1, 2, . . . do 3 Server calculates optimal n∗ , β ∗ and R∗ for each of its neighbors; 4 Select M initial clients by (29) and broadcast wt to them; 5 for m = 1, 2, . . . , M in parallel do t 6 wm,Q ← RWUpdateWirel(m, wt ); 7 Aggregate wt+1 via (11). RWUpdateWirel(m, wt ): 8 for q = 1, 2, . . . , Q do t 9 Client im,q updates wm,q via (9) and calculates ∗ ∗ optimal n , β and R∗ for each of its neighbors; t 10 Select im,q+1 by (29) and transmit wm,q to it; 11
t to server; return wm,Q
the top-ρ nodes X with the highest link reliability. Redundant branches are pruned based on condition (29). According to Proposition 2, each node performs a binary search over n ∈ [nτ , γn ]. Each step has complexity O(R), and a total of O(log2 (γn − nτ )) iterations are required. This is repeated ϕ times for feasible β, resulting in a total complexity of ¯ ¯ O(ϕ·R· d·log 2 (γn −nτ )), where d is the average node degree. Similarly, Proposition 3 uses binary search over R ∈ [0, γR ] with complexity O(γR · d¯ · log2 γR ). In the resilience-aware beam search, each node selects the top-ρ candidates from Z with complexity O(z log z), where z = |Z|. Evaluating the ¯ and pruning stops extendibility of each candidate costs O(d), early once the first expandable candidate is found. Thus, on average, only ρp ≪ ρ candidates are evaluated. The total ¯ which is near-linear in practice complexity is O(z log z+ρp d), as ρp is typically small. The modular design enables each component to be optimized independently, facilitating future extensions such as learning-based path selection or adaptive transmission under dynamic networks, and the integration of quantum algorithms to improve both computational and communication efficiency. FedRW mitigates the impact of channel state information (CSI) staleness through a proactive local sensing mechanism. Under a block fading channel, the current node performs an instantaneous SNR probe for all neighbors before each transition. Based on these measurements, the node subsequently computes the optimal transmission parameters and reliability to execute the beam search selection. Because the computational complexity is near-linear, the delay between sensing and transmission is negligible compared to the channel coherence time. This ensures that the selected parameters remain valid throughout the duration of each hop.
E. Optimality of Problem Decomposition To rigorously justify the proposed decomposition, we provide a proof of equivalence between the joint optimization problem and the distributed subproblems. Proposition 4. The joint optimization problem in (22) is i equivalent to maximizing the reliability Em,q for each potential wireless link independently, followed by solving the node selection matrix a based on these maximized values. Proof. Since the constraints (14c)−(14e) are link-specific, the feasible region for each (nm,q , Rm,q ) is strictly local. Importantly, there are no coupling constraints that link the parameter choices of different wireless links. Thus, the global joint maximization can be nested as Q M Y X X i . max aim,q max Em,q (30) a
m=1 q=0 i∈Nm,q
nm,q ,Rm,q
The maxnm,q ,Rm,q operator can be moved inside the summations and products because the objective is monotonically i non-decreasing with respect to each Em,q ≥ 0 and the local feasible sets are independent. By optimizing each wireless link reliability, the problem reduces to (27), confirming the optimality of the decomposition. Remark 6. We adopt two practical approximations for realtime execution. First, the two dimensional search is decoupled into two sequential one-dimensional subproblems. A logarithmic sampling strategy for β is used to prune the search space while capturing diminishing marginal gains of transmission efficiency. Second, a resilience-aware beam search with an extendibility criterion (29) is employed to avoid exponential complexity in path selection. This strategy prunes suboptimal branches early to achieve near-optimal reliability with linear complexity. Numerical results demonstrate that the cumulative optimality gap is negligible. VI. S IMULATION R ESULTS AND A NALYSIS Our objective is to validate the capability of FedRW to mitigate data heterogeneity, as well as the superiority of the proposed joint RW path selection and transmission parameter optimization algorithm. Specifically, we consider a simulation environment consisting of 100 clients and a central server. The server is positioned at the center of a circular area with a radius of 500 m, and clients are uniformly distributed within this area. We construct a directed Bernoulli random graph by connecting each pair of nodes independently with a probability of 0.5. The simulation results are the average of multiple experiments. To demonstrate the robustness, the figures include shaded regions representing the standard deviation. We evaluate FedRW on four benchmark datasets. For both MNIST and Fashion-MNIST, we use a multilayer perceptron (MLP) (784×100×10) with ReLU activation and Softmax output, trained with cross-entropy loss. For CIFAR-10 and CIFAR-100, we adopt the VGG13 [51] and ResNet-18 [52] respectively, both with Softmax and cross-entropy loss. Simulation parameters are summarized in Table II, which serves as the default unless otherwise stated.
11
TABLE II S IMULATION PARAMETERS
0.6 0.4 FedRW FedAvg
0.2 0
50
100 150 Rounds
(a) Fashion-MNIST ζn =0)
(mixed
Training loss
0.8
Algorithmic Parameters Parameter Value U 100 M 5 Q 3 Batch size 64 λ 0.01 ϕ 100 ρ 4
Accuracy
Wireless Parameters Parameter Value B 10 MHz P 23 dBm N0 −174 dBm/Hz ϵ 1e-5 γτ 20 ms pϱ 0.1 γR 2 e 128 bits
200
0.6
0
FedRW FedAvg
0 2.5 5 7.5 10 Communication overhead (×103 Mbit)
We consider two data heterogeneity settings. 1) In the mixed Non-IID setting, each client has a ζn fraction of IID data and a (1−ζn ) fraction from a label-sharded Non-IID pool (one class per shard) [42], where smaller ζn increases heterogeneity. 2) In the Dirichlet Non-IID setting, samples of each class y are allocated to clients by sampling a probability vector py from a Dirichlet distribution with concentration parameter ζd , i.e., py ∼ Dir(ζd ) [5]. A smaller ζd yields more skewed class distributions across clients. Experiments are conducted on a computing node equipped with an Intel Xeon Platinum 8558 CPU and an NVIDIA RTX 4090 D GPU. The implementation uses Python 3.8 and PyTorch 1.13.0 with CUDA 11.8 for GPU acceleration. A. Performance Comparisons of FedRW Learning Framework We first evaluate FedRW in heterogeneous networks to demonstrate its effectiveness in handling non-IID data. As shown in Fig. 2, the X-axis indicates the cumulative communication overhead across all nodes over training. Under highly heterogeneous data distributions on MNIST, FedRW achieves higher accuracy and faster convergence than FedAvg under the same communication overhead, indicating that FedRW adheres to the core principle of FL, trading computation for communication efficiency. In particular, FedRW improves the final accuracy by 8.72% and 2.26%, respectively. Moreover, because FedRW traverses a more diverse set of data samples, it exhibits more stable convergence behavior. Fig. 3 shows the accuracy and training loss of algorithms trained in strongly Non-IID settings on additional datasets, with γτ = 3 s on CIFAR-10 and CIFAR-100. For FashionMNIST, the results are similar to previous findings, with FedRW achieving 9% higher accuracy and faster reduction in training loss than FedAvg. However, for CIFAR-10 and
0.5 0.4 0.3 0.2 0.1 0.0
50
FedRW FedAvg
Non-IID,
0
200 400 Rounds
600
(d) CIFAR-10 (mixed Non-IID, ζn =0.2)
FedRW FedAvg
3.5 2.5 1.5 0.5
500 1000 1500 2000 Rounds
(e) CIFAR-100 (mixed Non-IID, ζn =0.4)
(mixed
200
0.8
4.5
0
100 150 Rounds
FedRW FedAvg
1.3
0.3
600
(c) CIFAR-10 (mixed Non-IID, ζn =0.2)
(b) MNIST (Dirichlet Non-IID, ζd =0.1)
Fig. 2. MNIST classification accuracy vs. total communication overhead under Non-IID data distribution (200 rounds).
200 400 Rounds
Training loss
Accuracy
FedRW FedAvg
Training loss
(a) MNIST (mixed Non-IID, ζn =0)
0.7
0.4 0.2
0.8
0
1.8
0.6
0
500 1000 1500 2000 Rounds
(f) CIFAR-100 (mixed Non-IID, ζn =0.4)
Fig. 3. Classification accuracy and training loss on Fashion-MNIST, CIFAR10, and CIFAR-100 in mixed Non-IID settings. 1.0
Accuracy
0 2.5 5 7.5 10 Communication overhead (×103 Mbit)
0.9
Accuracy
FedRW FedAvg
Accuracy
Accuracy
1.0
FedRW FedAvg
Non-IID,(b) Fashion-MNIST ζn =0)
0.8 1.0 0.9 0.8 0.7 0.6 0.5
3.0 2.5 2.0 1.5 1.0 0.5
0.9
0.8
0
50
100 Rounds
M=5, L=5 M=10, L=10 M=20, L=20 M=30, L=30 M=40, L=40 M=50, L=50 150 200
Fig. 4. MNIST classification accuracy of FedRW in Dirichlet Non-IID (ζd =0.1) setting with varying random walk chain counts and lengths.
CIFAR-100, FedRW explores the parameter space with higher variance updates in the early stages, leading to slower convergence initially. In contrast, FedAvg tends to converge quickly to a suboptimal solution dominated by local data distributions, which appears more favorable during the early rounds. As training progresses, FedRW achieves lower training loss, eventually improving accuracy by 2.49% and 4.97% respectively, as it better captures the global data distribution. Fig. 4 presents the classification accuracy of FedRW under different combinations of the number of RW chains M and chain length Q. As M and Q increase, the model achieves higher accuracy, faster convergence, and improved stability. However, the performance gain tends to saturates when M , Q ≥ 20, as the number of data samples visited per round becomes sufficient. When M = Q = 50, the accuracy plateaus
12
0.9
0.6 FedRW FedAvg FedProx FedNova
0.7 0.6
0
50
100 150 Rounds
0.7
0.5 FedRW FedAvg FedProx FedNova
0.4 0.3 0.2
200
0
500 1000 1500 2000 Rounds
(a) MNIST (Dirichlet Non-IID, ζd =0.1) (b) CIFAR-100 (Dirichlet Non-IID, ζd =0.2)
Fig. 5. Performance comparison between FedRW and state-of-the-art baselines in Dirichlet Non-IID setting.
0.8 FedRW =0 = 0.5 =1
0.7 0.6 0.5
0
50
100 150 Rounds
200
(a) MNIST (mixed Non-IID, ζn =0)
Accuracy
Accuracy
0.9
0.5 0.4 0.3 0.2 0.1 0.0
FedRW =0 = 0.5 =1 0
500 1000 Rounds
1500
(b) CIFAR-100 (mixed Non-IID, ζn =0.4)
Fig. 6. Performance comparison of FedRW under varying degrees of intrachain data diversity.
after 120 rounds, indicating that FedRW has converged. Fig. 5 compares FedRW with FedAvg, FedProx [8], and FedNova [53] in Dirichlet Non-IID settings. With proximal term coefficient tuned from {0.005, . . . , 0.1}, FedProx performs comparably to FedAvg, as its proximal term overly restricts local adaptation to extreme heterogeneity. FedNova slightly improves upon FedAvg but exhibits higher oscillations. This instability stems from its aggressive gradient scaling, which amplifies noise from clients with limited data in highly unbalanced data settings. In contrast, FedRW achieves the highest accuracy of 92.68% and 61.75% with superior stability. Its sequential traversal of local distributions acts as an implicit smoothing mechanism, effectively integrating diverse knowledge while avoiding the convergence volatility inherent in centralized aggregation. We introduce a parameter γ to investigate intra-chain heterogeneity by controlling the data diversity of the (1 − ζn ) fraction within each chain. As shown in Fig. 6, the highest accuracy and fastest convergence are achieved with fully heterogeneous chains (γ = 1), with the standard FedRW random strategy performing closely. Conversely, homogeneous chains (γ = 0) suffer from gradient bias accumulation and sample homogenization, leading to significant performance degradation. The random strategy effectively enhances learning efficiency through implicit data mixing and mutual gradient correction. While the performance gap narrows under milder heterogeneity (ζn = 0.4), the necessity of intra-chain diversity remains evident. These findings suggest that for extreme Non-IID scenarios, clustering clients by data similarity to systematically construct heterogeneous chains across clusters could further enhance learning efficiency, offering a promising direction for future optimization.
Testing loss
0.8
Accuracy
Accuracy
0.9
Unweighted Weighted by chain length
0.7
Unweighted Weighted by unique clients
0.5
0.7
Unweighted Weighted by data samples
0.6 0.5
0.5 0.3 0.1
0.4
0.3
0.3
0
100 Rounds
(a) MNIST (ζn =0)
200
0.1
0
100 Rounds
(b) MNIST (ζn =0)
200
0.2
0
100 Rounds
200
(c) MNIST (ζd =0.1)
Fig. 7. Comparison between unweighted and weighted aggregation schemes.
To validate the unweighted aggregation in (11), we compared it against three alternative weighting schemes based on RW chain length (length randomly distributed in [3,10]), the number of unique clients visited per chain (U = 20, Q = 10), and the total data samples processed along the chain (ζd = 0.1) under scenarios favoring weighting. As shown in Fig. 7, unweighted aggregation achieves comparable testing loss while demonstrating better stability. Specifically, the oscillations observed in Fig. 7 (c) for weighting by data volume stem from the fact that in the sequential structure of FedRW, a chain’s final model already represents an iterative refinement of all prior participants. Assigning a large weight based on total data volume within a chain essentially treats this integrated model as a single monolithic node, which disproportionately amplifies the local biases of the final nodes in that chain. In contrast, unweighted aggregation treats each RW as an equal contribution, effectively smoothing out individual biases through path diversity and preserving a more balanced global representation. Furthermore, unweighted aggregation avoids the additional communication and storage overhead of tracking and transmitting chain metadata. B. Performance Comparisons of Joint RW Path Selection and Transmission Parameter Optimization Algorithm To the best of our knowledge, there is extremely limited prior work similar to FedRW, and none that addresses client selection or transmission parameter optimization under unreliable communication. To validate the proposed joint RW path selection and transmission parameter optimization algorithm, we compare it with three baselines: 1) Ideal FedRW: assumes perfect channels without transmission errors and employs a uniform random walk strategy; 2) RandParam FedRW: randomly selects transmission parameters but optimizes RW path selection based on the resulting link reliability. 3) Greedy-RW FedRW: optimizes transmission parameters while selecting RW paths greedily, where the next-hop node is selected as j j im,q+1 = arg max Em,q + Iq=Q · Em,Q .
(31)
j∈Zm,q+1
where the indicator function Iq=Q activates only when q = Q, in which case the wireless link from the final client to the server is included. Note that as FedRW already outperforms all baselines in Section VI-A, we use only Ideal FedRW here.
Proposed Ideal Greedy-RW RandParam
0.7 0.6 0.5
0
50
100 150 Rounds
Training loss
Accuracy
0.8
Proposed Ideal Greedy-RW RandParam
1.0 0.6 0
50
100 150 Rounds
200
3.0 2.5 2.0 1.5 1.0 0.5
Proposed Ideal Greedy-RW RandParam
0.4 0.2
0
50
100 150 Rounds
(c) Fashion-MNIST ζn =0)
(mixed
Training loss
(b) MNIST (mixed Non-IID, ζn =0)
0.8 Accuracy
(a) MNIST (mixed Non-IID, ζn =0)
0.6
200
0.2 0
100 200 300 400 500 Rounds
Accuracy
(e) CIFAR-10 (mixed Non-IID, ζn =0.2)
0.5 0.4 0.3 0.2 0.1 0.0
Proposed Ideal Greedy-RW RandParam 0
Training loss
0.4
0
50
100 150 Rounds
500 1000 1500 2000 Rounds
3.0 2.5 2.0 1.5 1.0 0.5
(mixed
200 Non-IID,
Proposed Ideal Greedy-RW RandParam 0
100 200 300 400 500 Rounds
(f) CIFAR-10 (mixed Non-IID, ζn =0.2)
Training loss
Accuracy
Proposed Ideal Greedy-RW RandParam
0.6
Proposed Ideal Greedy-RW RandParam
Non-IID,(d) Fashion-MNIST ζn =0)
0.8
0.8
0.6
0.7
0.4
FedRW (Eq. 22c) FedRW (Reliable links)
0.2
0.2
200
0.8
5 4 3 2 1
Proposed Ideal Greedy-RW RandParam 0
500
1000 1500 2000 Rounds
(g) CIFAR-100 (mixed Non-IID, ζn =0.4) (h) CIFAR-100 (mixed Non-IID, ζn =0.4)
Fig. 8. Comparative of classification accuracy and loss between the proposed joint RW path selection and transmission parameter optimization algorithm and baselines on MNIST, Fashion-MNIST, CIFAR-10, and CIFAR-100.
Our joint optimization nearly reaches this upper bound, other suboptimal curves are omitted for clarity. Fig. 8 (a) and (b) show the accuracy and training loss of proposed algorithm and baselines over training rounds on the MNIST classification. Compared to Greedy-RW and RandParam algorithms, the proposed algorithm achieves an average accuracy improvement of 2.78% and 4.67% and has a faster convergence rate. The 2.78% performance gain is attributed to the foresight of the dynamic pruning-based beam search algorithm, which avoids the short-sighted decisions typical of greedy algorithms. This enables the proposed algorithm to match the accuracy and convergence rate of the Ideal FedRW. The 4.67% improvement comes from the optimization of transmission parameters, which allows access to more and higher quality neighbors during RW path selection. In contrast, Greedy-RW and RandParam algorithms experience larger oscillations due to discarding models with transmission
0
50
100 150 Rounds
(a) Fashion-MNIST ζn =0)
(mixed
200
Accuracy
1.4
0.9
Accuracy
13
0.6 FedRW (Eq. 22c) FedRW (Large data)
0.5 0.4
0
50
100 150 Rounds
200
Non-IID,(b) Fashion-MNIST (Dirichlet Non-IID, ζd =0.1)
Fig. 9. Comparison of classification accuracy between the proposed algorithm and its variant with constraint (22c) relaxed.
errors. Additionally, the training loss suggests that the empirical results are consistent with the expected convergence behavior outlined in the theoretical analysis. Fig. 8 (c) − (h) present the performance on Fashion-MNIST, CIFAR-10, and CIFAR-100. Consistent with the findings on MNIST, the proposed algorithm achieves the highest accuracy with minimal convergence oscillation across all three datasets. For CIFAR-10 and CIFAR-100 in particular, RandParam suffers from ineffective training, as its random transmission parameters often cause most wireless links to violate the relatively strict delay constraints. These results underscore the necessity of jointly optimizing RW path selection and transmission parameters to reduce training loss over unreliable wireless networks. From Fig. 8, we observe that our proposed algorithm achieves stable convergence and improved performance on non-convex neural networks. This empirical evidence suggests that, although these models are non-convex, their loss landscapes during training may possess properties akin to the PŁ condition assumed in our theoretical analysis, making our convergence guarantees practically relevant. We analyze the impact of relaxing constraint (22c) on convergence to verify that this restriction is essential for heterogeneity mitigation. As shown in Fig. 9 (a), prioritizing reliable links by allowing clients with high wireless reliability to participate in multiple chains leads to a final accuracy drop of 11.3%. This occurs because the optimization objective in (22) favors high reliability, causing the algorithm to persistently select the same few optimal clients and creating severe data sampling bias. As shown in Fig. 9 (b), allowing the top 10% of clients with the largest data volume to participate in multiple chains yields no advantage over standard FedRW. The inherent bias of beam search toward reliable links dominates data size considerations, while repeated selection of the same Non-IID clients introduces redundancy without enhancing data diversity. Therefore, constraint (22c) ensures that FedRW captures a broader range of data distributions across the network, effectively preventing the global model from being dominated by a small subset of biased clients. We further evaluate the proposed algorithm’s advantages over baselines under varying network conditions. Fig. 10 (a) shows how the number of RW chains participating in aggregation changes with γR . The proposed algorithm consistently achieves the best performance across all γR . As γR increases,
4 3 2
Proposed Greedy-RW RandParam
1 0
1
2
3
4
5
6
5 4 3 2
Proposed Greedy-RW RandParam
1 0
14
16
18
R
(a) γR vs. Number of aggregated RW chains
20 22 (ms)
24
26
Number of aggregated RW chains
5
Number of aggregated RW chains
Number of aggregated RW chains
14
5 4 3 2
Proposed Greedy-RW RandParam
1 0 10 7
10 6
10 5
10 4
(b) γτ vs. Number of aggregated RW chains (c) BER vs. Number of aggregated RW chains
Fig. 10. Comparison of number of aggregated RW chains under different network conditions on MNIST in mixed Non-IID (ζn =0) setting.
the success probability of model parameter transmission improves exponentially, narrowing the performance gap among algorithms. When γR = 6, nearly all wireless links with optimized transmission parameters become reliable, allowing Greedy-RW to perform comparably to the proposed algorithm. Fig. 10 (b) presents the number of RW chains aggregated under varying packet delay constraints γτ . As the delay constraint is relaxed, smaller packet sizes or more retransmissions are allowed, which improves transmission success rates under unreliable channels. The proposed algorithm consistently outperforms all baselines across all levels of delay constraints. Greedy-RW grows faster than RandParam because optimized transmission parameters allow it to better leverage the available delay budget to improve transmission reliability. Fig. 10 (c) shows the number of aggregated RW chains under varying BER levels. As BER increases, all methods degrade due to reduced transmission reliability, but the performance gap widens as baselines deteriorate more rapidly. RandParam fails to adjust transmission parameters, making it hard to find usable next-hop links. Greedy-RW can find reliable links locally, but often cannot extend the path due to surrounding unreliable neighbors. Compared to the baselines, the proposed algorithm effectively addresses both limitations by jointly optimizing transmission parameters and path selection, resulting in robust aggregation even under high BER.
While our analysis provides convergence upper bounds, two theoretical questions remain open. First, matching lower bounds could be established by applying rate distortion theory to model gradient transmission over unreliable links, or through adversarial constructions with orthogonal client data. Second, extending the analysis beyond PŁ conditions requires new techniques, such as constructing Lyapunov functions that incorporate wireless conditions, data heterogeneity, and random walk dynamics.
A PPENDIX A According to (16), the global model update at round t is given by wt+1 = wt − λ ∇F wt − Θ , (32) where PM QQ P t i i q=0 m=1 i∈Nm,q am,q Cm,q ∇fim,Q (wm,Q−1 ) PM QQ P . Θ = ∇F (wt )− ai C i m=1
q=0
i∈Nm,q
m,q
m,q
To prove Theorem 1, we leverage the quadratic upper bound provided by L-smoothness. ⊤ F wt+1 ≤ F wt + wt+1 − wt ∇F wt L 2 wt+1 − wt . + 2
(33)
VII. C ONCLUSION In this paper, we address two key challenges in wireless federated learning: data heterogeneity and unreliable transmission. We first propose a new FedRW framework, where multiple RW chains perform local updates in parallel, and their updates are aggregated by a server to mitigate data heterogeneity. Building on this, we formulate a joint RW path selection and transmission parameter optimization problem, aiming to minimize the training loss of FedRW. We simplify the problem using an upper bound of the expected convergence over unreliable wireless networks and develop a distributed solution. Each server or client only needs to determine the optimal packet size, maximum number of retransmissions, and next-hop based on the wireless link reliability and latency to its neighbors. Simulation results demonstrate the effectiveness and superiority of the proposed wireless FedRW in handling data heterogeneity and reducing training loss.
Given the learning rate λ = L1 , we can express the expected loss as ⊤ E F wt+1 ≤ E F wt − λ ∇F wt − Θ ∇F wt 2 ∥∇F (wt )∥ Θ⊤ ∇F (wt ) ∥Θ∥2 + − + 2L L 2L 2 t ∥∇F (w )∥ E ∥Θ∥2 t =E F w − + . 2L 2L (34) Then, we derive the upper bound of E[∥Θ∥2 ]. Let t ∇gitm,Q = ∇fim,Q (wm,Q−1 ), we first decompose (15) as P P 1 t ∇F (w ) = ψ ( m∈Ψs ∇gitm,Q + m∈Ψf ∇gitm,Q ), where Ψs denotes the set of RW chains that are selected and successfully transmitted in round t, and Ψf denotes those that are either not selected or failed in transmission. Since
15
PM
m=1
QQ P
i i t i∈Nm,q am,q Cm,q ∇gim,Q =
q=0
P
t m∈Ψs ∇gim,Q .
Therefore, we have " X 1 X 2 E ∥Θ∥ = E ∇gitm,Q ∇gitm,Q + ψ m∈Ψf m∈Ψs # P t 2 m∈Ψs ∇gim,Q − PM QQ P i i m=1 q=0 i∈Nm,q am,q Cm,q " PM QQ P i ψ − m=1 q=0 i∈Nm,q aim,q Cm,q =E − PM QQ P i ψ m=1 q=0 i∈Nm,q aim,q Cm,q # 2 X 1 X ∇gitm,Q + × . ∇gitm,Q ψ m∈Ψs m∈Ψf (35) By applying the triangle inequality, we have " PM QQ P i ψ − m=1 q=0 i∈Nm,q aim,q Cm,q 2 E ∥Θ∥ ≤ E PM QQ P i ψ m=1 q=0 i∈Nm,q aim,q Cm,q (36) #2 X 1 X t t ∇gim,Q . × ∇gim,Q + ψ m∈Ψs
m∈Ψf
Using ∥∇gitm,Q ∥ ≤ 1, we have X
p α2 + σ 2 ∥∇F (wt )∥2 from Definition
∇gitm,Q q
2
α2 + σ 2 ∥∇F (wt )∥
Q M Y X X
i aim,q Cm,q .
m=1 q=0 i∈Nm,q
(37) Noting that |Ψ | + |Ψ | = Ψ, we also have s f p P t ≤ α2 + σ 2 ∥∇F (wt )∥2 (ψ − m∈Ψf ∥∇gim,Q ∥ PM QQ P i i Therefore, (36) can m=1 q=0 i∈Nm,q am,q Cm,q ). be expressed as
α2 + σ 2 ∥∇F (wt )∥
2
(38) Q M Y X X 4 i E ψ − aim,q Cm,q ψ2 m=1 q=0 i∈Nm,q 2 2 2 × α + σ ∇F wt .
"
=
#2
Based on the expectation of the transmission success inP i i i ] = (pim,q )βm,q = Em,q , and dicator E[Cm,q m∈Ψs 1 + P m∈Ψf 1 = ψ, we have
2
E ∥Θ∥
i∈Nm,q
2σ 2 ∥∇F (wt )∥ + ψL
2
ψ−
Q M Y X X
i aim,q Em,q
.
m=1 q=0 i∈Nm,q
(40) Since F satisfies the µ-PŁ property, we have 2 ∇F wt ≥ 2µ F wt − F (w∗ ) . Substituting (41) into (40), we have E F wt+1 − F (w∗ ) ≤ J E F wt − F (w∗ ) Q M Y X X 2α2 i aim,q Em,q , ψ− + ψL m=1 q=0
(41)
(42)
Q M Y X X 4 i i ≤ ψ− am,q Em,q ψ m=1 q=0 i∈Nm,q 2 × α2 + σ 2 ∇F wt ,
where PM QQ P 2 µ µ i i J =1− L + 4σ m=1 q=0 i∈Nm,q am,q Em,q ). ψL (ψ − By recursive (42), we have E F wt+1 − F (w∗ ) ≤ J t E F w0 − F (w∗ ) Q M Y X X (43) 1−Jt 2α2 i i + . ψ− am,q Em,q ψL 1 − J m=1 q=0 i∈Nm,q
This completes the proof. R EFERENCES
" Q M Y X X 2 2 i i E ∥Θ∥ ≤ E ψ− am,q Cm,q ψ m=1 q=0 i∈Nm,q #2 q
×
∥∇F (wt )∥2 = E F wt − F (w∗ ) − 2L Q M Y 2 X X 2α i + ψ− aim,q Em,q ψL m=1 q=0
i∈Nm,q
m∈Ψs
≤
Substituting (39) into (34) and subtracting E[F (w∗ )] in both sides, we obtain E F wt+1 − F (w∗ ) ≤ E F wt − F (w∗ ) Q M Y 2 X X ∥∇F (wt )∥ 2 i − + ψ− aim,q Em,q 2L ψL m=1 q=0 i∈Nm,q 2 × α2 + σ 2 ∇F wt
(39)
[1] D. C. Nguyen, M. Ding, P. N. Pathirana, A. Seneviratne, J. Li, and H. Vincent Poor, “Federated learning for internet of things: A comprehensive survey,” IEEE Commun. Surv. Tutor., vol. 23, no. 3, pp. 1622– 1658, Apr. 2021. [2] L. Gao, H. Fu, L. Li, Y. Chen, M. Xu, and C.-Z. Xu, “FedDC: Federated learning with Non-IID data via local drift decoupling and correction,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2022, pp. 10 112–10 121. [3] S. P. Karimireddy, S. Kale, M. Mohri, S. Reddi, S. Stich, and A. T. Suresh, “SCAFFOLD: Stochastic controlled averaging for federated learning,” in Proc. 37th Int. Conf. Mach. Learn. (ICML), 2020, pp. 5132– 5143. [4] G. Ayache, V. Dassari, and S. El Rouayheb, “Walk for learning: A random walk approach for federated learning from heterogeneous data,” IEEE J. Sel. Areas Commun., vol. 41, no. 4, pp. 929–940, Feb. 2023. [5] C. Wang, Z. Wei, L. Liu, Q. Deng, Y. Wu, Y. Niu, Y. Pang, and Z. Feng, “Decentralized federated averaging via random walk,” IEEE Trans. Mob. Comput., pp. 1–18, 2025. [6] M. Chen, Z. Yang, W. Saad, C. Yin, H. V. Poor, and S. Cui, “A joint learning and communications framework for federated learning over wireless networks,” IEEE Trans. Wirel. Commun., vol. 20, no. 1, pp. 269–283, Jan. 2021. [7] P. Zheng, Y. Zhu, Y. Hu, Z. Zhang, and A. Schmeink, “Federated learning in heterogeneous networks with unreliable communication,” IEEE Trans. Wirel. Commun., vol. 23, no. 4, pp. 3823–3838, Apr. 2024.
16
[8] T. Li, A. K. Sahu, M. Zaheer, M. Sanjabi, A. Talwalkar, and V. Smith, “Federated optimization in heterogeneous networks,” in Proc. Mach. Learn. Syst. (MLSys), 2020, pp. 429–450. [9] Y. Sun, L. Shen, S. Chen, L. Ding, and D. Tao, “Dynamic regularized sharpness aware minimization in federated learning: Approaching global consistency and smooth landscape,” in Proc. Int. Conf. Mach. Learn. (ICML), 2023, pp. 32 991–33 013. [10] F. Sattler, K.-R. Müller, and W. Samek, “Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints,” IEEE Trans. Neural Netw. Learn. Syst., vol. 32, no. 8, pp. 3710–3722, Aug. 2021. [11] A. Ghosh, J. Chung, D. Yin, and K. Ramchandran, “An efficient framework for clustered federated learning,” IEEE Trans. Inf. Theory, vol. 68, no. 12, pp. 8076–8091, Dec. 2022. [12] J. Ma, T. Zhou, G. Long, J. Jiang, and C. Zhang, “Structured federated learning through clustered additive modeling,” in Proc. 37th Conf. Adv. Neural Inf. Process. Syst. (NeurIPS), 2023, pp. 43 097–43 107. [13] M. Duan, D. Liu, X. Ji, R. Liu, L. Liang, X. Chen, and Y. Tan, “FedGroup: Efficient federated learning via decomposed similarity-based clustering,” in Proc. IEEE Intl Conf. Parallel Distrib. Process. Appl., Big Data Cloud Comput., Sustain. Comput. Commun., Soc. Comput. Netw., 2021, pp. 228–237. [14] S. Li, F. Qi, Z. Zhang, and C. Xu, “Cross-modal meta consensus for heterogeneous federated learning,” in Proc. 32nd ACM Int. Conf. Multimedia, 2024, pp. 975–984. [15] X. Liu, Y. Deng, A. Nallanathan, and M. Bennis, “Federated learning and meta learning: Approaches, applications, and directions,” IEEE Commun. Surv. Tutor., vol. 26, no. 1, pp. 571–618, Feb. 2024. [16] F. Chen, M. Luo, Z. Dong, Z. Li, and X. He, “Federated meta-learning with fast convergence and efficient communication,” arXiv:1802.07876, 2018. [17] W. Ni, J. Han, and Z. Qin, “Convergence analysis of semi-federated learning with non-iid data,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. Workshops, 2024, pp. 214–218. [18] T. Yoon, S. Shin, S. J. Hwang, and E. Yang, “FedMix: Approximation of mixup under mean augmented federated learning,” in Proc. 9th Int. Conf. Learn. Represent. (ICLR), 2021, pp. 1–19. [19] L. Zhang, L. Shen, L. Ding, D. Tao, and L.-Y. Duan, “Fine-tuning global model via data-free knowledge distillation for non-iid federated learning,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2022, pp. 10 174–10 183. [20] Z. Li, Y. Sun, J. Shao, Y. Mao, J. H. Wang, and J. Zhang, “Feature matching data synthesis for Non-IID federated learning,” IEEE Trans. Mob. Comput., vol. 23, no. 10, pp. 9352–9367, Oct. 2024. [21] A. Triastcyn, M. Reisser, and C. Louizos, “Decentralized learning with random walks and communication-efficient adaptive optimization,” in in Proc. Workshop Federated Learn., Recent Adv. New Challenges (NeurIPS), 2022, pp. 1–30. [22] Q. Pan and Y. Zhu, “Fedwalk: Communication efficient federated unsupervised node embedding with differential privacy,” in Proc. 28th ACM SIGKDD Conf. Knowl. Discov. Data Mining, 2022, pp. 1317–1326. [23] T. Sun, D. Li, and B. Wang, “Adaptive random walk gradient descent for decentralized optimization,” in Proc. 39th Int. Conf. Mach. Learn. (ICML), 2022, pp. 20 790–20 809. [24] Y. Ye, H. Chen, Z. Ma, and M. Xiao, “Decentralized consensus optimization based on parallel random walk,” IEEE Commun. Lett., vol. 24, no. 2, pp. 391–395, Feb. 2019. [25] W. Ni, Y. Liu, Z. Yang, H. Tian, and X. Shen, “Integrating over-the-air federated learning and non-orthogonal multiple access: What role can ris play?” IEEE Trans. Wireless Commun., vol. 21, no. 12, pp. 10 083– 10 099, Dec. 2022. [26] W. Ni, Y. Liu, Z. Yang, H. Tian, and X. Shen, “Federated learning in multi-ris-aided systems,” IEEE Internet Things J., vol. 9, no. 12, pp. 9608–9624, Jun. 2022. [27] M. Chen, H. V. Poor, W. Saad, and S. Cui, “Convergence time optimization for federated learning over wireless networks,” IEEE Trans. Wirel. Commun., vol. 20, no. 4, pp. 2457–2471, Apr. 2021. [28] Y. Liu, B. Zhang, D. Guo, H. Wang, and G. Ding, “Joint precoding design and location optimization in joint communication, sensing and computing of UAV systems,” IEEE Trans. Cogn. Commun. Netw., vol. 10, no. 2, pp. 541–552, Apr. 2024. [29] A. Salari, S. J. Johnson, B. Vucetic, and M. Shirvanimoghaddam, “Rateconvergence tradeoff of federated learning over wireless channels,” IEEE Internet Things J., vol. 10, no. 24, pp. 22 703–22 716, Dec. 2023. [30] L. U. Khan, Y. K. Tun, M. Alsenwi, M. Imran, Z. Han, and C. S. Hong, “A dispersed federated learning framework for 6G-enabled autonomous
driving cars,” IEEE Trans. Netw. Sci. Eng., vol. 11, no. 6, pp. 5656–5667, Nov.-Dec. 2024. [31] J. Ren, W. Ni, and H. Tian, “Toward communication-learning tradeoff for federated learning at the network edge,” IEEE Commun. Lett., vol. 26, no. 8, pp. 1858–1862, Aug. 2022. [32] J. Song and M. Kountouris, “Wireless distributed edge learning: How many edge devices do we need?” IEEE J. Sel. Areas Commun., vol. 39, no. 7, pp. 2120–2134, Jul. 2021. [33] A. Motamedi, S. Yun, J.-M. Kang, Y. Ge, and I.-M. Kim, “Redundancy management in federated learning for fast communication,” IEEE Trans. Commun., vol. 71, no. 11, pp. 6332–6347, Nov. 2023. [34] A. Razi, F. Afghah, and A. Abedi, “Channel-adaptive packetization policy for minimal latency and maximal energy efficiency,” IEEE Trans. Wirel. Commun., vol. 15, no. 3, pp. 2407–2420, Mar. 2016. [35] K. Huang, W. Liu, Y. Li, A. Savkin, and B. Vucetic, “Wireless feedback control with variable packet length for industrial IoT,” IEEE Wirel. Commun. Lett., vol. 9, no. 9, pp. 1586–1590, Sep. 2020. [36] C. Zhao, B. Tang, Y. Huang, and H. Fu, “Multilayer joint optimization of packet size and adaptive transmission scheduling of wireless sensor networks for mechanical vibration monitoring,” IEEE Internet Things J., vol. 10, no. 7, pp. 6444–6455, Apr. 2023. [37] S. Samarakoon, M. Bennis, W. Saad, and M. Debbah, “Distributed federated learning for ultra-reliable low-latency vehicular communications,” IEEE Trans. Commun., vol. 68, no. 2, pp. 1146–1159, Feb. 2020. [38] M. Alishahi, P. Fortier, W. Hao, X. Li, and M. Zeng, “Energy minimization for wireless-powered federated learning network with NOMA,” IEEE Wireless Commun. Lett., vol. 12, no. 5, pp. 833–837, May 2023. [39] A. Elgabli, J. Park, C. B. Issaid, and M. Bennis, “Harnessing wireless channels for scalable and privacy-preserving federated learning,” IEEE Trans. Commun., vol. 69, no. 8, pp. 5194–5208, Aug. 2021. [40] S. Hu, X. Yuan, W. Ni, X. Wang, E. Hossain, and H. Vincent Poor, “OFDMA-F²L: Federated learning with flexible aggregation over an OFDMA air interface,” IEEE Trans. Wirel. Commun., vol. 23, no. 7, pp. 6793–6807, Jul. 2024. [41] H. Ye, L. Liang, and G. Y. Li, “Decentralized federated learning with unreliable communications,” IEEE J. Sel. Topics Signal Process., vol. 16, no. 3, pp. 487–500, Apr. 2022. [42] B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y. Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Proc. 20th Int. Conf. Artif. Intell. Stat. (AISTATS), 2017, pp. 1273–1282. [43] H. T. Nguyen, V. Sehwag, S. Hosseinalipour, C. G. Brinton, M. Chiang, and H. Vincent Poor, “Fast-convergent federated learning,” IEEE J. Sel. Areas Commun., vol. 39, no. 1, pp. 201–218, 2021. [44] C. Qiao, M. Li, Y. Liu, and Z. Tian, “Transitioning from federated learning to quantum federated learning in internet of things: A comprehensive survey,” IEEE Commun. Surv. Tutor., vol. 27, no. 1, pp. 509–545, Feb. 2025. [45] Y. Chen, H. Zhang, N. Fisher, L. Y. Wang, and G. Yin, “Probabilistic perpacket real-time guarantees for wireless networked sensing and control,” IEEE Trans. Ind. Inform., vol. 14, no. 5, pp. 2133–2145, May 2018. [46] H. Li, Z. Xu, G. Taylor, C. Studer, and T. Goldstein, “Visualizing the loss landscape of neural nets,” in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2018, pp. 6389–6399. [47] R. Sun, D. Li, S. Liang, T. Ding, and R. Srikant, “The global landscape of neural networks: An overview,” IEEE Signal Process. Mag., vol. 37, no. 5, pp. 95–108, 2020. [48] S. J. Reddi, Z. Charles, M. Zaheer, Z. Garrett, K. Rush, J. Konečný, S. Kumar, and H. B. McMahan, “Adaptive federated optimization,” in Proc. Int. Conf. Learn. Represent. (ICLR), 2021, pp. 1–38. [49] H. Karimi, J. Nutini, and M. Schmidt, “Linear convergence of gradient and proximal-gradient methods under the polyak-łojasiewicz condition,” in Proc. Joint Eur. Conf. Mach. Learn. Knowl. Discov. Databases, 2016, pp. 795–811. [50] T. Sun, D. Li, and B. Wang, “Decentralized federated averaging,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 4, pp. 4289–4301, 2023. [51] K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv:1409.1556, 2014. [52] K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2016, pp. 770–778. [53] J. Wang, Q. Liu, H. Liang, G. Joshi, and H. V. Poor, “Tackling the objective inconsistency problem in heterogeneous federated optimization,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), 2020, pp. 7611–7623.