NAACA: Training-Free NeuroAuditory Attentive Cognitive Architecture with Oscillatory Working Memory for Salience-Driven Attention Gating
Zhongju Yuan 1 Geraint Wiggins 2 3 Dick Botteldooren 1
arXiv:2605.13651v1 [cs.SD] 13 May 2026
Abstract
narrow classification, but face a critical pre-attentive bottleneck in real-time long-form analysis. Unlike biological hearing, which instinctively filters stable background soundscapes to prioritize salient stimuli, transformer-based ALMs allocate attention inefficiently over long contexts. When applied to long audio streams, ALM based inference can miss rare but critical events that occur late in the recording, because model focus is dominated by earlier or persistent background patterns, an effect we refer to as attention dilution. Fig. 1 illustrates this failure mode on a representative example. While exhaustive processing of short segments could recover these scene subsets, the computational cost is prohibitive for continuous monitoring. Consequently, a fundamental trade-off arises between perceptual saliency recall and computational efficiency.
Audio provides critical situational cues, yet current Audio Language Models (ALMs) face an attention bottleneck in long-form recordings where dominant background patterns can dilute rare, salient events. We introduce NAACA, a training-free NeuroAuditory Attentive Cognitive Architecture that reframes attention allocation as an auditory salience filtering problem. At its core is OWM, a neuro-inspired Oscillatory Working Memory that maintains stable attractor-like states and triggers higher-cognition ALM processing only when adaptive energy fluctuations signal perceptual salience, triggering higher-level reasoning. On XD-Violence, NAACA improves AudioQwen’s average precision (AP) from 53.50% to 70.60% while reducing unnecessary ALM invocations. Furthermore, qualitative case studies on the Urban Soundscapes of the World (USoW) dataset show that OWM captures novel events and subcategory shifts while remaining robust to transient pauses and ambient urban noise. The source code is available at https://github.com/zjyuan1208/ NAACA-Oscillatory-Working-Memory.
We address this trade-off by drawing inspiration from cognitive neuroscience, where selective attention mechanisms prioritize salient stimuli while filtering stable backgrounds. In auditory neuroscience, salience refers to unexpected or behaviorally relevant stimuli (Corbetta & Shulman, 2002; Kayser et al., 2005). Crucially, salience is not loudness: it corresponds to context changes requiring internal updates (Friston, 2009), while stable backgrounds should be maintained without consuming attention (Winkler et al., 2009). Salient events are thus those warranting increased ALM focus. Building on this salience framework, we reformulate longform processing as Salience-Driven Attention Gating, an online segment selection policy that routes salient audio regions to the ALM. Rather than processing every window, we detect when the auditory pattern shifts in a salient manner and selectively invoke ALM reasoning only for those segments. This approach is critical for deployment, where offline training is prohibitive and data streams are unlabeled and non-stationary (Wan et al., 2024; Chan et al., 2025). Existing approaches, statistical detectors (Rabanser et al., 2019; Chan et al., 2025) and representation-based methods (Wan et al., 2024), require long-term historical data and substantial overhead.
1. Introduction Audio provides critical situational cues when vision is degraded or unavailable, enabling detection of abnormal events in public spaces such as distress calls, fights, or sudden crowd escalation, while also supporting acoustic monitoring in natural environments, where shifts in soundscapes can indicate biodiversity changes. Recent Audio Language Models (ALMs) have advanced audio understanding beyond 1 WAVES Research Group, Ghent University, Gent, Belgium AI Lab, Vrije Universiteit Brussel, Brussel, Belgium 3 EECS, Queen Mary University of London, London, UK. Correspondence to: Zhongju Yuan <[email protected]>. 2
To avoid the long-term historical data and substantial overhead required by existing methods, we draw inspiration from biological working memory. Working memory is sup-
Proceedings of the 43 rd International Conference on Machine Learning, Seoul, South Korea. PMLR 306, 2026. Copyright 2026 by the author(s).
1
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
are forwarded to an ALM for semantic interpretation. This enables operation without offline training while improving long-context reasoning by prioritizing salient transitions. On XD-Violence, our gating improves AudioQwen for 17.10 percentage points in AP while substantially reducing ALM invocations. Our contributions are:
Assume that you are a human in a public place, can you describe what sounds do you hear? I hear the sound of a river flowing and people talking in the background.
• Neuroscience-Inspired Gating: We formalize the ALM accuracy–cost trade-off and address it via salience-driven gating.
I hear the sound of bagpipes playing in the distance.
• Oscillatory Working Memory: A bio-inspired module with optimized wave dynamics for training-free, adaptive saliency filtering.
I hear people talking, the sound of wind, and the distant sound of a bagpipe being played.
• Performance: 70.60% AP with near 40% cost reduction and interpretable, neurally-plausible dynamics.
I hear the sound of people talking in the background and the sound of rain falling.
Conflict of Interest Disclosure. The authors declare that they have no financial conflicts of interest related to this work.
I hear the sound of a bagpipe being played in the distance. People are talking and laughing in the background. The wind is blowing and the sound of the waves can be heard in the distance.
2. Methods
Figure 1. ALM attention failure and context limitations in longform audio. Top: Mel-spectrogram of sample R0056 (USoW) with three salient scenes: birdsong (blue), increased fountain noise (yellow), and bagpipe onset (red). Middle: Direct inference on the full 60s clip (partitioned into 15s segments) omits the terminal bagpipe event, illustrating context-length bottleneck. Bottom: Varying context lengths and ordering. Trailing windows (15s– 45s) recover different scene subsets; moving the final 15s to the front (reordered 60s) recovers the bagpipe, confirming temporalattention decay in the Audio-LLM.
2.1. NeuroAuditory Attentive Cognitive Architecture (NAACA) Our framework follows a multi-stage processing pipeline (Fig. 2 and Algorithm C.1). Incoming audio streams are segmented into short, overlapping windows xt , which are encoded into auditory object category probability vectors pt = Enc(xt ) by a pretrained encoder Enc(·). These probabilities are transformed into oscillatory drive signals through a predefined modulator. Specifically, each probability dimension is assigned a unique carrier frequency, represented as a sine wave, while the corresponding probability value modulates its amplitude. As illustrated in Fig. 2, Enc(·) produces sound-category probability vectors across sliding windows, which are then mapped to their respective sinusoidal drive signals at distinct frequencies. Formally, the modulated source term for auditory object category i is
ported by attractor-like neural states enabling stable maintenance while remaining sensitive to deviations requiring updates (Brennan & Proekt, 2023). Oscillatory dynamics link to attention and memory control, suggesting salience emerges from state transitions rather than learned classification (Lundqvist et al., 2018). Concretely, we propose OWM (Oscillatory Working Memory), a bio-inspired module integrating frequencyselective oscillatory inputs from pretrained audio representations, maintaining stable internal states as attractor-like memory items, and identifying saliency by comparing energy fluctuations to an adaptive threshold. Building on OWM, we propose NAACA, a NeuroAuditory Attentive Architecture performing training-free online saliency gating for ALMs. As shown in Fig. 2, we process audio in sliding windows and convert each window into auditory object probability sequences, which drive frequency selective oscillatory inputs on the OWM grids. OWM maintains stable representations and triggers attentional focus when energy exceeds an adaptive threshold; detected segments
Si (x, t) = ai (t) sin(ωi t) 1Ωi (x), ωi = 2πfi , ai (t) ∈ [0, 1],
(1)
where ai (t) denotes the instantaneous amplitude given by the encoder probability for category i at time t, fi is the carrier frequency assigned to category i((assignment details in Appendix B)), and ωi = 2πfi . Ωi ⊂ {1, . . . , G} × {1, . . . , G} is the spatial parcel on a G × G OWM lattice to which the i-th probability dimension pt [i] injects an oscillatory drive, and 1Ωi (x) restricts the forcing to that region. Here x abbreviates the 2D lattice coordinate (x, y); Eq. (1) is the compact notation of the full coordinate-wise form 2
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
𝑝 𝑣! 𝑣" Energy Calculator Higher Cognition
Adaptive Threshold
OWM
Encoder Audio
Event
Prob (4s)
speech
0.1, 0.2, 0.01, 0.2, 0.1
traffic
0.4, 0.3, 0.2, 0.1, 0.01
…
…
music
0.5, 0.2, 0.1, 0.05, 0.15
Modulator
Figure 2. Overview of the NAACA (NeuroAuditory Attentive Cognitive Architecture). Audio is segmented into sliding windows and mapped by a pretrained encoder to auditory object probability trajectories, which drive frequency-specific oscillatory inputs on OWM grids. OWM is a 2D neural network with primary (p) and velocity (v) neurons, parameterized by wave propagation speed c and damping k, where c follows a stripe-shaped binary pattern (dark/light blue). A gate-opening decision is made from OWM energy fluctuations relative to an adaptive threshold, and salient audio segments are routed to a higher-level cognition module for semantic interpretation.
2.2. OWM Formulation
in Eq. (B.13). Importantly, Eq. (1) only defines the input; wave-like propagation is produced by the OWM recurrent dynamics introduced next, where spatial coupling terms (via ∇p and ∇· v) allow activity induced in Ωi to spread and interact across the grid under damping and wave propagation speed parameters. In this driven–damped setting, Ωi serves as a consistent locus of excitation and can yield attractorlike category-specific spatiotemporal patterns (e.g., resonant responses) determined by the OWM dynamics rather than by the mapping alone.
OWM is a 2D recurrent field model defined on a G × G lattice, where G denotes the grid resolution. Its hidden state at time t consists of a primary pressure-like field p(x, y, t) and a velocity-like field v(x, y, t) = (vx (x, y, t), vy (x, y, t)) at lattice coordinate (x, y). The pressure field stores the current auditory memory state, while v mediates directional flow between neighboring locations. The update combines (i) temporal recurrence through the previous state for memory and (ii) spatial recurrence through a structured operator A(·) for lateral propagation. The wave propagation speed c(x, y) and damping coefficients k p (x, y) and k v (x, y) control, respectively, spatial coupling and dissipation. This bioinspired design is analogous to membrane-potential storage (p) and axonal/dendritic transport (v) in cortical sheet.
We monitor changes in the OWM system energy against an adaptive saliency threshold Tadapt . The OWM system energy is defined as the sum of the square of each neuron value at each time step ∆t. The Tadapt is computed using an energy-based approach:
In our implementation, the pretrained PANN encoder outputs C = 527 category probabilities. Category i ∈ {0, . . . , C − 1} is assigned a carrier frequency fi and spatial parcel Ωi on the 64 × 64 lattice; its probability ai (t) drives Ωi through Eq. (1). We set
Tadapt = µ + 2σ 1 + α · trend ,
where µ and σ are the running mean and standard deviation of energy-derived drift metrics over a sliding window of W = 20 samples, and the trend factor adjusts for temporal patterns in the data. The final detection decision employs persistence filtering to ensure robust salience detection while minimizing false positives, after which the detected segments are forwarded to a higher-level cognitive module for semantic interpretation. The whole procession is shown in Algorithm C.2.
fmax − fmin , C −1 p tan(πfi ∆t) (1 + ∆tk p )(1 + ∆tk v ) √ ci = , ∆t 2
fi = fmin + i
(2)
where fmin = 51 Hz, fmax = 1200 Hz, ∆t = 0.01 s, p v dx = 1, and P k = k = 10. The spatial speed field is c(x, y) = i ci 1Ωi (x, y), with 1Ωi denoting the parcel 3
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
indicator; Appendix B gives the full derivation.
where the phase delay is determined by input-resonance mismatch: ωi − ωres (x, y) τi (x, y) ∝ arctan , (6) k p (x, y) + k v (x, y)
The parcel allocation is deterministic rather than learned. We enumerate the G2 = 4096 lattice cells in row-major order and divide them across C = 527 PANN categories as evenly as possible: the first G2 mod C = 407 parcels contain eight cells, and the remaining parcels contain seven cells. This mapping gives each category a stable injection locus while avoiding any target-task optimization. Although the row-major assignment is simple, salience detection is computed from the global energy E(t) rather than from local category neighborhoods alone; therefore any substantial change in the encoder probability vector can produce a global energy transient. The striped wave-speed field further amplifies such transients through modal coupling, so the method does not require a learned semantic geometry. If a different encoder with C ′ output dimensions is used, only the deterministic frequency and parcel assignment needs to be recomputed.
with ωres (x, y) the local resonance frequency, Ai (x, y) the amplitude response, and τi (x, y) the temporal phase delay at location (x, y) for input frequency ωi . This establishes frequency selectivity via phase: different frequencies produce distinct phase delays, enabling spatial encoding of spectral content. Proof. See Appendix D. System Energy Measurement. Different spatial locations within the OWM lattice are associated with distinct attractors corresponding to specific sound event categories, enabling the system to localize and track the perceptual saliency of diverse auditory sources. Since each event is characterized by its own modulatory input frequency, the local wave propagation speed c(x, y) must also vary across space. This spatial dependence ensures that the eigenfrequency structure reflects the diversity of sound-driven dynamics in the system.
2.2.1. C ONSTRUCTING THE STRUCTURED SPATIAL OPERATOR A(·) OF OWM Wave System Foundations. We consider the OWM as a two-dimensional oscillatory system governed by a damped wave equation in the first-order velocity–pressure formulation: ∂p + k p (x, y) p = −c2 (x, y) ∇ · v + S(x, y, t), ∂t (3) ∂v + k v (x, y) v = −∇p, ∂t where c(x, y) is the spatially varying wave propagation speed (time-independent), k p (x, y) and k v (x, y) are pressure and velocity damping coefficients (time-independent), and S(x, y, t) is given by Eq. 1, and ∇ = [∂/∂x, ∂/∂y]T is the gradient operator, and ∇ · v = ∂vx /∂x + ∂vy /∂y is the divergence operator.
However, while local eigenmodes are essential for modeling event-specific resonances, pattern drift detection and memory-related computations require more than analyzing these modes in isolation. Instead, the collective behavior of the system must be captured in terms of a global state variable. To this end, we define the total system energy, which aggregates pressure and velocity contributions across the lattice. This energy-based representation not only reflects the ongoing dynamics of the OWM but also forms the key computational signal for detection and optimality analysis. The total energy of the OWM system in discrete form is E(t) =
Discretizing Eqs. 3 over a two-dimensional lattice yields: p(x, y, t + ∆t) = 1 − ∆t kp (x, y) p(x, y, t)
1 X 2 2 2 p (t) + vx,i,j (t) + vy,i,j (t) , 2 i,j i,j
(7)
where the terms correspond to kinetic energy due to coupling, potential energy due to stiffness. For the purpose of analyzing and designing the internal structure and parameters, we approximate the 2D lattice as a continuous medium. The energy then becomes RR 1 2 2 2 E(t) = 2 p (x, y, t) + vx (x, y, t) + vy (x, y, t) dxdy, (8) which will be used in the following calculations and theorem proofs as the basis for sensitivity and optimality analyses.
− ∆t c2 (x, y) ∇ · v(x, y, t) + ∆t S(x, y, t), v(x, y, t + ∆t) = 1 − ∆t kv (x, y) v(x, y, t) − ∆t ∇p(x, y, t). (4)
where ∆t is the time step. This discrete update system exhibits frequency-selective response through spatial phase differentiation, as characterized by Theorem 2.1. Theorem 2.1 (Frequency-Selective Phase Response). UnP der multi-frequency excitation S(x, y, t) = i Si (x, y, t) with components at frequencies {ωi }, the steady-state pressure field exhibits frequency-dependent phase delay: X p(x, y, t) ≈ Ai (x, y) Si (x, y, t − τi (x, y)), (5)
2.2.2. T OPOLOGICAL O RGANIZATION WITH H IGH S ENSITIVITY TO S ALIENCE To analyze the role of topological organization and its sensitivity to drift, we first reformulate the governing first-order
i
4
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
3. Experiment
velocity–pressure system in a more compact representation in Theorem 2.2. This reformulation exposes the effective damping and restoring mechanisms and serves as a foundation for later connecting topological behavior with energy dynamics. Theorem 2.2 (Equivalence of First-Order System to Second-Order Damped Wave Equation). The first-order pressure-velocity system Eqs. 3 is equivalent to the secondorder damped wave equation
Dataset. We evaluate NAACA using XD-Violence (Wu et al., 2020) and Urban Soundscapes of the World (USoW) (De Coensel et al., 2023; 2017). For the multimodal XD-Violence dataset, we utilize only the audio track to benchmark our auditory drift detection. As NAACA is training-free, we evaluate exclusively on the 500-sample test set, leveraging its high-granularity, frame-level labels to assess temporal boundary precision. To complement the ∂2p ∂ ∂p v p stylized movie audio of XD-Violence, we use USoW to sim2 v 2 v +γ +k k ·p = ∇·(c ∇p)+(k v+∇p)·∇c + k + S, ∂t2 ∂t ∂t ulate real-world surveillance. USoW provides unlabeled, (9) high-quality 4-channel ambisonics of stable urban environwith effective damping coefficient γ = k p + k v , restoring ments punctuated by rare events. This serves as our primary force coefficient µ = k v k p , and modified source term Seff = benchmark for qualitative analysis, demonstrating OWM’s (k v +∂/∂t)S. The term (k v v+∇p)·∇c2 represents spatial robustness against ambient noise and its interpretability in coupling from wave speed variation. detecting meaningful sonic shifts. Proof. See Appendix E. Measurements. We evaluate our framework using a mix Building on this structural equivalence, we next derive the of ground-truth metrics and efficiency proxies. For XDexplicit energy evolution law, which highlights how the Violence, we utilize frame-level annotations to report Avwave propagation speed c governs energy redistribution and erage Precision (AP), assessing the global ability to disthereby influences stability and drift sensitivity. tinguish violent anomalies from background noise. We Theorem 2.3 (Energy Evolution). When p(x, y, t) and also report frame-level temporal precision, defined as the vx , vy are governed by Eqs. 3 under periodic boundaries. fraction of OWM drift points that coincide with annotated The energy evolution is given by salient event frames. To measure the practical utility of RR dE p 2 v 2 2 our attention-gating across both datasets, we define Compu= [pS −k p −k |v| −(c −1)p∇·v] dxdy. (10) dt tational Time Saved. This metric quantifies the reduction Proof. See Appendix F. in inference overhead achieved by invoking the ALM only RR pS dx dy in Eq. (10) governs detecThe injection term at detected drift points versus exhaustive, continuous protion sensitivity. To maximize sensitivity, c(x, y) must crecessing. By reporting the fraction of detected drifts and ate frequency-selective spatial differentiation where differvisualizing the OWM’s internal energy states, we demonent auditory events drive spatially distinct activity patterns strate the architecture’s ability to capture salient shifts while through varying local resonance frequencies (Lakatos et al., minimizing the computational burden of long-form audio 2016), while enabling coherent coupling between slow mainunderstanding. tenance dynamics and fast encoding transients (Lundqvist Baselines. We evaluate our framework against four cateet al., 2018). A striped structure c(x, y) = c(y) with Bragggories: (i) Exhaustive ALM Inference, an internal ablation matched periodicity (Kushwaha et al., 1993) achieves both where AudioQwen processes the full stream without gating objectives: coherent reflections create slow-propagating to isolate the efficiency gains of our mechanism; (ii) Ranmodes supporting maintenance oscillations, which interdom 4 s Segment Selection, which randomly forwards the act with encoding transients via phase-dependent energy same number of 4 s segments as NAACA to separate the injection (Lundqvist et al., 2018). benefit of shorter inputs from the benefit of OWM-based Theorem 2.4 (Striped Pattern Optimality). Under ampliselection; (iii) Supervised audio-only models, including HLtude constraint |δc2 | ≤ A, the Bragg-resonant striped Net (Wu et al., 2020) and AVadCLIP (Wu et al., 2025); and square wave δc2 (x, y) = A · sgn[cos(2πq0 y/Ly )] maxi(iv) Video-only frameworks, covering supervised models mizes modal coupling strength |C(m,n),(m,n+q0 ) | and spasuch as S3R (Wu et al., 2022), VadCLIP (Wu et al., 2024) tial frequency differentiation for salience detection at mode and Holmes-VAU (Zhang et al., 2025), as well as zero-shot separation q0 . approaches like TRACE (Siddiqui et al., 2025). Crucially, unlike our training-free approach, these baseline models reProof. See Appendix G.4. quire domain-specific fine-tuning, extra training on domain The Bragg-matched structure supports multi-timescale dyknowledge, or auxiliary attention fusion layers. namics through slow-propagating coherent modes, enabling Implementation Details. Audio is processed in 4 s wininteractions between maintenance and encoding processes dows using PANN (Kong et al., 2020) features (527 classes). analogous to cross-frequency coupling in neural working OWM uses a 64 × 64 grid with ∆t = 0.01, kp = kv = 10, memory (Lundqvist et al., 2018). 5
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
carrier frequencies from 51–1200 Hz, and striped c(y) ∈ [0.1, 70] from Theorem 2.1. AudioQwen (Chu et al., 2023) provides semantic interpretation. Full details in Appendix B.
bution of OWM is larger. In addition, OWM drift points coincide with frame-level ground-truth timestamps at 61.1%, showing that the selected segments are temporally aligned with annotated salient events rather than merely reducing input length.
4. Results and Discussion
Notably, our training-free approach significantly outperforms supervised audio-only models like AVadCLIP (52.51% AP) and HL-Net (60.50% AP). While video-based methods like TRACE show strong results (83.67% AP), it is important to note that TRACE is not a pure zero-shot solution in the same sense as our framework; despite being marked as zero-shot in Table 1, it relies heavily on the training of an additional temporal encoder and a cross-attention fusion layer, which we consider a form of domain adaptation. In contrast, our framework provides a specialized, training-free solution for scenarios where visual data is unavailable or where computational resources preclude the training of auxiliary fusion modules.
4.1. Quantitative Evaluation on XD-Violence Performance Success. The primary goal of our framework is to achieve competitive audio-only performance using general-purpose models without the need for expensive training from scratch or domain-specific fine-tuning. Taskspecific models often incur prohibitive costs in data collection and labeling, and video-based systems are frequently limited by environmental factors such as poor lighting or occlusions; in contrast, audio-based models offer a more resilient alternative that is less sensitive to such conditions. Table 1. Average Precision (AP) on XD-Violence, grouped by baseline type.
Method Audio Qwen Random 4 s
✓
HL-Net† AVadCLIP†
Audio Audio
53.50 60.44
✓ ✓
Audio Audio
60.50 52.51
S3R∗ VadCLIP∗ Holmes-VAU∗
✓ ✓ ✓
Video Video Video
80.26 84.51 87.68
Zero-shot CLIP∗ TRACE†
✓
✓ ✓
Video Video
17.83 83.67
✓
Audio
70.60
NAACA
The Audio-Video Gap (Failure Case Analysis). Despite NAACA’s competitive performance, a gap remains between audio-only frameworks and supervised video models. As illustrated in the confusion matrix in Fig. 3, this performance ceiling is largely attributable to inherent acoustic ambiguity and dataset constraints. The Abuse category suffers the highest misclassification, with 45.0% of cases identified as Fighting. This is primarily due to the extreme scarcity of data—comprising only 11 samples—and the high semantic overlap of acoustic cues like shouting. Similarly, Shooting exhibits a 19.0% confusion rate with Fighting. These events frequently co-occur in real-world scenarios, and without visual cues to identify firearms, the model defaults to the broader acoustic signature of a physical altercation. Furthermore, categories such as Explosions and Car Accidents rely heavily on visual markers like fire or debris for definitive classification. While 14.7% of Fighting samples are missed entirely (appearing in the None/Miss category), only 0.7% are confused with Explosions, though sudden, high-energy acoustic transients from both categories can be acoustically similar without visual context.
Training Zero-shot Modality AP (%) ✓
∗
Results reported in Holmes-VAU paper. † Results reported in their respective papers.
As shown in Table 1, we utilize Audio Qwen as our operational baseline for classifying the audio stream. While video-only models generally outperform audio-only models on the XD-Violence task due to the explicit visual cues available in action-movie-style data, our results demonstrate that audio remains a highly informative modality when processed correctly.
4.2. Qualitative Case Study on USoW To qualitatively assess the behavior of our framework, we highlight three illustrative cases of auditory pattern drift. Specifically, we consider: (1) the detection of salient novel events that shifts the auditory context, (2) robustness to transient silences or pauses in ongoing sound streams, and (3) sensitivity to subcategory-level substitutions within a broader sound category (e.g., different types of musical instruments within the “music” class). These cases provide concrete insights into how the OWM detects and distinguishes different forms of drift beyond low-level acoustic fluctuations.
Our NAACA achieves an AP of 70.60%. This represents a substantial 17.1% absolute improvement over the baseline Audio Qwen (53.50% AP). To separate the effect of shorter inputs from the effect of OWM-based saliency selection, we additionally evaluate a random 4 s segment baseline that forwards the same number of segments as NAACA. This random baseline reaches 60.44% AP, indicating that shorter inputs account for a 6.94% gain over exhaustive inference, while OWM selection contributes an additional 10.16% AP. Thus, both effects are beneficial, but the selective contri6
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating B1 Fighting
0.0
10.3
7.4
2.2
0.7
14.7
B2 Shooting
19.0
40.1
4.8
4.1
9.5
12.9
9.5
B4 Riot
6.2
3.5
72.6
5.3
2.7
4.4
5.3
45.0
0.0
10.0
5.0
15.0
20.0
5.0
5.2
1.7
1.7
1.7
73.0
6.1
10.4
G B6 Explosion Car Accident
80
60 Percentage (%)
Ground Truth Label
64.7
B5 Abuse
100
(a) R0002 (Place d’Armes, Montreal): Car engine onset at 53 s; OWM p-field activation near (30, 52).
40
20
6.2
1.8
0.9
3.5
9.7
66.4
11.5
B1 Fighting
B2 Shooting
B4 Riot
B5 B6 G Abuse Car Accident Explosion
Miss
0
Predicted Label
Figure 3. Confusion matrix on the XD-Violence test set audio track. Significant overlaps between Abuse, Shooting, and Fighting reflect acoustic ambiguities and event co-occurrence. The misclassification of Fighting as Explosions highlights the reliance on visual cues for high-energy transient events.
(b) R0056 (Alexanderplatz, Berlin): Bagpipe onset at 49 s; OWM p-field activation near (25, 22). Figure 4. OWM detection of novel events. Mel-spectrograms with car engine (a) and bagpipe (b) onsets. OWM outputs (cyan = energy change, red = adaptive threshold, p-field states shown). Vertical dashed lines mark detected drifts.
4.2.1. D ETECTION OF S ALIENT N OVEL E VENTS We illustrate this case with two representative recordings in which the most salient novel event occurs near the end of the segment. In both recordings, the background soundscape is relatively stable: the Montreal recording features continuous traffic flow and bird chirping, while the Berlin recording contains crowd conversations, birds, and fountain noise. This provides a clear contrast when a new source emerges late in the sequence, allowing us to assess how well each method captures such onsets.
(a) R0037 (Johnston Road, Hong Kong): A baby cry with short pauses. OWM registers one event at 33 s.
As shown in Fig. 4, OWM detects late-arriving novel events with high precision. The p-field concentrates energy near the true change point (e.g., Example R0002, Fig. 4a), distinguishing genuine onsets from background variability. 4.2.2. ROBUSTNESS TO T RANSIENT PAUSES We next consider recordings where the salient sound events include natural pauses or interruptions. Such cases are challenging because detectors may mistake short gaps within an ongoing event for the onset of new events. The first recording (Fig. 5a) was captured in a dense traffic environment, while the second (Fig. 5b) comes from a lively public square during a music festival. In both recordings, prominent sources exhibit intermittent activity, providing a useful testbed for evaluating robustness to transient pauses.
(b) R0016 (Quincy Market, Boston): Festival scene with speech followed by applause. OWM yields a single detection. Figure 5. OWM is robust to transient pauses. Mel-spectrogram of OWM output. Vertical dashed lines mark detected drifts: cyan indicates energy change, and red indicates the adaptive threshold.
short silences within the same salient event. This demonstrates its ability to maintain a stable event representation and avoid over-segmentation despite transient pauses in the acoustic signal.
As shown in Fig. 5, OWM successfully identifies the main events while maintaining stability through spectral fluctuations. In Example R0016, OWM effectively consolidates 7
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating Before Drift (Steps 33-43s)
4.2.3. S UBCATEGORY T RANSITION S ENSITIVITY
After Drift (Steps 43-53s)
50
60
40
30
30
20 20
10
10
0
0
10
20
30
Grid X
40
50
60
Peak Frequency (Hz)
Grid Y
40
40
50
Peak Frequency (Hz)
50
Grid Y
We further analyze cases where acoustic variation arises within a subcategory of ongoing sounds rather than from the introduction of a completely new source. In this example (Fig. 6), recorded in Square Phillips (Montreal), the background consists of street traffic mixed with music containing two main instruments: a hi-hat at higher frequencies and a slower kick drum. The interplay of these instruments produces several subcategory-level shifts.
50
60
40
30
30
20 20
10
10
0
0
0
10
20
30
Grid X
40
50
60
0
(a) Example R0016 (drift around 43 s)
Before Drift (Steps 37-47s)
After Drift (Steps 47-57s)
50
60
40
30
30
20 20
10
10
0
10
20
30
Grid X
40
50
60
0
Grid Y
Grid Y
40
40
50
Peak Frequency (Hz)
50
0
50
60
Peak Frequency (Hz)
Specifically, the hi-hat drops out at 21 s, leaving only the kick drum; it reappears at 32 s and pauses again at 38 s. OWM successfully detects each of these subtle transitions, capturing the precise moments of instrument entry and exit. At 42 s, a distinct car horn emerges, which OWM identifies as a salient novel source. These results demonstrate OWM’s ability to capture fine-grained subcategory-level drift while simultaneously maintaining high sensitivity to distinct novel events.
40
30
30
20 20
10
10
0
0
10
20
30
Grid X
40
50
60
0
(b) Example R0056 (drift around 47 s) Figure 7. Temporal frequency analysis around drift detection events. Frequency distributions in active p neurons during 10 s before (left) and after (right) drift onset. Only neurons above the 75th percentile activity threshold are shown.
shifted toward γ-band activity (30–50 Hz), reflecting rapid encoding of salient auditory input (applause, cheering). In Example R0056, the post-drift segment with emerging bagpipe sounds showed subsets of neurons entering the γ range, while pronounced β-band oscillations persisted, suggesting mixed maintenance and encoding dynamics. Spatially, both examples exhibited a redistribution of activity: channels along the upper grid boundary (Y=1 row), previously speech-related, showed reduced activity post-drift, whereas deeper clusters (Y ≈ 20) became strongly engaged, consistent with recruiting new resources for encoding applause, cheering, and musical instruments. These patterns underscore that OWM reallocates oscillatory dynamics to novel salient sources rather than sustaining prior speech inputs. Supplementary animations show the real-time evolution of p-field activity for each example.
Figure 6. OWM sensitivity to fine-grained salient transitions (Example R0010, Square Phillips, Montreal). The segment features alternating hi-hat and kick drum patterns, with a distinct car horn at 42 s that OWM detects as a novel event alongside the subcategory drift. Vertical dashed red lines mark detected drift points. The cyan curve represents energy change, the red curve shows the adaptive threshold, and detected events are highlighted at the change points.
4.3. Spectral Analysis of p-field Dynamics via FFT We computed Fast Fourier Transforms (FFTs) of p-field activity, sampling internal states every second to match the sliding window stride (Subsection 3). With dt = 0.01, one second equaled 100 time steps. For each p neuron, we extracted the dominant frequency (maximal FFT amplitude) to construct frequency maps (Fig. 7, Examples R0016 and R0056). To suppress numerical noise, only neurons above the 75th percentile of variance were retained. Additional results appear in Appendix J.
In contrast, α-band activity (8–12 Hz) remained weak with no systematic changes across drift events, precluding confirmation of links between elevated α power and attentional lapses (Lakatos et al., 2016; Kasten et al., 2024). Similarly, θ-band activity (4–8 Hz) was sparse and failed to form robust clusters, despite prior reports of θ entrainment supporting auditory working memory (Albouy et al., 2017; Bonetti et al., 2024).
The analysis revealed spatially clustered oscillatory activity rather than uniform grid activation, with dominant frequencies limited to 0–50 Hz by the Nyquist bound (dt = 0.01 s). Distinct frequency bands aligned with canonical neural regimes: during stable background periods, both examples exhibited sustained β-band activity (15–30 Hz), consistent with its theorized role in working memory maintenance (Lundqvist et al., 2018). After drift onset, Example R0016
In sum, the OWM reallocates frequency-specific oscillatory clusters, similar to cortical γ-band encoding and β-band 8
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
mainly set by the 1s encoder stride, with the persistence filter adding only a small delay in the worst case; the subsequent ALM runtime is model- and hardware-dependent. Thus, NAACA should be interpreted as reducing unnecessary ALM invocations and forwarded audio duration, not as changing the intrinsic inference speed of the ALM itself. The high Time Sent Ratio observed for acoustically complex clips is also desirable: the system does not impose a fixed compression budget, but preserves more context when salient transitions occur frequently.
Datasets
XD-Violence USoW
1.0
Time Sent Ratio
0.8
0.6
0.4
0.2
0.0
XD-Violence (N=500) Mean: 0.632 Median: 0.597 Q1-Q3: 0.481-0.740
USoW (N=133) Mean: 0.644 Median: 0.650 Q1-Q3: 0.500-0.750
XD-Violence
USoW
5. Conclusion We introduced NAACA, a neuro-inspired framework for ALM understanding enhancement, with OWM as its core working-memory component. Our approach combines a wave-based recurrent field model with an energy-driven drift detection mechanism that adaptively reallocates attention without long-term historical data or offline pretraining. We proved that binary and striped wave-speed distributions optimize drift sensitivity, and demonstrated through urban soundscape experiments that OWM reliably captures salient novel events, resists transient pauses, and subcategory saliency shifts more effectively than similarity-based baselines. OWM’s oscillatory dynamics align with cortical working memory, underscoring its biological plausibility and interpretability. These results establish OWM as a computationally efficient, neuro-inspired foundation for extending long-context reasoning in multimodal systems.
Figure 8. Time sent ratios for XD-Violence and USoW datasets. Violin plots with box plots and scatter points show the fraction of audio forwarded to the ALM after OWM drift detection. Both datasets exhibit similar distributions (medians: 0.597 and 0.650), demonstrating that NAACA consistently processes only 60% of audio duration, substantially reducing computational cost while preserving detection accuracy.
maintenance, to represent salient auditory transitions within its bio-physical constraints. 4.4. Cognitive Resource Efficiency Deploying ALMs for long-form audio requires balancing accuracy with computational cost. While exhaustive slidingwindow processing addresses attention dilution, it requires 57 ALM invocations per 60 s clip, which is prohibitive for real-time use. NAACA optimizes this via OWM-based gating, forwarding only salient segments. We measure efficiency using the Time Sent Ratio.
Limitations NAACA’s performance is inherently bounded by the capability of the chosen backbone encoder and ALM; stronger pretrained models will directly yield better salience detection and semantic interpretation without any modification to OWM. The current encoder (PANN) is trained on AudioSet categories, so out-of-distribution sound events in specialised domains may be missed or misidentified. The hard-gating interface is efficient for long, information-sparse streams, but may discard boundary context that soft attention or KV-cache modulation could preserve; such variants would require white-box ALM access and are left for future work. Finally, our evaluation focuses on anomaly detection via AP and temporal precision, and future work should include SpeechIQ-style tasks such as audio question answering, instruction following, and multi-turn event summarization to assess whether OWM-gated inputs preserve the context needed for deeper reasoning.
As shown in Fig. 8, median ratios for XD-Violence and USoW are 0.597 and 0.650, respectively. This signifies a 40% reduction in ALM invocations (from ∼57 to ∼34). Notably, this cost reduction is paired with a 17.1% improvement in AP (70.60% vs. 53.50% baseline). By focusing on drift-enriched windows, OWM provides the ALM with contexts where transitions are concentrated, shifting the Pareto frontier of accuracy and efficiency. Scatter points in Fig. 8 demonstrate that NAACA’s cost scales adaptively: ratios near 1.0 indicate high acoustic complexity, while stable soundscapes yield ratios of 0.3– 0.4. This adaptive allocation spends the computational budget proportionally to information density. Despite different acoustic characteristics, OWM maintains stable gating across both datasets, positioning NAACA as a practical solution for resource-constrained monitoring.
Acknowledgment This work was supported by the Special Research Fund (BOF) of Ghent University under Grant BOF/24J/2021/246, and by the Flemish Government through the Flanders AI Re-
For streaming deployment, the gating decision is made online before invoking the ALM, rather than by post-hoc pruning after full-clip inference. The algorithmic latency is 9
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
search programme (Onderzoeksprogramma AI Vlaanderen programme).
Corbetta, M. and Shulman, G. L. Control of goal-directed and stimulus-driven attention in the brain. Nature reviews neuroscience, 3(3):201–215, 2002.
Impact Statement
De Coensel, B., Sun, K., and Botteldooren, D. Urban soundscapes of the world: Selection and reproduction of urban acoustic environments with soundscape in mind. In INTER-NOISE and NOISE-CON Congress and Conference Proceedings, volume 255, pp. 5407–5413. Institute of Noise Control Engineering, 2017.
This paper presents work whose goal is to advance the field of Machine Learning. There are many potential societal consequences of our work, none which we feel must be specifically highlighted here.
References
De Coensel, B., Botteldooren, D., Kang, S., and Van Renterghem, T. Urban soundscapes of the world. zenodo: https://zenodo.org/records/10106181, 2023. doi: 10.5281/zenodo.10106180.
Aggarwal, C. C., Hinneburg, A., and Keim, D. A. On the surprising behavior of distance metrics in high dimensional space. In International conference on database theory, pp. 420–434. Springer, 2001.
Friston, K. The free-energy principle: a rough guide to the brain? Trends in cognitive sciences, 13(7):293–301, 2009.
Albouy, P., Weiss, A., Baillet, S., and Zatorre, R. J. Selective entrainment of theta oscillations in the dorsal stream causally enhances auditory working memory performance. Neuron, 94(1):193–206, 2017.
Greco, S., Vacchetti, B., Apiletti, D., and Cerquitelli, T. Unsupervised concept drift detection from deep learning representations in real-time. IEEE Transactions on Knowledge and Data Engineering, 2025.
Bai, J., Yin, H., Wang, M., Shi, D., Gan, W.-S., Chen, J., and Rahardja, S. Audiolog: Llms-powered long audio logging with hybrid token-semantic contrastive learning. In 2024 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6. IEEE, 2024.
He, B., Li, H., Jang, Y. K., Jia, M., Cao, X., Shah, A., Shrivastava, A., and Lim, S.-N. Ma-lmm: Memoryaugmented large multimodal model for long-term video understanding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13504–13514, 2024.
Beyer, K., Goldstein, J., Ramakrishnan, R., and Shaft, U. When is “nearest neighbor” meaningful? In International conference on database theory, pp. 217–235. Springer, 1999.
Kasten, F. H., Busson, Q., and Zoefel, B. Opposing neural processing modes alternate rhythmically during sustained auditory attention. Communications Biology, 7(1):1125, 2024.
Bonetti, L., Fernández-Rubio, G., Carlomagno, F., Dietz, M., Pantazis, D., Vuust, P., and Kringelbach, M. Spatiotemporal brain hierarchies of auditory memory recognition and predictive coding. Nature Communications, 15(1):4313, 2024.
Kayser, C., Petkov, C. I., Lippert, M., and Logothetis, N. K. Mechanisms for allocating auditory attention: an auditory saliency map. Current biology, 15(21):1943–1947, 2005.
Brennan, C. and Proekt, A. Attractor dynamics with activitydependent plasticity capture human working memory across time scales. Communications psychology, 1(1):28, 2023.
Kong, Q., Cao, Y., Iqbal, T., Wang, Y., Wang, W., and Plumbley, M. D. Panns: Large-scale pretrained audio neural networks for audio pattern recognition. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 28:2880–2894, 2020. doi: 10.1109/TASLP.2020. 3030497.
Chan, T.-H. H., Jiang, S. H.-C., Wu, T., and Zhao, M. Online clustering with nearly optimal consistency. In The Thirteenth International Conference on Learning Representations, 2025. URL https://openreview.net/ forum?id=NA2vUMaMOm.
Kushwaha, M. S., Halevi, P., Dobrzynski, L., and DjafariRouhani, B. Acoustic band structure of periodic elastic composites. Physical review letters, 71(13):2022, 1993.
Chu, Y., Xu, J., Zhou, X., Yang, Q., Zhang, S., Yan, Z., Zhou, C., and Zhou, J. Qwen-audio: Advancing universal audio understanding via unified large-scale audiolanguage models. arXiv preprint arXiv:2311.07919, 2023.
Lakatos, P., Barczak, A., Neymotin, S. A., McGinnis, T., Ross, D., Javitt, D. C., and O’Connell, M. N. Global dynamics of selective attention and its lapses in primary auditory cortex. Nature neuroscience, 19(12):1707–1717, 2016. 10
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
Lundqvist, M., Herman, P., Warden, M. R., Brincat, S. L., and Miller, E. K. Gamma and beta bursts during working memory readout suggest roles in its volitional control. Nature communications, 9(1):394, 2018.
Zhang, H., Xu, X., Wang, X., Zuo, J., Huang, X., Gao, C., Zhang, S., Yu, L., and Sang, N. Holmes-vau: Towards long-term video anomaly understanding at any granularity. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp. 13843–13853, 2025.
Qian, R., Ding, S., Dong, X., Zhang, P., Zang, Y., Cao, Y., Lin, D., and Wang, J. Dispider: Enabling video llms with active real-time interaction via disentangled perception, decision, and reaction. In Proceedings of the Computer Vision and Pattern Recognition Conference, pp. 24045– 24055, 2025. Rabanser, S., Günnemann, S., and Lipton, Z. Failing loudly: An empirical study of methods for detecting dataset shift. Advances in Neural Information Processing Systems, 32, 2019. Siddiqui, Y. A., Usmani, S., Tariq, U., Shamsi, J. A., and Khan, M. B. Traces: Temporal recall with contextual embeddings for real-time video anomaly detection. arXiv preprint arXiv:2511.00580, 2025. Wan, K., Liang, Y., and Yoon, S. Online drift detection with maximum concept discrepancy. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 2924–2935, 2024. Winkler, I., Denham, S. L., and Nelken, I. Modeling the auditory scene: predictive regularity representations and perceptual objects. Trends in cognitive sciences, 13(12): 532–540, 2009. Wu, J.-C., Hsieh, H.-Y., Chen, D.-J., Fuh, C.-S., and Liu, T.-L. Self-supervised sparse representation for video anomaly detection. In European Conference on Computer Vision, pp. 729–745. Springer, 2022. Wu, P., Liu, J., Shi, Y., Sun, Y., Shao, F., Wu, Z., and Yang, Z. Not only look, but also listen: Learning multimodal violence detection under weak supervision. In European conference on computer vision, pp. 322–339. Springer, 2020. Wu, P., Zhou, X., Pang, G., Zhou, L., Yan, Q., Wang, P., and Zhang, Y. Vadclip: Adapting vision-language models for weakly supervised video anomaly detection. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pp. 6074–6082, 2024. Wu, P., Su, W., Pang, G., Sun, Y., Yan, Q., Wang, P., and Zhang, Y. Avadclip: Audio-visual collaboration for robust video anomaly detection. arXiv preprint arXiv:2504.04495, 2025. Wu, X., Lu, H., Li, K., Wu, Z., Liu, X., and Meng, H. Hiformer: Sequence modeling networks with hierarchical attention mechanisms. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31:3993–4003, 2023. 11
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
Appendix A. Related Work Auditory selective attention and temporal pattern drift have been studied both in neuroscience, where oscillatory dynamics are linked to memory and attentional control, and in machine learning, where attention bottlenecks in audio language models (ALMs) constrain long-sequence processing. Insights from neuroscience on tracking behaviorally relevant inputs and adapting to changes over time motivate analogous strategies for ALMs operating on long audio streams. In our setting, we use temporal drift to denote a shift in the audio stream’s statistics or in its task-relevant representations (e.g., embedding or class-probability trajectories) across time. This is closely related to concept drift in machine learning, which refers to changes in the underlying data-generating process that alter the mapping between inputs and the semantics or labels of interest. Thus, detecting temporal drift in representations provides an online, label-free proxy for potential concept drift and can trigger reallocation of limited inference resources. A.1. Oscillatory Dynamics in Memory and Attention One prevailing hypothesis is that working memory is supported by discrete neural activity configurations, often described as attractor states (Brennan & Proekt, 2023). However, attractor dynamics alone may fail to explain working memory across multiple timescales, motivating models that couple attractor-like dynamics with activity-dependent plasticity (Brennan & Proekt, 2023). Within this dynamical view, neural oscillations provide a complementary mechanism for coordinating information maintenance and prioritization over time. Neural oscillations in specific frequency bands have been shown to play a central role in memory, selective attention, and sensitivity to temporal drift. For example, (Lundqvist et al., 2018) demonstrated that working memory tasks involve non-stationary dynamics, with gamma bursts during encoding and beta bursts during maintenance. Similarly, selective entrainment of theta oscillations has been shown to enhance auditory working memory performance (Albouy et al., 2017; Bonetti et al., 2024). In contrast, high alpha-band activity has been associated with increased error rates and reduced auditory attention (Lakatos et al., 2016; Kasten et al., 2024). A.2. Attention Limitations and Concept Drift Detection Inspired by these oscillatory mechanisms, one can view attention in ALMs as a resource that must be selectively and dynamically allocated in response to temporal pattern drift rather than distributed uniformly across the input. Although recent advances in ALMs have enabled significant progress in audio understanding, long-form reasoning remains limited by restricted attention span, motivating efforts to extend context length (Wu et al., 2023; He et al., 2024; Bai et al., 2024). Most existing solutions require retraining or fine-tuning, which is computationally costly and inflexible. A complementary perspective is to frame attention allocation as a drift detection problem, where established methods from the machine learning literature may provide efficient and adaptive alternatives. In real-world audio monitoring, salient events are inherently rare and context dependent, and many of the situations that make them important are only evident at run time. As a result, it is generally impractical to construct exhaustive supervised datasets that cover all relevant foreground events and background conditions, and to train a dedicated detector for each deployment scenario. Instead, the scope can be narrowed by operating in a task-relevant semantic space: a high-dimensional auditory representation learned from large corpora that captures human-recognizable sound structure and supports downstream reasoning. Within this representation space, salience can be operationalized as online distributional change, motivating unsupervised drift detection methods that trigger selective processing without requiring explicit event labels. High-dimensional semantic embedding challenges. Accordingly, our setting calls for online drift detection in semantic audio representations, such as class-probability trajectories or embedding sequences produced by pretrained audio recognition models. By operating in this high-dimensional representation space learned from large corpora, changes in acoustic context manifest as distributional shifts over time, providing a practical signal for unsupervised drift detection without requiring explicit event labels. Naive statistical approaches, such as tracking Euclidean distances from exponential moving averages, face the curse of dimensionality: as dimensions increase, distance metrics lose discriminative power as all points become approximately equidistant (Aggarwal et al., 2001; Beyer et al., 1999). A key difficulty in high-dimensional drift detection is that the same change magnitude can correspond to qualitatively different shifts. For example, consider two consecutive class-probability vectors with identical L2 distance: in one case, probability mass moves coherently between a small set of semantically related classes (e.g., gunshot and explosion); in another case, the same L2 distance arises from small, diffuse fluctuations spread across many unrelated classes. A single threshold on ∥pt+1 − pt ∥2 cannot reliably distinguish these 12
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
cases, motivating drift measures that exploit structure in the semantic space rather than magnitude alone. Historical data and training requirements. Cluster-based approaches (Chan et al., 2025) assume sufficient samples per category to maintain stable cluster statistics, which is unrealistic for heterogeneous urban soundscapes where salient events (e.g., sirens, screams) are rare and unpredictable. MCD-DD (Wan et al., 2024) employs contrastive learning on encoder representations to compute maximum concept discrepancy, but requires maintaining reference distributions from extensive historical windows (typically >100 samples) and incurs significant computational overhead from pairwise similarity computation. DriftLens (Greco et al., 2025) detects drift from deep representations in real time, but assumes an offline instantiation phase that estimates a fixed reference (baseline) embedding distribution and detection thresholds from historical/training-era data. A different setting is training-free stream monitoring, where semantic representations are extracted from pretrained audio encoders but access to encoder training data or a dedicated in-domain reference corpus may be unavailable, making offline baseline construction less straightforward. Deployment constraints. Real-time audio monitoring, such as public safety surveillance or environmental monitoring, imposes strict constraints: (1) No offline training: Systems must operate on new deployments without domain-specific fine-tuning; (2) No big historical buffering: Embedded devices cannot store hours of high-dimensional embeddings; (3) Cold-start capability: Detection must work immediately without warm-up periods; (4) Non-stationary environments: Acoustic distributions evolve (morning traffic → evening crowds), rendering historical baselines obsolete. Table A.1 summarizes these requirements. Our OWM-based approach is designed to satisfy them by maintaining a compact online state via oscillatory dynamics, which summarizes recent context without storing long histories of high-dimensional embeddings. When we describe NAACA as training-free, we mean that the internal network parameters of the fixed pretrained audio encoder, OWM, and ALM are not fine-tuned or updated for the target deployment; the online adaptive threshold is still computed from the streaming signal. No long historical data accumulation refers to not requiring an offline reference corpus or baseline calibration phase prior to monitoring. Table A.1. Requirements comparison of drift detection approaches for audio-semantic streams. Online: Processes streaming data without batch accumulation. No long historical data: Does not require long-term buffering (>50 samples) of past embeddings or statistics. High-dim: Effective on >500 dimensional semantic embeddings without distance concentration issues. Topology-preserving: Maintains structured spatial relationships in semantic representation space, not just raw semantic features. The symbol ∼ indicates partial support or conditional availability depending on configuration parameters.
Method
Online detection
No long historical data
High-dim (>500D)
Topology -preserving
Statistical (EMA/Variance) MCD-DD (Wan et al., 2024) DriftLens (Greco et al., 2025) Cluster-based (Chan et al., 2025)
✓ ✓ ~ ✓
✓ × × ×
× ✓ ✓ ~
× × × ×
OWM (ours)
✓
✓
✓
✓
A.3. Selective Attention in Video-Language Models The challenge of redundant long-context processing is a central theme in recent Video Language Models (VLMs). Dispider (Qian et al., 2025) introduces a disentangled perception framework where a “Decision” module monitors coarse-grained video to proactively trigger a “Reaction” module only during relevant interaction moments. Similarly, Holmes-VAU (Zhang et al., 2025) utilizes an anomaly-focused Temporal Sampler (ATS) that leverages a lightweight detector to generate anomaly scores, allowing the VLM to selectively aggregate salient segments while filtering uninformative background. Functionally, both the Decision module in Dispider and the ATS in Holmes-VAU serve as asynchronous gatekeepers similar to our Oscillatory Working Memory (OWM): they decouple continuous signal monitoring from expensive autoregressive inference to resolve the accuracy-cost trade-off. However, a key distinction lies in the detection mechanism. While the samplers in Dispider and Holmes-VAU typically rely on representation-based or supervised detectors that require dataset-specific training or historical data, our OWM approach operates training-free by maintaining a compact online state via oscillatory dynamics, eliminating the need for long-term historical buffering or offline calibration while achieving comparable or superior detection sensitivity. 13
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
B. Carrier Frequency Assignment B.1. Frequency Allocation Strategy We assign each PANN dimension i ∈ {0, 1, . . . , 526} a distinct carrier frequency fi to enable frequency-multiplexed oscillatory drives within the OWM lattice. The allocation follows a deterministic procedure ensuring compatibility with the discrete wave dynamics. B.1.1. L INEAR F REQUENCY D ISTRIBUTION Given C = 527 PANN dimensions and a target frequency band [fmin , fmax ], carrier frequencies are uniformly distributed: fi = fmin + (fmax − fmin ) ×
i , C −1
i ∈ {0, 1, . . . , 526}.
(B.1)
In our implementation, fmin = 51 Hz and fmax = 1200 Hz, yielding an average frequency spacing of ∆f ≈ 2.18 Hz. B.1.2. F REQUENCY- TO -G RID M APPING Each frequency fi is mapped to a spatial parcel Ωi ⊂ {0, . . . , G − 1} × {0, . . . , G − 1} on the G × G lattice, where G = 64. Grid enumeration.
All grid coordinates are enumerated in row-major order: G = {(x, y) : x ∈ {0, . . . , G − 1}, y ∈ {0, . . . , G − 1}},
(B.2)
where |G| = G2 = 4096. 2 Parcel allocation. The grid G is partitioned into C contiguous parcels {Ωi }C−1 i=0 . To distribute the G grid points as evenly as possible, we first compute: 2 G nbase = = 7, nrem = G2 mod C = 407. (B.3) C
The first nrem parcels receive one additional grid point to accommodate the remainder: ( nbase + 1 = 8 if i < nrem , |Ωi | = nbase = 7 if i ≥ nrem .
(B.4)
For each parcel i, the boundaries are determined by cumulative allocation: starti =
i−1 X
|Ωj |,
(B.5)
j=0
endi = starti + |Ωi |.
(B.6)
The parcel Ωi then consists of grid positions with linear indices in [starti , endi ): Ωi = {(x, y) ∈ G : starti ≤ x · G + y < endi } . Note that
PC−1 i=0
(B.7)
|Ωi | < G2 , with the remaining grid points left unassigned.
B.1.3. WAVE PROPAGATION SPEED C OMPUTATION For each parcel Ωi , the local wave propagation speed ci is computed from the target frequency fi using the eigenfrequency relation from Theorem 2.1 Eq. (D.1) in Appendix D: p tan(πfi ∆t) (1 + ∆tkp )(1 + ∆tkv ) √ ci = , (B.8) ∆t 2 √ where ∆t = 0.01 is the time step, kp = kv = 10.0 are damping coefficients, and the factor 2 accounts for the 2D isotropic spatial discretization with dx = 1. 14
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
Stability constraints.
To ensure numerical stability, the computed wave propagation speed is clamped: q dx √ (1 + ∆tkp )(1 + ∆tkv ) ≈ 77.8, ∆t 2 ci ← min (ci , 0.9 × cmax ) ≈ 70.0,
(B.10)
ci ← max(ci , 0.1).
(B.11)
cmax =
(B.9)
The upper bound prevents CFL-like violations, while the lower bound ensures non-zero propagation for high-frequency modes. Spatial wave propagation speed field. ci to all positions in parcel Ωi :
The wave propagation speed field c(x, y) on the lattice is constructed by assigning c(x, y) =
526 X
ci · ⊮Ωi (x, y),
(B.12)
i=0
where ⊮Ωi (x, y) is the indicator function. This produces a spatially-varying field with approximately binary contrast between low-frequency (small ci ) and high-frequency (large ci ) parcels. Nyquist Constraint. The lower bound fmin = 51 Hz is chosen to strictly exceed the Nyquist frequency fN = 1/(2∆t) = 50 Hz imposed by the discrete time step ∆t = 0.01 s. Setting fmin = fN would cause the drive signal sin(2πfmin t) to evaluate to zero at all discrete timesteps t = n∆t (since sin(πn) = 0), and would create a singularity in the wave propagation speed formula (Eq. B.8) where tan(πfmin ∆t) = tan(π/2) → ∞. The choice of 51 Hz maintains the original frequency spacing of approximately 2.18 Hz while ensuring well-defined dynamics. B.2. Oscillatory Drive Signal Construction At each time step t, the modulated excitation for PANN dimension i is: Si (x, y, t) = ai (t) sin(2πfi t) · ⊮Ωi (x, y),
(B.13)
where ai (t) ∈ [0, 1] is the PANN probability (sigmoid-activated logit) for event category i at time t. This is the full 2D coordinate form of Eq. (1), where the main text suppresses the y-dependence by writing x for the lattice coordinate. The total drive signal is the superposition: 526 X S(x, y, t) = Si (x, y, t). (B.14) i=0
Batch implementation. In the batch-aware implementation, time t is tracked independently for each sample b ∈ {1, . . . , B}: t(b) = time steps(b) × ∆t, (B.15) where time steps(b) is an integer counter maintained in batch states[time steps]. The drive signal for batch b is: S (b) (x, y, t(b) ) =
526 X (b) ai (t(b) ) sin(2πfi t(b) ) · ⊮Ωi (x, y).
(B.16)
i=0
B.3. Nyquist Constraint and Phase Encoding The discrete-time system with ∆t = 0.01 s imposes a Nyquist frequency: fNyquist =
1 = 50 Hz. 2∆t
(B.17)
This constrains the internal oscillatory dynamics of the pressure field p(x, y, t) to frequencies below 50 Hz. FFT analysis (Appendix J) confirms dominant p-field frequencies lie within theta (4–8 Hz), alpha (8–12 Hz), beta (13–30 Hz), and low-gamma (30–50 Hz) bands. 15
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
High-frequency drive encoding. Drive frequencies fi > 50 Hz do not produce corresponding oscillations in p(x, y, t) due to the Nyquist constraint. Instead, these drives encode information through phase relationships. For integer time indices n = t/∆t, the drive signal phase: ϕi (n) = 2πfi n∆t mod 2π (B.18) varies uniquely for each fi , enabling discrimination between 527 semantic categories via phase-based interference patterns and energy accumulation rates, despite internal dynamics remaining below 50 Hz. B.4. Implementation Parameters The frequency assignment is fully determined by the following fixed parameters: • PANN encoder output dimension: C = 527 • Grid resolution: G = 64 • Time step: ∆t = 0.01 s • Spatial step: dx = 1 • Damping coefficients: kp = kv = 10.0 • Frequency range: [fmin , fmax ] = [51, 1200] Hz These parameters remain constant across all experiments and datasets (XD-Violence, USoW), requiring no domain-specific calibration or retraining.
C. Detailed Algorithms This section provides the complete algorithmic specifications for the OWM-based drift detection framework presented in Subsection 2.1. We present two key algorithms: the main drift detection pipeline and the adaptive threshold computation mechanism. C.1. Main Salience Detection Algorithm Algorithm C.1 describes the complete workflow for detecting auditory pattern drift using the NAACA. The algorithm processes streaming audio input through several key stages: feature extraction via a pretrained encoder, oscillatory signal generation, OWM state updates, energy-based change detection, and persistence filtering. The energy rate (first derivative) within the well-designed structure of the OWM system captures sudden transitions in the rate of energy change, which correspond to significant shifts in auditory patterns. The algorithm employs an adaptive threshold mechanism that automatically adjusts to the system’s baseline behavior and temporal trends, eliminating the need for manual threshold tuning. To ensure robust detection and minimize false positives, the algorithm incorporates persistence filtering that requires a minimum proportion of recent detections before confirming a drift event. Additionally, a cooldown period prevents redundant detections of the same drift event. C.2. Adaptive Threshold Computation Algorithm C.2 details the online computation of adaptive thresholds for energy-based drift detection. The threshold adapts to both the statistical properties of recent observations and temporal trends in the data. The algorithm maintains a sliding window of recent metric values and computes the threshold as T = µ + 2σ(1 + α · ftrend ), where µ and σ are the running mean and standard deviation, α is the trend adjustment factor, and ftrend quantifies the strength of temporal trends using linear regression. During the initial bootstrap phase with insufficient data (fewer than 5 samples), the algorithm uses a simplified threshold computation to avoid instability. The trend factor captures whether the metric values are systematically increasing or 16
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
Algorithm C.1 OWM-based Auditory Pattern Drift Detection Require: Audio stream {xt }, encoder Enc(·), OWM model with spatial operator A Require: Persistence duration P = 3, cooldown period C = 3 1: Initialize energy calculator 2: Initialize adaptive threshold Tadapt for energy metric 3: Initialize detection buffer D = ∅, cooldown timer tlast = −1 4: for each time step t do 5: pt ← Enc(xt ) 6: Generate oscillatory inputs: Si (x, t) = ai (t) sin(ωi t)1Ωi (x) 7: Update OWM state with oscillatory drive signals 8: Calculate current energy change rate from OWM dynamics 9: Tadapt ← µ + 2σ(1 + α · trend) 10: dcandidate ← 1(energy change rate > Tadapt ) 11: Add dcandidate to detection buffer D 12: if |D| ≥ P then PP −1 13: rpersist ← P1 i=0 D[−P + i] 14: if rpersist ≥ 0.5 AND t − tlast > C then 15: output Drift detected at time t 16: tlast ← t, clear D 17: end if 18: end if 19: end for
▷ Extract event probabilities
▷ Energy change rate ▷ Update adaptive threshold ▷ Energy-based detection ▷ Persistence filtering ▷ Persistence ratio
▷ Reset detection state
Algorithm C.2 Online Adaptive Threshold Calculation Require: Window size W = 20, trend adjustment factor α = 0.2 1: Initialize value buffer V = ∅ with maximum size W 2: function AdaptiveThreshold.update(vnew ) 3: Add vnew to buffer V 4: if |V| < 5 then P 1 5: µ ← |V| i Vi 6: if |V| >q 1 then P 1 2 7: σ ← |V|−1 i (Vi − µ) 8: else 9: σ ← 0.1 10: end if 11: return µ + 1.5σ 12: end if P 1 Vi 13: µ ← |V| q i P 1 2 14: σ ← i (Vi − µ) |V|−1 15: if |V| ≥ 3 then 16: x ← [0, 1,P. . . , |V| − 1] 17:
slope ←
▷ Insufficient data for robust statistics
▷ Simple threshold for bootstrap ▷ Compute baseline statistics ▷ Running mean ▷ Running std ▷ Time indices ▷ Linear regression slope
(xi −x̄)(Vi −µ) iP 2 i (xi −x̄) |slope|
18: ftrend ← σ+10−8 19: else 20: ftrend ← 0 21: end if 22: Tadapt ← µ + 2σ(1 + α · ftrend ) 23: return Tadapt
▷ Normalized trend strength
▷ Adaptive threshold with trend adjustment
17
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
decreasing, allowing the threshold to adapt accordingly. This prevents false negatives during periods of natural system evolution while maintaining sensitivity to abrupt changes. The adaptive nature of this threshold computation is crucial for handling diverse auditory environments with varying baseline activity levels, ensuring consistent detection performance across different acoustic contexts without requiring environment-specific calibration.
D. Proof for Theorem 2.1 D.1. Eigenvalue Analysis and Local Resonance Frequency The OWM system is governed by the discrete formulation in Eqs. 4. For a local grid point (x, y), define the state vector h = [p, vx , vy ]T . The update can be written as h(t + ∆t) = Ah(t) + S(x, y, t),
(D.1)
A = M−1 Damp MVelocity , ∂ ∂ 1 −c2 ∆t ∂x −c2 ∆t ∂y ∂ , MVelocity = −∆t ∂x 1 0 ∂ −∆t ∂y 0 1 1 + ∆t k p (x, y) 0 0 . 0 1 + ∆t k v (x, y) 0 MDamp = 0 0 1 + ∆t k v (x, y)
(D.2)
where
(D.3)
(D.4)
In Fourier space, ∂/∂x → iξx and ∂/∂y → iξy . The corresponding system matrix becomes c2i,j ∆tiξx c2i,j ∆tiξy 1 − − p p p 1+∆tki,j 1+∆tki,j i,j 1+∆tk 1 − ∆tiξxv . A = M−1 M = 0 v Velocity Damp 1+∆tki,j 1+∆tki,j ∆tiξ 1 − 1+∆tkyv 0 v 1+∆tk i,j
(D.5)
i,j
The characteristic equation det(A − λI) = 0 expands to !2 " ! ! # c2i,j ∆t2 (ξx2 + ξy2 ) 1 1 1 p −λ v −λ v − λ + (1 + ∆tk p )(1 + ∆tk v ) = 0. 1 + ∆tki,j 1 + ∆tki,j 1 + ∆tki,j i,j i,j v This yields one real eigenvalue λ1 = 1/(1 + ∆tki,j ) and two eigenvalues satisfying ! ! c2i,j ∆t2 (ξx2 + ξy2 ) 1 1 −λ + p −λ p v v ) = 0. 1 + ∆tki,j 1 + ∆tki,j (1 + ∆tki,j )(1 + ∆tki,j
(D.6)
(D.7)
For the parameter regime used (∆tkp = ∆tkv = 0.1 ≪ 1 and typical spatial wavelengths), the discriminant of Eq. D.7 satisfies ∆ < 0, ensuring complex conjugate eigenvalues. Under the balanced damping condition kp = kv , the real parts cancel exactly, yielding: q " # c ∆t ξx2 + ξy2 i,j 1 1 1 λ2,3 = ± iq . (D.8) p + v 2 1 + ∆tki,j 1 + ∆tki,j (1 + ∆tk p )(1 + ∆tk v ) i,j
i,j
Let θ be the phase angle of λ2,3 : θ = tan−1
Im(λ) Re(λ)
q
ξx2 + ξy2 . = tan−1 q p 1 1 v ) (1 + ∆tki,j )(1 + ∆tki,j + p v 1+∆tk 1+∆tk 2ci,j ∆t
i,j
18
i,j
(D.9)
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
In discrete time, the oscillation frequency associated with phase θ is f = θ/(π∆t), hence the local characteristic frequency is q 2ci,j ∆t ξx2 + ξy2 1 . (D.10) fi,j = tan−1 q p 1 1 π∆t v ) )(1 + ∆tki,j (1 + ∆tki,j + 1+∆tkv 1+∆tkp i,j
i,j
We define the local resonance frequency of the discrete system by ωres (x, y) = 2πfi,j . D.2. Frequency-Domain Response and Phase Delay Consider harmonic excitation at angular frequency ω. In the frequency domain, the continuous system in Eqs. (3) satisfies [iω + k p (x, y)]p(x, y, ω) = −c2 (x, y)∇ · v(x, y, ω) + S0 (x, y),
(D.11)
[iω + k v (x, y)]v(x, y, ω) = −∇p(x, y, ω).
(D.12)
Eliminating v gives [iω + k p ][iω + k v ]p − c2 ∇2 p = [iω + k v ]S0 . The resonance frequency ωres (x, y) is the natural angular frequency of the discrete system from the previous subsection. Using ωres = θ/∆t and the small ∆t approximation yields q ωres (x, y) ≈ c(x, y) ξx2 + ξy2 .
(D.13)
2 For slowly varying parameters, we use the local approximation −c2 ∇2 → ωres (x, y), leading to the localized frequencydomain relation h i 2 (ωres − k p k v − ω 2 ) + iω(k p + k v ) p ≈ (iω + k v )S0 . (D.14) 2 Define the effective local resonance by Ω2res (x, y) ≜ ωres (x, y)−k p (x, y)k v (x, y). Then the complex denominator governing the response is D(ω) = (Ω2res − ω 2 ) + iω(k p + k v ). (D.15)
Hence the amplitude response satisfies A(x, y, ω) = |iω + k v |/|D(ω)|. The phase of p is given by the argument of D(ω). Writing ϕ(ω; x, y) = − arg D(ω), one obtains ω(k p + k v ) ϕ(ω; x, y) = − arctan . Ω2res − ω 2 Near resonance, linearize Ω2res − ω 2 ≈ −2Ωres (ω − Ωres ) to obtain ω(k p + k v ) ϕ(ω; x, y) ≈ arctan . 2Ωres (ω − Ωres )
(D.16)
(D.17)
Up to a slowly varying prefactor (absorbed by the proportionality in Eq. (6)), this yields the temporal phase delay. Using the identity arctan(−x) = − arctan(x) and absorbing the sign into the definition of positive phase delay (where lag is defined as positive), we obtain: ϕ(ω; x, y) ω − ωres (x, y) τ (ω; x, y) = ∝ arctan p , (D.18) ω k (x, y) + k v (x, y) which matches the form in Eq. (6). P Finally, by linearity and superposition, for multi-frequency excitation S(x, y, t) = i Si (x, y, t) with narrowband components at ωi and under the quasi-steady assumption (envelope variation slower than (k p + k v )−1 ), each component is locally delayed, giving X p(x, y, t) ≈ Ai (x, y) Si x, y, t − τi (x, y) , (D.19) i
which establishes Eq. (5). 19
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
D.3. Application to OWM and Generality In OWM (Section 3 and Appendix B), c(x, y) is designed to vary spatially, which makes ωres (x, y) = 2πfi,j spatially varying through Eq. (D.10). For a component at frequency ωi , Eq. (D.18) gives a location-dependent delay τi (x, y), and superposition yields the delayed-sum form in Eq. (5). The proof relies on (i) linear operation so that superposition holds, (ii) the quasi-steady condition on the excitation envelope relative to (k p + k v )−1 , and (iii) slowly varying spatial parameters so that the local approximation in Eq. (D.14) is valid. Under these conditions, different input frequencies induce different local phase delays determined by the mismatch between ωi and ωres (x, y).
E. Proof for Theorem 2.2 Proof. We prove the equivalence by transforming the system step by step. We begin by differentiating the pressure equation from Eqs. 3 with respect to time: ∂S ∂2p ∂p ∂ + kp =− ∇ · (c2 (x, y)v) + . ∂t2 ∂t ∂t ∂t
(E.1)
Since c2 (x, y) is time-independent, we apply the product rule for the divergence of a time-dependent vector field with spatially-varying coefficients: ∂ ∂v ∂v [∇ · (c2 v)] = ∇ · c2 + · ∇c2 . ∂t ∂t ∂t
(E.2)
To evaluate the velocity derivatives, we use the velocity equations from Eqs. 3: ∂v = −k v v − ∇p. ∂t
(E.3)
Substituting Eq. E.3 into the divergence term in Eq. E.2:
∂v ∇ · c2 = ∇ · c2 (−k v v − ∇p) ∂t = −k v ∇ · (c2 v) − ∇ · (c2 ∇p).
(E.4)
For the gradient coupling term in Eq. E.2: ∂v · ∇c2 = (−k v v − ∇p) · ∇c2 = −k v v · ∇c2 − ∇p · ∇c2 . ∂t
(E.5)
Combining Eqs. E.4 and E.5 into Eq. E.2: ∂ [∇ · (c2 v)] = −k v ∇ · (c2 v) − ∇ · (c2 ∇p) − k v v · ∇c2 − ∇p · ∇c2 . ∂t
(E.6)
We now eliminate the velocity divergence using the pressure equation from Eqs. 3: ∇ · (c2 v) = −
∂p − k p p + S. ∂t
Inserting Eq. E.7 into Eq. E.6: 20
(E.7)
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
∂ ∂p 2 v p [∇ · (c v)] = −k − − k p + S − ∇ · (c2 ∇p) ∂t ∂t − k v v · ∇c2 − ∇p · ∇c2 ∂p = kv + k v k p p − k v S − ∇ · (c2 ∇p) ∂t − k v v · ∇c2 − ∇p · ∇c2 .
(E.8)
Substituting Eq. E.8 back into Eq. E.1:
∂p ∂2p p ∂p +k = − kv + k v k p p − k v S − ∇ · (c2 ∇p) ∂t2 ∂t ∂t ∂S −k v v · ∇c2 − ∇p · ∇c2 + . ∂t
(E.9)
Finally, rearranging terms leads to: ∂ ∂2p v p 2 v 2 v p v ∂p + k k p = ∇ · (c ∇p) + (k v + ∇p) · ∇c + k + + (k + k ) S, ∂t2 ∂t ∂t
(E.10)
which matches Eq. 9 with effective damping coefficient γ = k p + k v , restoring force coefficient µ = k v k p , and spatial coupling term (k v v + ∇p) · ∇c2 arising from the spatially-varying wave speed.
F. Proof for Theorem 2.3 Proof. We begin by computing the time derivative of energy: ZZ h dE ∂p ∂vx ∂vy i = p + vx + vy dx dy. dt ∂t ∂t ∂t Substituting the system equations from Eqs. 3 into Eq. F.1, we obtain: ZZ h i dE ∂vy ∂p ∂p v v x = p − k p p − c2 ( ∂v + ) + S + v − k v − + v − k v − dx dy. x x y y ∂x ∂y ∂x ∂y dt Expanding the terms in Eq. F.2 yields: ZZ h i dE ∂vy ∂p ∂p v 2 v 2 x = − k p p2 − c2 p( ∂v + ) + pS − k v − v − k v − v x y x y ∂x ∂y ∂x ∂y dx dy. dt
(F.1)
(F.2)
(F.3)
We can group the terms in Eq. F.3 to separate dissipation, coupling, and source contributions: dE = dt
ZZ h
ZZ ZZ h i i ∂vy ∂p ∂p x − kp p2 − kv (vx2 + vy2 ) dx dy + − c2 p( ∂v + ) − v − v dx dy + pS dx dy. x y ∂x ∂y ∂x ∂y
To handle the coupling terms in Eq. F.4, we apply integration by parts. For example: ZZ ZZ ∂p ∂vx vx dx dy = vx p − p dx dy. ∂x ∂x x boundaries Since periodic boundary conditions imply the boundary term vanishes, we have: ZZ ZZ ∂vx ∂p vx dx dy = − p dx dy. ∂x ∂x 21
(F.4)
(F.5)
(F.6)
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
Similarly, for the y-component: ZZ vy
ZZ
∂p dx dy = − ∂y
p
∂vy dx dy. ∂y
(F.7)
Using Eqs. F.6 and F.7, the coupling terms in Eq. F.4 reduce to: ∂vx ∂vy ∂p ∂p −c p + − vx − vy ∂x ∂y ∂x ∂y ∂vy ∂vx ∂vy ∂vx 2 = −c p + +p + ∂x ∂y ∂x ∂y ∂vx ∂vy = −(c2 − 1) p + . ∂x ∂y 2
(F.8)
Combining all results, we obtain the final expression: dE =− dt
ZZ
p 2 k p + kv (vx2 + vy2 ) dx dy −
ZZ
2
(c − 1)p
∂vx ∂vy + ∂x ∂y
ZZ dx dy +
pS dx dy,
(F.9)
which establishes the claim.
G. Proofs for wave propagation speed Optimization G.1. Interface Reflection and Contrast Effects Lemma G.1 (Interface Reflection Coefficient). Consider a plane wave incident on an interface between two constant-speed media with speeds c1 and c2 . With uniform density ρ = 1 so that impedance Z = ρc = c, the pressure reflection coefficient is c2 − c1 R= . (G.1) c1 + c2 The energy reflection ratio is Ereflected /Eincident = |R|2 . Under a fixed speed-sum constraint c1 + c2 = C, |R|2 is maximized by extreme (binary) contrasts (c1 , c2 ) ∈ {(0, C), (C, 0)}, while c1 = c2 = C/2 yields R = 0. Proof. With ρ = 1, the medium impedances are Zi = ci , i = 1, 2. Continuity of pressure and normal velocity (using v = p/Z) at the interface yields p1 pr pt − 1 = 2, Z1 Z1 Z2
p1 + pr1 = pt2 ,
(G.2)
where subscripts denote incident (no subscript), reflected (r), and transmitted (t) components. Solving these equations gives pt2 =
2Z2 p1 , Z1 + Z 2
pr1 Z2 − Z 1 c2 − c 1 = = = R. p1 Z1 + Z 2 c1 + c 2
(G.3)
The reflected-to-incident energy ratio is therefore Ereflected = |R|2 = Eincident
c2 − c 1 c1 + c 2
2 .
(G.4)
2 1 If c1 + c2 = C, maximizing |R|2 = c2 −c is equivalent to maximizing |c2 − c1 |. The maximum occurs at the C binary extremes (c1 , c2 ) = (0, C) or (C, 0), for which |R| → 1. Any interior choice yields a smaller R. For example, c1 = c2 = C/2 gives R = 0, while c1 = 0.9C, c2 = 0.1C gives |R| = 0.8 < 1. 22
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
G.2. Modal Coupling Framework Lemma G.2 (Modal Coupling Derivation and Selection Rule). In the periodic domain [0, Lx ] × [0, Ly ] with orthonormal Fourier basis 2πmx 2πny 1 +i , A = Lx Ly , (G.5) ϕm,n (x, y) = √ exp i Lx Ly A and wavenumbers
2 km,n =
2πm Lx
2
+
2πn Ly
2 ,
(G.6)
P write p(x, y, t) = m,n am,n (t)ϕm,n (x, y) and c2 (x, y) = c20 + δc2 (x, y). Here, am,n (t) are the time-dependent modal coefficients. Neglecting damping, the modal system X
2 äm,n + ωm,n am,n =
C(m,n),(m′ ,n′ ) am′ ,n′ + Sm,n ,
(G.7)
m′ ,n′ 2 2 has ωm,n = c20 km,n and coupling 2 2 C(m,n),(m′ ,n′ ) = km ′ ,n′ ⟨δc , ϕm′ ,n′ , ϕm,n ⟩.
(G.8)
⟨δc2 , ϕm′ ,n′ , ϕm,n ⟩ = δm,m′ V̂n−n′ ,
(G.9)
For striped δc2 (x, y) = f (y),
i.e., coupling is block-diagonal in m and depends on the y-Fourier coefficients V̂q of f , where 1 V̂q = Ly
Z Ly
i 2πqy
f (y) e Ly dy.
(G.10)
0
Proof. We begin by establishing the modal expansion and deriving the coupling matrix through systematic projection onto Fourier basis functions. On the periodic domain [0, Lx ] × [0, Ly ], we employ the orthonormal Fourier basis defined in Eq. (G.5), where A = Lx Ly 2 is the domain area. These functions satisfy ∇2 ϕm,n = −km,n ϕm,n . Starting from the wave equation without damping: ∂2p = c2 (x, y)∇2 p + S(x, y, t), ∂t2 we expand p(x, y, t) =
c2 (x, y) = c20 + δc2 (x, y),
(G.11)
P
m,n am,n (t)ϕm,n (x, y) to obtain:
! X
äm,n (t)ϕm,n (x, y) = (c20 + δc2 (x, y))∇2
m,n
X
am,n (t)ϕm,n (x, y)
+ S(x, y, t)
m,n
=
X
am,n (t)(c20 + δc2 (x, y))∇2 ϕm,n (x, y) + S(x, y, t).
(G.12)
m,n
2 Substituting ∇2 ϕm,n = −km,n ϕm,n into Eq. (G.12) yields:
X
äm,n (t)ϕm,n = −
m,n
X
2 am,n (t)km,n (c20 + δc2 )ϕm,n + S(x, y, t).
(G.13)
m,n
To project this equation onto individual modes, we define the normalized inner product on [0, Lx ] × [0, Ly ] by: ⟨f, g⟩ :=
1 A
Z LxZ Ly 0
f (x, y) g ∗ (x, y) dx dy,
0
23
A = Lx Ly ,
(G.14)
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
so that the Fourier modes are orthonormal: ⟨ϕm,n , ϕµ,ν ⟩ = δm,µ δn,ν , where δ denotes the Kronecker delta function. We also use the trilinear shorthand: Z Z 1 Lx Ly 2 δc (x, y) ϕ∗m,n (x, y) ϕµ,ν (x, y) dx dy. ⟨δc2 , ϕm,n , ϕµ,ν ⟩ := (G.15) A 0 0 Multiplying Eq. (G.13) by ϕµ,ν (x, y) and integrating over the domain, we analyze each term separately. For the left-hand side: + * X X X äm,n ϕm,n , ϕµ,ν = äm,n ⟨ϕm,n , ϕµ,ν ⟩ = äm,n δm,µ δn,ν = äµ,ν (t). (G.16) m,n
m,n
m,n
For the reference-speed part: + * X X 2 2 − am,n km,n c20 ϕm,n , ϕµ,ν = −c20 am,n km,n ⟨ϕm,n , ϕµ,ν ⟩ m,n
m,n 2 = −c20 kµ,ν aµ,ν (t).
For the perturbation (coupling) part: * + X X 2 2 2 − am,n km,n δc ϕm,n , ϕµ,ν = − am,n km,n ⟨δc2 , ϕm,n , ϕµ,ν ⟩. m,n
(G.17)
(G.18)
m,n
For the source part: ⟨S(x, y, t), ϕµ,ν ⟩ =: Sµ,ν (t).
(G.19)
Collecting terms from Eqs. (G.16)–(G.19) gives: 2 äµ,ν (t) + c20 kµ,ν aµ,ν (t) = −
X
2 km,n ⟨δc2 , ϕm,n , ϕµ,ν ⟩ am,n (t) + Sµ,ν (t).
(G.20)
m,n 2 2 and the coupling matrix: := c20 km,n Defining ωm,n 2 C(µ,ν),(m,n) := km,n ⟨δc2 , ϕm,n , ϕµ,ν ⟩, ′
(G.21)
′
and relabeling (µ, ν) → (m, n), (m, n) → (m , n ) in the sum, we obtain the modal system in Eq. (G.7). For the special case of striped distributions where δc2 (x, y) = f (y), we can evaluate the coupling matrix explicitly using Eq. (G.15): ZZ 2π(n−n′ )y 2π(m−m′ )x 1 i Ly Lx ⟨δc2 , ϕm′ ,n′ , ϕm,n ⟩ = f (y) ei e dx dy A "Z # "Z # Lx Ly 2π(n−n′ )y 2π(m−m′ )x 1 i i L L y x = e dx f (y)e dy . (G.22) A 0 0 The x-integral in Eq. (G.22) evaluates to Lx δm,m′ . Defining the Fourier coefficients: Z Ly 1 i 2πqy V̂q = f (y)e Ly dy, q = n − n′ , Ly 0
(G.23)
the y-integral becomes Ly V̂n−n′ . Therefore: ⟨δc2 , ϕm′ ,n′ , ϕm,n ⟩ = δm,m′ V̂n−n′ .
(G.24)
Substituting Eq. (G.24) into Eq. (G.21), the coupling matrix under striped distributions becomes block-diagonal in m: 2 C(m,n),(m′ ,n′ ) = km ′ ,n′ δm,m′ V̂n−n′ .
24
(G.25)
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
G.3. Fourier Coefficient Maximization Lemma G.3 (Square-Wave Fourier Optimality). For a periodic function f (y) with period L and pointwise constraint |f (y)| ≤ A, the magnitude of the q-th Fourier coefficient Z 1 L ˆ f (y)ei2πqy/L dy (G.26) fq = L 0 is maximized by the square wave 2πqy f (y) = A · sgn cos , L
(G.27)
achieving |fˆq | = 2A/(πq) for odd q. Proof. By the Cauchy-Schwarz inequality, 1 |fˆq | ≤ L
Z L 0
1 |f (y)| dy ≤ L
Z L A dy = A.
(G.28)
0
Equality holds when f (y) is phase-aligned with ei2πqy/L , i.e., when 2πqy f (y) = A · sgn cos . L For this square wave, direct computation gives Z 2πqy 2A 1 L ˆ ei2πqy/L dy = fq = A · sgn cos L 0 L πq
(G.29)
(G.30)
for odd q, confirming optimality. Alternatively, this result follows from the convex optimization perspective: the set of functions satisfying |f (y)| ≤ A and fixed mean is convex, and the objective |fˆq | is a linear functional. By the extreme point theorem, the maximum occurs at an extreme point of the feasible set, which corresponds to f (y) ∈ {−A, A} almost everywhere. The phase-alignment condition then determines the switching pattern, yielding the square wave in Eq. (G.27). G.4. Proof of Theorem 2.4 We now prove that the striped square-wave perturbation maximizes drift detection sensitivity through optimal spatial organization. Proof. The proof establishes optimality through three complementary perspectives: geometric structure, resonant coupling, and spectral amplitude. Part I: Geometric constraint from striped structure. From Lemma G.2, when the speed perturbation takes the form δc2 (x, y) = f (y) (independent of x), the coupling matrix satisfies 2 C(m,n),(m′ ,n′ ) = km ′ ,n′ δm,m′ V̂n−n′ ,
where V̂q are the Fourier coefficients of f (y) defined by Z Ly 1 i 2πqy V̂q = f (y) e Ly dy. Ly 0
(G.31)
(G.32)
The Kronecker delta δm,m′ in Eq. (G.31) reveals that the striped structure decouples modes with different x-direction wavenumbers: modes (m, n) and (m′ , n′ ) with m ̸= m′ do not couple. Within each m-block, coupling between modes (m, n) and (m, n′ ) depends solely on the Fourier coefficient V̂n−n′ of the y-direction profile f (y). This geometric decoupling converts the multi-dimensional optimization problem over c(x, y) into independent onedimensional problems along y for each fixed m. This reduction reveals that unidirectional (striped) variation is structurally optimal for maximizing targeted modal coupling. 25
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
Part II: Resonant period selection via Fourier harmonics. To maximize coupling between modes (m, n) and (m, n+q0 ), we examine 2 |C(m,n),(m,n+q0 ) | = km,n+q |V̂q0 |. (G.33) 0 2 Since km,n+q is fixed by mode indices, maximizing coupling reduces to maximizing |V̂q0 |. 0
Consider a periodic function f (y) on [0, Ly ] with period T (where T divides Ly evenly). The periodicity condition f (y) = f (y + T ) implies that the Fourier series Eq. (G.32) has V̂q = 0 unless q is an integer multiple of Ly /T . Specifically, the Fourier coefficients are nonzero only at q =n·
Ly , T
n = 0, ±1, ±2, . . .
(G.34)
For the fundamental Fourier component (largest amplitude in a typical periodic function) to occur at the target mode index q0 , we require Ly Ly ⇒ T = . (G.35) q0 = 1 · T q0 This period selection has a clear physical interpretation. In the modal expansion, mode index n corresponds to a y-direction wavenumber 2πn . (G.36) ky(n) = Ly The discrete modal separation q0 therefore corresponds to a wavenumber difference ∆ky = ky(n+q0 ) − ky(n) =
2π(n + q0 ) 2πn 2πq0 − = . Ly Ly Ly
(G.37)
Using the wave relation k = 2π/λ, the spatial wavelength associated with this mode coupling is λcoupling =
2π 2π Ly = = = T. ∆ky 2πq0 /Ly q0
(G.38)
When the stripe period T matches this coupling wavelength, we achieve resonant enhancement analogous to the Bragg condition for coherent scattering in periodic structures (Kushwaha et al., 1993): reflections from successive interfaces interfere constructively, maximizing energy transfer between the mode pair (m, n) and (m, n + q0 ). The period T = Ly /q0 is not merely sufficient but necessary for fundamental-harmonic coupling. Any other period would either shift the fundamental component to a different mode index or distribute energy across multiple harmonics, reducing coupling strength at q0 . Part III: Amplitude maximization through square-wave profile. Given the resonant period T = Ly /q0 from Part II, we now optimize the profile shape f (y) to maximize |V̂q0 | under constraint |f (y)| ≤ A. For a function f (y) with period T , we can compute V̂q0 by integrating over one period and accounting for the number of periods in [0, Ly ]. Since f (y) repeats q0 times over [0, Ly ], we have 1 V̂q0 = Ly
Z Ly f (y)e 0
i2πq0 y/Ly
q0 dy = Ly
Z T
f (y)ei2πq0 y/Ly dy.
(G.39)
0
Substituting T = Ly /q0 and changing variables η = q0 y/Ly (so dy = T dη and η ∈ [0, 1] over one period): V̂q0 =
q0 Ly
Z 1 0
f (T η)ei2πη T dη =
1 Ly /q0
26
Z Ly /q0 0
f (y)ei2πq0 y/Ly dy.
(G.40)
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
Now we apply Lemma G.3. Define a rescaled Fourier coefficient for one period: Ṽ :=
1 T
Z T
f (y)ei2πq0 y/Ly dy =
0
1 T
Z T
f (y)ei2πy/T dy,
(G.41)
0
where we used q0 /Ly = 1/T . This is precisely the Fourier coefficient at the fundamental frequency for a function with period T , matching the form in Lemma G.3 with L = T and q = 1. From Lemma G.3, |Ṽ | is maximized when f (y) is the square wave 2πy 2πq0 y f (y) = A · sgn cos = A · sgn cos , T Ly
(G.42)
achieving |Ṽ |max =
2A 2A = . π·1 π
(G.43)
2A . π
(G.44)
From Eq. (G.40), we have V̂q0 = Ṽ , therefore |V̂q0 |max =
The optimality of the square-wave profile admits dual interpretations. Mathematically, the Cauchy-Schwarz inequality (used in proving Lemma G.3) shows that phase alignment with the Fourier kernel ei2πq0 y/Ly while maintaining maximal amplitude |f (y)| = A maximizes the overlap integral in Eq. (G.32). Physically, the square wave creates binary impedance contrasts at interfaces y = (2n + 1)T /2 for integer n. At each interface, waves reflect with coefficient approaching R → ±1 as shown in Lemma G.1. When interfaces are spaced at period T = Ly /q0 , reflections from all interfaces arrive in phase at the coupled mode pair, creating maximal constructive interference. The Fourier coefficient |V̂q0 | quantifies precisely this coherent amplification. Synthesis: Joint optimization via amplitude and phase.
Combining Parts I–III, the striped square wave
2πq0 y δc (x, y) = A · sgn cos Ly 2
(G.45)
2 simultaneously achieves: (i) maximal modal coupling amplitude |C(m,n),(m,n+q0 ) | = km,n+q · 2A/π, and (ii) maximal 0 spatial differentiation with dynamic range ∆c = 2A. The latter creates maximal spatial variation in local resonance frequencies ωres (y) ∝ c(y) and consequently in frequency-dependent phase delays τi (y) (Theorem 2.1). Different input frequencies thus produce spatially distinct phase patterns, enabling frequency-selective detection. This joint optimization of coupling amplitude and phase selectivity maximizes drift detection sensitivity.
H. Prompt The prompt used to make the classification is shown in Fig. H.1. To ensure a rigorous evaluation on the XD-Violence dataset (Wu et al., 2020), we adopt the ground-truth label definitions provided by the original benchmark authors. A significant challenge in applying zero-shot Audio Language Models (ALMs) to this dataset is the nature of the source material; the majority of audio scenarios in XD-Violence are extracted from action movies and films. We observed that without domain-specific pre-training or fine-tuning, general-purpose ALMs tend to exhibit a “fictional bias.” Specifically, the models often recognize the high-energy acoustic signatures or specific dialogue as being part of a movie or video game and, as a result, classify the sample as containing “no violence” because it is perceived as non-real. To mitigate this, we designed a specific Fictional Context Rule within our prompt. This rule explicitly instructs the model to ignore any mentions of the audio being from a fictional medium and to focus solely on the physical actions described (e.g., classifying a movie gunshot as a valid shooting event). This ensures that the ALM functions as a security-oriented classifier rather than a content-type identifier, allowing for a fair comparison against supervised baselines. 27
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating XD-Violence Audio Track Classification Prompt
[ROLE] You are a professional security audio classifier. Your ONLY task is to detect and categorize violent events from audio descriptions. [EVIDENCE] {evidence text} [RULES] 1. Label mapping (mandatory): B1: Fighting (scuffles, hitting, physical combat) B2: Shooting (gunfire, gunshots) B4: Riot (large crowd chaos, protests, shouting) B5: Abuse (harassment, physical or verbal abuse) B6: Car accident (crashes, breaking glass, vehicle impacts) G: Explosion (blasts, loud booming sounds) None: Only if absolutely no violent events are mentioned. 2. Violence dominance rule: If any single part of the evidence mentions a violent event, you MUST classify the sample based on that event, even if all other parts of the evidence state “there is no violence.” One positive detection overrides all None detections. 3. Fictional context rule: Strictly IGNORE any mentions of the audio being from a “video game,” “movie,” “film,” or “soundtrack.” You must classify based on the actions described (e.g., if a movie gunshot is described, label it B2). [OUTPUT FORMAT] Output ONLY the code (e.g., B4). Do not include reasoning, descriptions, punctuation, or extra text. Figure H.1. Prompt used for violence event classification from audio descriptions.
I. Additional Qualitative Comparisons To complement the illustrative cases in Section 4.2, we provide six additional Mel-spectrogram examples of OWM. These examples highlight diverse acoustic scenarios and further demonstrate the relative robustness of OWM. Car horn onset (Example R0003). As shown in Fig. I.1, a car horn appears at 21 s and persists for several seconds. Both methods successfully detect the onset, but OWM localizes the event with fewer spurious triggers. 120
4096
Metric Value (Scaled)
Mel Frequency Bins
Energy Metric Adaptive Threshold
100 80
2048
60 1024
40 512
20
21s 0
0
6
12
18
24
30
Time (seconds)
36
42
48
54
60
0
Figure I.1. Example R0003: Car horn onset. OWM localizes events with few spurious triggers.
Intermittent piano playing (Example R0007). As shown in Fig. I.2, piano notes occur intermittently, producing pauses between onsets. OWM registers four discrete activations, thereby reducing sensitivity to the continuous drift caused by spectral divergence. 28
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating 120
Metric Value (Scaled)
Mel Frequency Bins
Energy Metric Adaptive Threshold 4096
100 80
2048
60 1024
40 512
20
11s 0
0
6
12
24s 18
24
37s 30
Time (seconds)
36
53s 42
48
54
60
0
Figure I.2. Example R0007 (Chalet du Mont-Royal, Montreal — street traffic):The most salient event is intermittent piano playing, which triggers OWM four times; this discretization reduces sensitivity to the continuous drift caused by spectral divergence.
Conversational speech (Example R0028). As shown in Fig. I.3, after 30 s, a dialogue with pauses and speaker changes begins. OWM detects a single event at 38 s, reflecting its robustness to intra-speech variability. 120
4096
Metric Value (Scaled)
Mel Frequency Bins
Energy Metric Adaptive Threshold
100 80
2048
60 1024
40 512
20
3s 0
0
38s 6
12
18
24
30
Time (seconds)
36
42
48
54
60
0
Figure I.3. Example R0028 (Heping Road, Tianjin — street traffic): The most salient event is conversation after 30 s, with pauses and speaker changes. OWM is triggered only once at 38 s.
Repeated car horn sounds (Example R0030). As shown in Fig. I.4, horns occur around 24 s, 32 s, and 50 s. OWM detects only the late instance (around 51 s). 120
4096
Metric Value (Scaled)
Mel Frequency Bins
Energy Metric Adaptive Threshold
100 80
2048
60 1024
40 512
20
3s 0
0
42s 6
12
18
24
30
Time (seconds)
36
42
46s
51s 48
54
60
0
Figure I.4. Example R0030 (Century Clock, Tianjin — street traffic): The most salient event is repeated car horn sounds at approximately 24 s, 32 s, and 50 s. OWM detects only the instance around 51 s.
Railway station announcement (Example R0031). As shown in Fig. I.5, the segment contains continuous speech without other salient events. OWM triggers only once during the initial threshold adaptation phase, demonstrating its robustness against continuous background speech. 29
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating 120
Metric Value (Scaled)
Mel Frequency Bins
Energy Metric Adaptive Threshold 4096
100 80
2048
60 1024
40 512
20
3s 0
0
6
12
18
24
30
Time (seconds)
36
42
48
54
60
0
Figure I.5. Example R0031 (Tianjin Railway Station, Tianjin — public square): Analysis of a railway station announcement. OWM triggers only once during the initial threshold adaptation, demonstrating its stability and resistance to false activations during continuous speech.
Church bell with crowd talking (Example R0131). As shown in Fig. I.6, the spectrogram is dominated by continuous bell ringing. OWM’s adaptive threshold rises in response to this persistent signal, effectively suppressing background crowd noise and preventing spurious detections. 120
Metric Value (Scaled)
Mel Frequency Bins
Energy Metric Adaptive Threshold 4096
100 80
2048
60 1024
40 512
20
3s 0
7s
0
6
12
18
24
30
Time (seconds)
36
42
48
54
60
0
Figure I.6. Example R0131 (Town Hall Square, Vilnius — square): OWM response to continuous church bell ringing. The adaptive threshold scales according to the persistent bell signal, effectively suppressing background crowd noise and preventing spurious detections.
Taken together, these additional examples reinforce the primary findings: OWM maintains high specificity by avoiding spurious detections during transient pauses, repeated motifs, or continuous sources, while remaining sensitive to salient novel events.
J. Additional FFT Analysis
20 20
10
10
0
10
20
30
Grid X
40
50
(a) R0002
60
40
30
30
20 20
10
10
0
0
10
20
30
Grid X
40
50
(b) R0010
60
40
50
40
30
30
20 20
10
10
0
0
10
20
30
Grid X
40
50
(c) R0016
60
40
50
Peak Frequency (Hz)
Grid Y
30
30
R0056 - Peak Frequencies (Hz) FFT Analysis of Pressure Neurons 60
Grid Y
40
40
50
Peak Frequency (Hz)
Grid Y
30
30
40
50
Peak Frequency (Hz)
Grid Y
40
R0037 - Peak Frequencies (Hz) FFT Analysis of Pressure Neurons 60
Grid Y
40
50
0
R0016 - Peak Frequencies (Hz) FFT Analysis of Pressure Neurons 60
Peak Frequency (Hz)
R0010 - Peak Frequencies (Hz) FFT Analysis of Pressure Neurons 60
Peak Frequency (Hz)
R0002 - Peak Frequencies (Hz) FFT Analysis of Pressure Neurons 60
40
30
30
20 20
10
10
0
0
10
20
30
Grid X
40
50
(d) R0037
60
20 20
10
10
0
0
10
20
30
Grid X
40
50
60
(e) R0056
Figure J.1. Frequency distribution across the p-field neurons obtained via FFT for different Examples (R0002, R0010, R0016, R0037, R0056). The results reveal band-specific activity in the theta (4–8 Hz), alpha (8–12 Hz), beta (13–30 Hz), and gamma (30–50 Hz) ranges.
In the main paper (Section 4.3), we presented FFT analyses for Examples R0016 and R0056 to illustrate how BioWM reallocates oscillatory activity around drift onsets. To provide further evidence, Fig. J.1 shows additional FFT spectra for five 30
Training-Free Oscillatory Working Memory for Salience-Driven Attention Gating
representative cases (R0002, R0010, R0016, R0037, R0056). These examples span a variety of acoustic scenes, including novel sound events (R0002), subcategory-level drift (R0010), transient pauses (R0016, R0037), and salient novel sources (R0056). Across all examples, the dominant oscillatory activity of p-field neurons lies within the θ (4–8 Hz), α (8–12 Hz), β (13–30 Hz), and low-γ (30–50 Hz) bands, consistent with canonical neural regimes. Rather than being uniformly distributed, activity is organized in clustered regions that evolve after drift onsets. The figures display the activity of all p neurons over entire segments; thus, direct saliency patterns are not immediately visible. What becomes evident instead is the periodic coupling structure along the Y-axis of the lattice, in line with the striped optimality predicted by Theorem 2.4. This suggests that BioWM’s drift sensitivity arises from frequency-specific clustering combined with spatial coupling, rather than from broad or diffuse spectral fluctuations. Animated visualizations of these dynamics are included as supplementary material.
31