Conceptio › Archive › arXiv CS
arXiv CS open access

A High-Density EEG Dataset for Stimulus-Driven Auditory Attention

Ruofan Yan et al. · arxiv_cs
arXiv CS · Papers
Open Source ↗Direct PDF ↓
databasesstorage
Stimulus-driven auditory attention determines which sound gains priority when multiple sources compete without an explicit listening goal, yet most computational studies focus either on acoustic salience or on decoding predefined attended targets. This study investigates instruction-free auditory co
Conceptio Open Archive

Analyze & explore related research in Conceptio

Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.

A High-Density EEG Dataset for Stimulus-Driven Auditory Attention Ruofan Yan1,2 , Na Lu1,* , Shu Peng2 , Wenlong You2 , Zhige Chen2 , Yuxuan Yan1 , Yan Liu3 , Kay Chen Tan2 , and Jibin Wu2* 1 Systems Engineering Institute, School of Automation Science and Engineering, Xi’an Jiaotong University, China 2 Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR 3 Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR

arXiv:2610.01303v1 [q-bio.NC] 1 Oct 2026

* jibin.wu@polyu.edu.hk, lvna2009@mail.xjtu.edu.cn

ABSTRACT Elucidating how the human auditory system automatically prioritizes competing sound streams in complex environments is a central goal in both cognitive neuroscience and the development of auditory brain-computer interfaces (BCIs). To track these dynamic processes, electroencephalography (EEG)-based auditory attention decoding (AAD) has emerged as a crucial approach. However, most open-access EEG benchmarks focus on top-down, instructed target selection, falling short of capturing bottom-up, stimulus-driven orienting during instruction-free dichotic competition. To bridge this gap, we present the SAAD-EEG dataset, comprising 128-channel EEG recordings from 23 participants exposed to competing naturalistic sounds drawn from environmental, speech, and music domains. The experimental paradigm was deliberately designed without explicit target instructions, enabling the investigation of stimulus-driven prioritization based on acoustic and semantic salience. Alongside raw and preprocessed EEG data, the release includes trial-aligned orienting labels, reaction times, and subjective sound ratings. Comprehensive technical validation confirms the dataset’s high neurophysiological quality, behavioral consistency, and robust decodability. This open-access resource opens new avenues for studying the neural mechanisms of bottom-up auditory attention and provides a critical foundation for developing attention-aware hearing technologies.

Background & Summary Recent progress in auditory BCIs and assistive listening devices has advocated the use of neural decoding to determine which auditory stream is being prioritized by the user1–7 . EEG-based AAD has emerged as a promising, non-invasive, and temporally precise approach for tracking these attention-related neural dynamics8–14 . However, most existing open-access EEG datasets have focused almost exclusively on goal-directed (top-down) selection, utilizing instructed paradigms wherein participants are explicitly directed to attend to a designated target audio stream15–22 . While these resources have facilitated benchmarking of top-down AAD algorithms23–27 , real-world communication frequently takes place in complex environments, where listeners are often interrupted by urgent or salient events, such as an infant crying or a fire alarm, that capture attention irrespective of current goals. Auditory BCIs incapable of tracking this stimulus-driven (bottom-up) orienting risk missing critical environmental cues. Despite the significance of this challenge, available EEG resources for stimulus-driven auditory attention remain scarce and are largely limited to detecting temporal salience within a single stream14, 28–34 , rather than resolving instruction-free competition between multiple streams. Understanding how the brain manages these demands is crucial for developing comprehensive models of natural auditory attention, underscoring an urgent need for datasets and paradigms that reflect the true dynamics of unprompted, stimulus-driven auditory orienting in competing scenes. Here, we introduce the SAAD-EEG (Stimulus-Driven Auditory Attention EEG) dataset, which comprises 128-channel EEG recordings from 23 participants engaged in an instruction-free dichotic listening paradigm. The stimuli consist of naturalistic sound events categorized into eight subcategories and 24 cross-category pairing types, encompassing environmental sounds with both high and low ecological validity, speech, and music. In each trial, participants were presented with a dichotic pair of sounds without any explicit attentional cues. To minimize goal-directed selection and isolate genuine bottom-up orienting, they continuously watched a silent movie during sound presentation. After a brief post-stimulus delay, participants indicated which side was more attention-capturing. This design offers a unique opportunity to examine how competing audio streams draw attention based on their acoustic prominence, semantic meaning, and ecological relevance. Validation analyses confirm the dataset’s high quality, behavioral consistency, and robust decodability across multiple cross-validation schemes. The dataset also includes comprehensive behavioral annotations for the stimuli, including trial-level orienting-side labels, precise reaction times, and participant-level subjective ratings of each sound’s familiarity, urgency, and likability. These detailed annotations enable fine-grained analyses of how specific acoustic, semantic, and ecological properties

influence neural processing and attentional capture in complex auditory environments. All data, including raw and preprocessed EEG files, stimulus manifests, and preprocessing scripts, are provided in standardized formats to ensure accessibility and reproducibility (see Figure 1 for an overview of the dataset generation and validation pipeline). The SAAD-EEG dataset offers several advantages for advancing research in auditory neuroscience and neuroengineering. It facilitates investigation of the neural mechanisms underlying bottom-up auditory attention, illuminating how the brain automatically evaluates and prioritizes competing sound streams in the absence of explicit instruction. The inclusion of category-structured, naturalistic stimuli enables exploration of how ecological validity and semantic urgency influence stimulusdriven orienting. Ultimately, this reproducible and open-access resource provides a foundation for developing next-generation, attention-aware hearing devices that can seamlessly adapt to the complexities of real-world acoustic environments.

Procedure

Preprocessing

Validation

Consent

Pipeline

Signal Quality

Behavior

Practice

Montage

EEG layout

EEG recording

Bad channel detection

Excluded trials analysis RT distribution

—Session 1 —Trial 1 —… —Trial 160 —Session 2

Bad channel interpolation Filtering Re-reference

—Session 3

ICA

Subjective rating

Segmentation

Release Data records

Metadata

Raw EEG

Bad channel analysis ICA analysis PSD validation Decoding performance

Processed EEG

Stimuli

Group-level selection rates Audio Feature Regression Subjective rating analysis

Ratings

Code

Figure 1. Schematic overview of the dataset generation and validation pipeline. The workflow comprises four stages: Procedure: After prescreening, participants provided informed consent, completed practice, and underwent formal EEG recording, followed by subjective ratings on representative sound clips. Preprocessing: EEG recordings were preprocessed according to standardized procedures. Validation: EEG data validation included signal quality assessment (layout verification, bad-channel analysis, ICA analysis), neurophysiological plausibility checks (PSD validation), and decoding performance evaluation. Behavioral validation included analyses such as excluded-trial summaries, reaction time distributions, and subjective rating assessments. Release: All data, including metadata, raw and processed EEG recordings, stimuli, subjective ratings, and processing scripts, were publicly released in a structured format.

Methods Participants The dataset comprises EEG recordings from 23 adult participants (14 males and 9 females), with a mean age of 27.0 ± 2.7 years. All participants were native Chinese speakers, fluent in English, and enrolled as students at The Hong Kong Polytechnic University. 22 participants were right-handed and one participant was left-handed. All participants had normal hearing and reported no history of neurological disorders. The study was approved by the Institutional Review Board of The Hong Kong Polytechnic University (Reference No. HSEARS20230628001). Before the experiment, participants received a detailed explanation of the experimental procedure, potential risks, and task-related requirements. Each participant provided written informed consent and agreed to the voluntary collection and public release of their data. They were compensated for their time and contribution. 2/12

Table 1. Hierarchical taxonomy of stimulus subcategories. Main Categories High-ecological environmental sounds Low-ecological environmental sounds Speech Music

Subcategories Baby cry, infant cry Telephone bell ringing Computer keyboard Helicopter Male speech, man speaking Female speech, woman speaking Bass drum Sad music

Code A1 A2 B1 B2 C1 C2 D1 D2

Table 2. Twenty-four subcategory-level dichotic pairing types derived from cross-category combinations. See Table 1 for code definitions. Main-category pair A–B A–C A–D B–C B–D C–D

Subcategory pairing type codes A1B1, A1B2, A2B1, A2B2 A1C1, A1C2, A2C1, A2C2 A1D1, A1D2, A2D1, A2D2 B1C1, B1C2, B2C1, B2C2 B1D1, B1D2, B2D1, B2D2 C1D1, C1D2, C2D1, C2D2

Stimuli Stimuli were constructed as dichotic audio pairs, simultaneously presented to the left and right ears. Source clips were selected from AudioSet35 , a manually annotated corpus of audio events sourced from YouTube, to ensure broad coverage of naturalistic, real-world sounds. The stimulus pool was organized according to a hierarchical taxonomy comprising four main categories: high-ecological (HE) and low-ecological (LE) environmental sounds, speech, and music, each subdivided into two subcategories. Ecological validity was defined in terms of everyday occurrence and attentional relevance, facilitating comparisons across distinct sound categories. Complete subcategory definitions and codes are provided in Table 1. Clips were manually screened, and 2-s excerpts were carefully selected to maximize label consistency while preserving perceptual clarity. The amplitude of each clip was normalized based on the root mean square (RMS) amplitude calculated from the loudest 1% of samples, reducing potential loudness-related confounds across stimulus pairs. Pair construction was restricted to cross-category combinations, with within-category and self-pairs excluded. Under these constraints, 24 valid subcategory-level pairing types were generated, as enumerated in Table 2. Each pairing type was repeated 10 times and expanded with mirrored left–right versions to balance ear assignment and limit side confounds, resulting in a total of 480 dichotic stimulus pairs. Experimental Procedure All recordings were conducted in a sound-attenuated and electromagnetically shielded room. As illustrated in Figures 2a and 2b, participants wore an EEG cap and wired headphones, viewed a monitor positioned approximately 50 cm in front, and responded using a response pad. Saline was applied to ensure stable conductivity prior to recording. A five-trial practice block preceded the main acquisition phase. During the main phase, the 480 dichotic stimulus pairs were randomly divided into three sessions (160 trials per session). To minimize fatigue and maintain data quality, adequate rest was provided between sessions, during which saline was replenished as needed to preserve electrode contact. At the beginning of each session, a central fixation cross was presented to prompt participants to maintain attention. Participants initiated the run by pressing the response pad. As shown in Figure 2c, each trial began with a 3-second silent period, ensuring that each dichotic stimulus pair started from silence. The two sound clips were then simultaneously presented to the left and right ears for 2 seconds without ear-specific attentional instruction. A 1-second post-stimulus delay preceded response collection to reduce potential contamination of stimulus-related EEG activity by motor responses associated with button presses36 . After this delay, a response prompt instructed participants to report which side was more attention-capturing by pressing the corresponding left or right key. Participants were allowed up to five seconds to respond, and trials exceeding this response window were excluded from subsequent analysis. Trial labels therefore reflected participants’ post-stimulus selfreports of the more attention-capturing side, rather than externally instructed or objectively verified attended ears. Throughout each session, a silent American feature film was displayed. Participants were instructed to follow the movie and not to 3/12

a

c Visual Prompt Report

Which side attracts you more?

Response Pad Watch

Stimulus device

c

EEG

EEG amplifier

Record

Record Recording device

Time Session N

Practice

Trial 1

⋯

Session N+1 Trial 160

Rest

Trial 1

3s

2s

1s

Silence

Dichotic Clip

Interval

⋯

Trial 160

< 5s Respond

Figure 2. (a) The EEG experimental setup. (b) Hardware configuration and data flow. (c) Overview of the experimental procedure.

deliberately monitor the dichotic sounds. This design was intended to minimize explicit goal-directed selection and capture stimulus-driven auditory orienting during dichotic competition. Data Acquisition EEG signals were recorded using a 128-channel HydroCel GSN system (Electrical Geodesics, Inc.) at a sampling rate of 250 Hz. Electrode positions followed the international 10–10 system, and impedance was maintained below 10 kΩ before recording. During acquisition, signals were referenced online to the vertex (Cz), with the COM sensor (posterior to Cz) used as ground. Stimulus presentation, event-marker delivery, and response logging were implemented in E-Prime 2.0 (Psychology Software Tools, Pittsburgh, PA). Behavioral responses were collected via the EGI Chronos response pad, which recorded left/right choices and reaction time (RT) with millisecond precision. Through the E-Prime–Chronos interface, trial events, behavioral responses, and EEG recordings were temporally aligned at the trial level. In addition, participants completed post-experiment subjective ratings using an online questionnaire. For each subcategory, one representative audio clip was presented, and participants rated familiarity, liking, and urgency on a 0–4 scale. Each item was rated after listening to its corresponding clip. At the end of the experiment, raw EEG data together with event markers were saved in .mff format for offline analysis, and behavioral logs were exported as .txt files. Data preprocessing EEG preprocessing was performed offline in Python (v3.12.7) using MNE-Python (v1.10.237 ), PyPREP (v0.4.338 ) and mneicalabel39 . Raw recordings were configured with the GSN-HydroCel-128 montage, with VREF treated as a miscellaneous channel. Noisy channels were automatically identified using PyPREP based on local correlation criteria and then interpolated using spherical spline interpolation. The data were subsequently re-referenced to the common average reference. A 0.1-40 Hz FIR band-pass filter was applied to remove DC offset and suppress slow baseline drifts, while retaining frequency components relevant to auditory attention. A 50 Hz notch filter was then applied to attenuate line noise. For artifact reduction, independent component analysis (ICA) with the Infomax algorithm40 was used to decompose the EEG into independent components. The ICLabel classifier (mne-icalabel) was then applied to assign each component to categories such as brain, eye, and muscle; non-brain components were removed, and the cleaned EEG was reconstructed from the remaining components. Continuous 4/12

i SAAD_dataset/ A README.md Ð dataset_description.json O participants.tsv A CHANGES.txt g raw_eeg/ g sub-01/ g ses-01/ j sub-01_ses-01_task-SAAD_run-01_eeg.mff/ ! ses-02, ses-03 ! sub-02, ..., sub-23 g processed/ g sub-01/ A sub-01_preprocessed_eeg.npy O sub-01_preprocessed_labels.tsv O sub-01_preprocessed_rts.tsv Ð sub-01_preprocessed_meta.json ! sub-02, ..., sub-23 g stimuli/ g wav/ g high_ecological_environmental/ baby_cry, telephone_bell_ringing g low_ecological_environmental/ computer_keyboard, helicopter g speech/ male_speech, female_speech g music/ bass_drum, sad_music g pairs/ O trial_stimulus_index.tsv g ratings/ O ratings_scale_description.tsv O participant_ratings.tsv Figure 3. Directory layout of the SAAD-EEG dataset as released on Zenodo. Icons indicate item types: g directories, j raw EEG recordings (.mff), Ð JSON metadata, O tabular files (.tsv), and A other release files (.md/.npy). Only sub-01 is shown in full. Ellipses (...) indicate repeated structures across participants and sessions. Under each main audio category in stimuli/wav/, grey italic text lists the two subcategory folder names.

5/12

EEG was segmented into 6 s trial epochs locked to trial onset. For analysis and deposited processed data, time is expressed relative to dichotic-stimulus onset (t = 0 s): a 3 s pre-stimulus silent baseline (−3 to 0 s), a 2 s dichotic-stimulation interval (0 to 2 s), and a 1 s post-stimulus silent interval (+2 to +3 s) before the orienting response. Baseline correction for validation analyses used the −3 to 0 s window; primary decoding and spectral summaries used the 0 to 2 s stimulation window. Released arrays store the same 6 s segments with stimulus onset at sample index 750 (3 s × 250 Hz); see Data Records for array layout.

Data Records The dataset is publicly available on the Zenodo platform41 . The release follows a hierarchical organization designed for transparent reuse. As shown in Figure 3, the dataset includes root-level metadata files and four main subdirectories: raw_eeg/ (raw EEG recordings), processed/ (preprocessed EEG data), stimuli/ (stimulus audio files), and ratings/ (participant-level subjective ratings). For clarity, the figure shows the full tree for sub-01 only; all other participants and the remaining sessions follow the same file naming and folder structure. Root-level metadata The README.md file describes the Zenodo folder layout and refers readers to preprocessing code on GitHub (Code availability). The dataset_description.json file records technical parameters of the dataset, including sampling rate, channel count, trial count, and epoch timing. Participant ID, sex, age, and handedness are listed in participants.tsv. The data contains no personally identifiable information beyond these demographics. The CHANGES.txt file logs changes between dataset releases. Raw EEG folder The raw_eeg/ directory stores continuous session-level EEG recordings in EGI .mff format, organized by participant (sub-XX/) and session (ses-01/, ses-02/, ses-03/). Each session folder contains one recording, sub-XX_ses-YY_ task-SAAD_run-01_eeg.mff/, as acquired during data collection. Processed folder The processed/ directory contains trial-epoched EEG and behavioral data per participant. The three sessions are merged: each sub-XX/ folder contains 480 trials in four files. The file sub-XX_preprocessed_eeg.npy stores epoched EEG as a NumPy array of shape (480, 128, 1500) at 250 Hz, corresponding to 6 s per trial spanning the pre-stimulus, dichotic-stimulation, and post-stimulus intervals of each trial. The files sub-XX_preprocessed_labels.tsv and sub-XX_preprocessed_rts.tsv provide trial-wise orienting-side labels (Label: 0 = left, 1 = right) and reaction times (RT_ms). The file sub-XX_preprocessed_meta.json records channel names, preprocessing information, and epoch timing. Stimuli folder The stimuli/ directory contains the auditory materials used in the experiment. The wav/ subfolder contains singleear reference clips organized by four main categories, each with two subcategory folders. The pairs/ subfolder holds 480 dichotic pair waveforms (.wav), one file per experimental pair. The file trial_stimulus_index.tsv lists the playback order for all sessions (480 rows: 160 per session) with columns session, stimulus_index, pair_id, and pair_relative_path, linking each trial to the corresponding file in pairs/. Ratings folder The ratings/ directory contains two tab-separated files. ratings_scale_description.tsv defines the postexperiment rating scales (familiarity, urgency, and liking; 0–4) with English questions and anchor labels. participant_ratings.tsv contains the ratings for each participant across eight sound subcategories.

Technical Validation To assess the reliability and quality of the dataset, we performed a series of validation analyses covering EEG signal quality, neurophysiological plausibility, decoding performance and robustness across partitioning schemes, and behavioral consistency. Signal Quality Assessment We first assessed EEG quality after preprocessing to support reproducible reuse of the dataset. Figure 4a presents the 128channel HydroCel sensor layout used for data acquisition, providing dense scalp coverage for spatially resolved EEG analyses. The number of interpolated channels for each participant is summarized in Figure 4b (left). Across participants, interpolation 6/12

c

b

Number

a

32

16

24

12

16

8

8

4

0 0 Interpolated Channels

e

d F1

Before ICA

Brain

Eye blink

Channel noise

Alpha

Beta

Theta

ICA Removed

f

Fz F2

F1

After ICA

Fz F2

g

Figure 4. Signal quality assessment results for the SAAD-EEG dataset. (a) Sensor layout of the 128-channel HydroCel EEG system. (b) Number of interpolated channels and excluded ICA components for each participant. (c) Representative independent components identified by ICA and labeled with ICLabel. (d) EEG signals at representative electrodes F1, Fz, and F2 before and after artifact removal. (e) Group mean PSD (dB) over 1–40 Hz for the pre-stimulus baseline (-3 to 0 s; dashed grey) and dichotic-stimulus (0 to 2 s; solid red) windows. Shaded regions indicate the standard error of the mean (SEM) across participants. (f) Scalp topographies of the stimulus-minus-baseline log-power difference (dB) for theta, alpha, and beta bands, averaged across participants. (g) Robustness of EEGNet decoding for each participant across three cross-validation schemes: trial-random, mirror-constrained, and category-held-out splits. The dashed horizontal line indicates chance level.

was required for 8–15 channels (median = 11). One participant required 30 interpolated channels. This outlier may reflect individual differences in electrode contact quality and cap fitting during acquisition. Excluded ICA-component counts per participant are summarized in Figure 4b (right). Across participants, 3–9 ICA components were removed (median = 5). These interpolation and ICA-rejection counts fall within ranges commonly observed in high-density saline-based EEG recordings, supporting the technical usability of the deposited EEG. Figure 4c shows representative independent components identified by ICA and labeled with ICLabel, illustrating typical retained brain activity alongside common rejected artifact components such as eye blinks and channel noise. Figure 4d compares EEG signals at representative frontocentral electrodes (F1, Fz, and F2) before and after ICA removal, demonstrating reduction of blink-related artifacts while preserving the overall temporal characteristics of the EEG signals. Neurophysiological Plausibility Check To assess neurophysiological plausibility, we compared group-level spectral profiles and scalp topographies between the baseline window (-3 to 0 s) and the dichotic-stimulation window (0 to 2 s). Group mean power spectral density (PSD) across participants is shown in Figure 4e. Relative to baseline, the stimulation window showed increased spectral power across 0–40 Hz, with larger changes observed in lower-frequency bands. Theta (4–8 Hz) and alpha (8–13 Hz) exhibited the strongest increases, whereas beta (13–30 Hz) showed a smaller but consistent increase. These results indicate stimulus-related spectral 7/12

Table 3. Each cell reports per-participant BACC and fold-wise SD. S1 S2 S3 S4 S5 S6 S7 S8 S9 S10 S11 S12 0.6262 0.6539 0.8442 0.5820 0.6271 0.8837 0.6088 0.6317 0.6443 0.6924 0.7121 0.7261 ±0.0296 ±0.0376 ±0.0291 ±0.0570 ±0.0320 ±0.0251 ±0.0219 ±0.0249 ±0.0226 ±0.0524 ±0.0254 ±0.0287 S13 S14 S15 S16 S17 S18 S19 S20 S21 S22 S23 Avg 0.8297 0.5988 0.6122 0.7458 0.6936 0.7089 0.6172 0.8044 0.6194 0.6916 0.5733 0.6838 ±0.0239 ±0.0191 ±0.0449 ±0.0356 ±0.0305 ±0.0380 ±0.0342 ±0.0240 ±0.0342 ±0.0433 ±0.0141 ±0.0949

modulation relative to the pre-stimulus baseline. To further map the spatial distribution of spectral changes, we computed scalp topographies of the stimulus-minus-baseline log-power difference for alpha, beta and theta bands, as shown in Figure 4f. The topographic maps showed distinct spatial distributions across frequency bands. Alpha and beta increases were most prominent over parieto-occipital regions, broadly consistent with previous reports of posterior task-related modulation42 . Theta increases were most prominent over anterior frontal regions, broadly consistent with previously reported frontal theta involvement in cognitive control and engagement processes43 . Together, these patterns support the neurophysiological plausibility of the released EEG dataset. Baseline Decoding Results To evaluate the decodability of the released EEG dataset, we employed EEGNet44 , a compact deep learning model designed for EEG-based decoding tasks, as a baseline classifier. Using depthwise separable convolutions, EEGNet learns spatial and temporal features efficiently with fewer parameters. This model has been successfully applied to auditory attention decoding tasks12, 45 . To ensure a fair and reproducible model evaluation, we adopted a within-subject, five-fold cross-validation strategy. For each participant, trials were randomly shuffled and partitioned into five approximately equal-sized folds. Each fold was used once as the test set, while the remaining four folds were used for training. The same partitioning procedure was applied to all participants, and fold assignments were generated using a fixed random seed to enable reproducibility. Because the labels represent participants’ self-reported orienting choices, class distributions may be imbalanced and vary across individuals. Therefore, balanced accuracy (BACC) and standard deviation (SD) were reported to provide equal weighting across classes. For each participant, BACC was averaged across the five test folds. As shown in Table 3, EEGNet achieved above-chance trial-wise prediction of the response labels under the random split cross-validation scheme. At the group level, balanced accuracy averaged 68.38% (SD = 9.5% across participants), indicating reliable but moderate decodability on this stimulus-driven listening task. Individual performance varied across participants, with mean BACC values ranging from approximately 57% to 88%. However, within-participant variability across cross-validation folds was relatively small for most individuals, indicating stable evaluation across different test splits. Overall, these results demonstrate the presence of discriminative neural information in the released EEG data while highlighting inter-individual variability commonly observed in EEG decoding studies. Robustness across partitioning strategies Beyond the trial-level random split, we designed two additional cross-validation schemes to assess whether decoding performance was driven by trial-level neural information rather than shortcut learning from ear-of-presentation cues or memorized stimulus pairings. All analyses were conducted within-subject, with only the rule for grouping trials into folds differing across schemes. Mirror-constrained split. Random splitting may introduce shared acoustic information across training and testing folds, allowing decoders to exploit ear-of-presentation or stimulus-specific features. To reduce this potential leakage, mirrored trials from the same pair were assigned to the same fold, ensuring that the model never encountered the opposite ear assignment of a given stimulus pair during training. Five-fold cross-validation was performed under this grouping strategy. Pairing-type held-out split. Models may learn specific subcategory pairing patterns rather than generalize to unseen stimulus combinations. We therefore adopted a six-fold cross-validation scheme based on the 24 subcategory-level pairing types defined in the stimulus taxonomy. In each split, models were trained on 20 pairing types and evaluated on 4 held-out pairing types. This scheme evaluates generalization to unseen stimulus pairings rather than leave-one-category-out generalization to entirely novel sound categories. For each scheme, we trained EEGNet with the same preprocessing and hyperparameters, summarized per-participant BACC, and then reported group-level means across participants. As shown in Figure 4g, the three cross-validation schemes yielded comparable decoding performance: random split (68.4%), mirror-constrained split (68.2%), and pairing-type held-out split (68.3%). The small performance differences across schemes suggest that decoding was not primarily driven by ear-of8/12

presentation cues or memorization of specific stimulus pairings. These results indicate that the released EEG data contain trial-level neural information related to participants’ self-reported stimulus-driven orienting outcomes. a

b

c

e

d

Figure 5. Behavioral analysis results for the SAAD-EEG dataset. (a) Number of excluded trials for each participant. (b) RT distributions for three sessions across all participants. (c) Group-level selection rates for music, speech, high-ecology, and low-ecology sounds in the dichotic listening stimulus-driven attention task. Each bar shows the ratio of trials in which a category was selected to trials in which it was available as the left- or right-ear stimulus. The dashed line at 0.5 indicates chance performance (no systematic bias). Gray asterisks mark categories whose selection rates differ significantly from 0.5; the horizontal bracket and label indicate that all pairwise comparisons between categories are significant. Bonferroni correction (α = 0.05) was applied separately to each test family. (d) Pair-level logistic regression (binomial GLM, logit link). Odds ratios (OR) and 95% confidence intervals for left–right audio-feature differences and group-level selection on one side of each stimulus pair. The dashed vertical line indicates OR = 1; ∗ p < 0.05, ∗∗ p < 0.01, ∗∗∗ p < 0.001. (e) Mean subjective ratings across participants (familiarity/liking/urgency; 0–4 scale) of representative clips for each subcategory.

Behavioral Data Validation This section presents technical validation of the behavioral data through response quality, category-level response patterns, and complementary acoustic and subjective characterizations. Figure 5a summarizes trial exclusions under the predefined RT criterion (>5,000 ms). In total, only 15 trials were removed, representing 0.14% of all trials, indicating high completeness of the behavioral responses. Figure 5b presents RT distributions across the three sessions. Each session showed a typical positive skew, with about 60% of trials between 300–800 ms and a right tail of slower responses. Median RT decreased progressively from Session 1 (554 ms) to Session 2 (469 ms) and Session 3 (440 ms), indicating increasing task familiarity and minimal fatigue effects. To examine whether behavioral responses exhibited non-random selection patterns across the predefined sound categories, we computed selection rates (SR) for the four main sound categories (music, speech, HE, and LE). For each category, we selected presented c defined the selection rate as: SRc = npresented , where c denotes the sound category, nselected and Nc denote the numbers of c Nc

selected and presented trials for category c, respectively. Under unbiased selection, the expected selection rate is 0.5. Figure 5c shows that all four categories deviated significantly from the expected value of 0.5 after Bonferroni correction. Speech (SR = 0.61) and HE (SR = 0.58) were selected more frequently than expected, whereas music (SR = 0.48) and LE (SR = 0.33) were selected less frequently. This trend is broadly consistent with the greater semantic salience and ecological relevance of speech and HE sounds, whereas music and LE environmental sounds may have been perceived as more background-like. All pairwise comparisons between categories were significant, indicating distinct category-level behavioral response patterns. We further examined whether behavioral choices were systematically associated with measurable acoustic differences between competing sounds. Pair-level binomial GLMs (logit) were fitted using the left–right differences (∆) for nine perceptual features defined in a previous study33 . Each feature was z-scored across pairs. As shown in Figure 5d, loudness, spectral modulation, spectral centroid, and temporal modulation were positively associated with behavioral choices (all p < 0.001), 9/12

whereas spectral flatness and f0 showed negative associations (p < 0.001 and p < 0.01, respectively). Harmonicity showed a weak positive association (p < 0.05), while the remaining features were not significant. Figure 5e presents the post-experiment subjective ratings of familiarity, perceived urgency, and liking across the eight stimulus subcategories. Within each main category, the two subcategories showed broadly similar subjective rating profiles. Across categories, music received the highest liking ratings and the lowest urgency ratings, whereas HE sounds showed the opposite pattern. Speech was relatively familiar, and LE sounds generally received lower liking ratings. These subjective profiles were broadly consistent with the expected perceptual characteristics of the predefined stimulus categories. Usage Notes The SAAD-EEG dataset provides a structured and reproducible resource for studies of stimulus-driven auditory attention, combining high-density EEG recordings with rich behavioral, stimulus, and subjective annotations. Researchers interested in customized preprocessing or validating alternative preprocessing strategies may use the raw .mff recordings, whereas the released preprocessed EEG epochs are intended for direct statistical analysis and machine learning. The released epochs preserve the complete trial structure, enabling flexible analyses of pre-stimulus, stimulus-evoked, and post-stimulus neural activity. We recommend MNE-Python (validated with version 1.10.2) to ensure compatibility with the released preprocessing pipeline. Unlike conventional auditory attention datasets based on explicit listening instructions, the released labels represent participants’ self-reported orienting outcomes during instruction-free dichotic competition. They should therefore be interpreted as behavioral measures of stimulus-driven attentional orienting rather than objective measures of attentional state. Beyond serving as a reference benchmark for stimulus-driven auditory attention decoding, the released dataset supports several additional research directions. First, the high-density EEG recordings collected under an instruction-free paradigm provide a valuable resource for investigating the neural mechanisms of stimulus-driven auditory attention, complementing the extensive literature based on instructed attention paradigms. Second, the combination of behavioral annotations, stimulus metadata, and subjective ratings enables investigations of how acoustic, semantic, and ecological sound properties influence attentional orienting and its neural correlates. Finally, the dataset supports the development and evaluation of multimodal computational models of stimulus-driven auditory attention.

Data Availability The SAAD-EEG dataset is publicly accessible on the Zenodo platform at https://zenodo.org/records/20557225 (DOI: 10.5281/zenodo.20557225.).

Code Availability The preprocessing and analysis scripts described in this paper are publicly available on GitHub (https://github.com/ yanruofan628/saad-preprocessing).

References 1. Belo, J., Clerc, M. & Schön, D. Eeg-based auditory attention detection and its possible future applications for passive bci. Front. computer science 3, 661178 (2021). 2. Zhang, H. et al. A novel spatial auditory brain-computer interface based on low-frequency periodic auditory motion stimulation paradigm. IEEE Transactions on Biomed. Eng. (2025). 3. Zheng, Q. et al. Applications and challenges of auditory brain-computer interfaces in objective auditory assessments for pediatric cochlear implants. In Exploration, vol. 5, 20240078 (Wiley Online Library, 2025). 4. Wang, Y., Liu, X., Cui, H., Li, Z. & Chen, X. An auditory selective attention brain-computer interface system based on auditory steady-state response. Appl. Acoust. 228, 110291 (2025). 5. Han, C. et al. Speaker-independent auditory attention decoding without access to clean speech sources. Sci. advances 5, eaav6134 (2019). 6. Markovinović, I., Vrankić, M., Vlahinić, S. & Šverko, Z. Design considerations for the auditory brain computer interface speller. Biomed. Signal Process. Control. 75, 103546 (2022). 7. Hjortkjær, J. et al. Real-time control of a hearing instrument with eeg-based attention decoding. J. Neural Eng. 22, 016027 (2025). 8. Geirnaert, S. et al. Electroencephalography-based auditory attention decoding: Toward neurosteered hearing devices. IEEE Signal Process. Mag. 38, 89–102 (2021). 10/12

9. O’sullivan, J. A. et al. Attentional selection in a cocktail party environment can be decoded from single-trial eeg. Cereb. cortex 25, 1697–1706 (2015). 10. Kerlin, J. R., Shahin, A. J. & Miller, L. M. Attentional gain control of ongoing cortical speech representations in a “cocktail party”. J. Neurosci. 30, 620–628 (2010). 11. Li, J. et al. Multi-talker speech comprehension at different temporal scales in listeners with normal and impaired hearing. bioRxiv 2024–06 (2024). 12. Wang, C., Gao, Y., Li, J., Fan, J. & Zhao, X. Research progress on auditory attention detection in eeg. Indian J. Otolaryngol. Head & Neck Surg. 77, 3532–3540 (2025). 13. Das, N., Vanthornhout, J., Francart, T. & Bertrand, A. Stimulus-aware spatial filtering for single-trial neural response and temporal response function estimation in high-density eeg with applications in auditory research. Neuroimage 204, 116211 (2020). 14. Straetmans, L., Holtze, B., Debener, S., Jaeger, M. & Mirkovic, B. Neural tracking to go: auditory attention decoding and saliency detection with mobile eeg. J. neural engineering 18, 066054 (2021). 15. Kaya, E. M. & Elhilali, M. Modelling auditory attention. Philos. Transactions Royal Soc. B: Biol. Sci. 372 (2017). 16. Mundanad Narayanan, A., Zink, R. & Bertrand, A. Eeg miniaturization limits for stimulus decoding with eeg sensor networks. J. Neural Eng. 18, 056042 (2021). 17. Das, N., Biesmans, W., Bertrand, A. & Francart, T. The effect of head-related filtering and ear-specific decoding bias on auditory attention detection. J. neural engineering 13, 056014 (2016). 18. Deng, Y., Choi, I., Shinn-Cunningham, B. & Baumgartner, R. Impoverished auditory cues limit engagement of brain networks controlling spatial selective attention. NeuroImage 202, 116151 (2019). 19. Fuglsang, S. A., Dau, T. & Hjortkjær, J. Noise-robust cortical tracking of attended speech in real-world acoustic scenes. NeuroImage 156, 435–444 (2017). 20. Aroudi, A., Mirkovic, B., De Vos, M. & Doclo, S. Impact of different acoustic components on eeg-based auditory attention decoding in noisy and reverberant conditions. IEEE Transactions on Neural Syst. Rehabil. Eng. 27, 652–663 (2019). 21. Zhang, Y. et al. A learnable spatial mapping for decoding the directional focus of auditory attention using eeg. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1–5 (IEEE, 2023). 22. Ceolini, E. et al. Brain-informed speech separation (biss) for enhancement of target speaker in multitalker speech perception. NeuroImage 223, 117282 (2020). 23. Cai, S., Zhang, R., Zhu, H. & Li, H. Modeling the temporal dynamics of eeg signals in selective listening. IEEE Transactions on Consumer Electron. 71, 1115–1124 (2025). 24. Cai, S., Zhang, R. & Li, H. Robust decoding of the auditory attention from eeg recordings through graph convolutional networks. In ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2320–2324 (IEEE, 2024). 25. Pahuja, S. et al. Atgnet: Adaptive temporal graph network for eeg-enabled sound source tracking in cocktail party scenarios. In ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1–5, DOI: 10.1109/ICASSP49660.2025.10890424 (2025). 26. Zeng, X., Cai, S. & Xie, L. Attention-guided graph structure learning network for eeg-enabled auditory attention detection. J. Neural Eng. 21, 036025 (2024). 27. Asjid Tanveer, M., Jensen, J., Tan, Z.-H. & Østergaard, J. Single-microphone deep envelope separation based auditory attention decoding for competing speech and music. J. Neural Eng. 22, 036006 (2025). 28. Tordini, F., Bregman, A. S. & Cooperstock, J. R. The loud bird doesn’t (always) get the worm: Why computational salience also needs brightness and tempo. In ICAD, 236–243 (2015). 29. Bouvier, B., Susini, P., Marquis-Favre, C. & Misdariis, N. Revealing the stimulus-driven component of attention through modulations of auditory salience by timbre attributes. Sci. Reports 13, 6842 (2023). 30. Kothinti, S. R., Huang, N. & Elhilali, M. Auditory salience using natural scenes: An online study. The J. Acoust. Soc. Am. 150, 2952–2966 (2021). 31. Kaya, E. M. & Elhilali, M. Investigating bottom-up auditory attention. Front. human neuroscience 8, 85912 (2014). 11/12

32. Podwinska, Z., Sobieraj, I., Fazenda, B. M., Davies, W. J. & Plumbley, M. D. Acoustic event detection from weakly labeled data using auditory salience. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 41–45 (IEEE, 2019). 33. Huang, N. & Elhilali, M. Auditory salience using natural soundscapes. The J. Acoust. Soc. Am. 141, 2163–2176 (2017). 34. Huang, X.-Y., Cherng, F.-Y., King, J.-T. & Lin, W.-C. Eeg-based measures of auditory saliency in a complex context. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, 1–11 (2019). 35. Gemmeke, J. F. et al. Audio set: An ontology and human-labeled dataset for audio events. In 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), 776–780 (IEEE, 2017). 36. Luck, S. J. Ten simple rules for designing and interpreting erp experiments. Event-related potentials: A methods handbook 4 (2005). 37. Gramfort, A. et al. Meg and eeg data analysis with mne-python. Front. Neuroinformatics 7, 267 (2013). 38. Bigdely-Shamlo, N., Mullen, T., Kothe, C., Su, K.-M. & Robbins, K. A. The prep pipeline: standardized preprocessing for large-scale eeg analysis. Front. neuroinformatics 9, 16 (2015). 39. Pion-Tonachini, L., Kreutz-Delgado, K. & Makeig, S. Iclabel: An automated electroencephalographic independent component classifier, dataset, and website. NeuroImage 198, 181–197 (2019). 40. Bell, A. J. & Sejnowski, T. J. An information-maximization approach to blind separation and blind deconvolution. Neural computation 7, 1129–1159 (1995). 41. Yan, R. et al. SAAD-EEG: A High-Density EEG Dataset for Stimulus-Driven Auditory Attention, DOI: 10.5281/zenodo. 20557225 (2026). [Dataset]. 42. Deng, Y., Choi, I. & Shinn-Cunningham, B. Topographic specificity of alpha power during auditory spatial attention. NeuroImage 207, 116360 (2020). 43. Cavanagh, J. F. & Frank, M. J. Frontal theta as a mechanism for cognitive control. Trends cognitive sciences 18, 414–421 (2014). 44. Lawhern, V. J. et al. Eegnet: a compact convolutional neural network for eeg-based brain–computer interfaces. J. neural engineering 15, 056013 (2018). 45. Mahjoory, K., Bahmer, A. & Henry, M. J. Convolutional neural networks can identify brain interactions involved in decoding spatial auditory attention. PLOS Comput. Biol. 20, e1012376 (2024).

Acknowledgements This work was partially supported by the Research Grants Council of the Hong Kong SAR (Grant No. C5052-23G, PolyU15215623, PolyU15229824, PolyU25216423, PolyU15217424, and SRFS2526-5S04), the National Natural Science Foundation of China (Grant No. 62306259), and The Hong Kong Polytechnic University (P0056503, P0058445, and P0060651). This work was also supported by the National Natural Science Foundation of China (Grant No. 62476213) and the Natural Science Basic Research Program of Shaanxi Province (Grant No. 2024JC-YBMS-486).

Author contributions R.Y. and J.W. conceived the dataset and designed the experiment. R.Y., S.P., W.Y. collected the EEG and behavioral data. R.Y., W.Y., Z.C., Y.Y. performed preprocessing, dataset curation, and technical validation analyses. R.Y. drafted the manuscript. J.W., N.L., W.Y., S.P. contributed to results discussion and manuscript writing. J.W., K.T., N.L., Y.L. supervised the whole project.

Competing interests The authors declare no competing interests.

12/12

Related documents

Record · ID 1169665 · SHA-256 a3c48359146e89cd
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive