Toward Deployable Bangla Sign Language Recognition with Expert-Validated Data and a Lightweight Attention-Based Model
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
Toward Deployable Bangla Sign Language Recognition with Expert-Validated Data and a Lightweight Attention-Based Model Saad Ahmeda,, Md Khalid Syfullaha a Department of Computer Science and Engineering, Bangladesh Army University of Science and Technology, Saidpur
Cantonment, Saidpur, Bangladesh
arXiv:2608.06252v1 [cs.CV] 6 Aug 2026
Abstract Deaf and hard-of-hearing people in Bangladesh communicate mainly through Bangla Sign Language (BdSL). Automatic BdSL recognition on personal devices could widen access to education and services. Existing systems use controlled-setting datasets without expert verification and heavyweight pretrained backbones unsuited to on-device use. We introduce RSBdSL38, 10,874 expert-validated images spanning all 38 BdSL hand signs, representing the 51 letters of the Bangla alphabet, recorded from real signers at three special-needs schools across Bangladesh. We propose a lightweight attention-based convolutional network of 298,470 parameters, built from grouped bottleneck residual blocks, channel and spatial attention, a multi-scale depthwise hand-feature block, dual pooling, and Swish activations. Trained from scratch, it attains 96.37% accuracy (95.72% ± 0.54% over five seeds), within 1.08 percentage points of the best of nine ImageNet-pretrained efficient architectures under an identical protocol, using 8.5 to 68× fewer parameters and 1.3 to 21.7× fewer MACs. Retrained, it reaches 92.95 to 98.33% on six public BdSL benchmarks, 97.04% on a merged corpus, and 76.25% zero-shot on BdSL-38. Removing any architectural stage costs 7.61 to 89.30 points, against at most 3.17 for the training recipe. Grad-CAM with deletion–insertion and weight-randomization checks confirms that predictions follow the signing hand. A signer-independent split holding out 6 of 36 signers yields 85.18%. Quantized to 0.48 MB, it runs at 3.98 ms per image within a 15.5 MB footprint on a commodity smartphone. Together, RSBdSL38 and our from-scratch model turn benchmark accuracy into deployable accessibility at a fraction of pretrained-backbone cost; dataset, code, and models are released. Keywords: Bangla sign language, sign language recognition, lightweight CNN, attention mechanism, benchmark dataset, ablation study
1. Introduction Spoken language is inaccessible to the approximately 430 million people worldwide, over 5% of the global population, who live with disabling hearing loss, a figure the World Health Organization projects will exceed 700 million by 2050 [32]. In Bangladesh the prevalence of hearing impairment is nearly 9.6%, almost double the global average, and an estimated 2.5 to 3 million people rely on Bangla Sign Language (BdSL) daily [12, 52]. Their barriers to education, healthcare, employment, and social participation follow not from the disability itself but from the absence of communication bridges. Certified BdSL interpreters are few and concentrated in urban centres, so for most of the deaf and hard-of-hearing (DHH) population an interpreter is not available when communication is needed. An automatic recognition system running on the hardware people already own is therefore not a convenience but a substitute for a service that does not otherwise exist. Sign language is a complete, rule-governed visual-gestural language with its own phonology, morphology, grammar, and lexicon, and is not universally shared across nations or regions [47, 55]. BdSL, formally recognized in 2000 by the Centre for Disability in Development, is the primary means of communication for the DHH community in Bangladesh [22]; it comprises 38 hand signs representing the 51 letters of the Bangla alphabet, in both one-handed and two-handed forms [30]. Alphabet-level, or fingerspelling, recognition is the entry point to the problem: it underpins name and loanword spelling, classroom instruction, and interactive learning tools, and supplies the visual front end on which later word- and sentence-level systems are built [38].
Visually the task is harder than its 38-way label space suggests. Several BdSL signs differ only in the flexion of a single finger or a small change of palm orientation, so the between-class distance in image space can be smaller than the within-class distance induced by a change of signer, viewpoint, or lighting; skin tone, hand size, and articulation habits all vary strongly across signers. The discriminative evidence occupies a small, deformable, self-occluding region, while the remaining pixels, clothing, furniture, classroom walls, are class-irrelevant and often higher in contrast than the hand itself. A recognizer that works outside the laboratory must therefore learn where to look as well as what to look for, from the modest labelled data that low-resource sign languages can realistically provide. Deep learning has advanced automatic sign language recognition (SLR) considerably. Convolutional Neural Networks (CNNs) are the dominant paradigm for image-based SLR, reaching high accuracy on American, Chinese, and German Sign Language [3, 40]; transfer learning from large pretrained models is widely used to compensate for the limited data available in low-resource domains [13, 31, 53], alongside ensembles, attention mechanisms, and hybrid CNN-LSTM designs [12, 22, 34]. In parallel, the wider vision community has produced a mature family of efficient backbones, MobileNetV4, MobileViT, EfficientNetV2, EfficientFormerV2, and GhostNetV2 among them [25, 28, 29, 35, 48, 49], attention modules that improve feature selectivity at small parameter cost [18, 56], and attribution tools that expose what a trained model actually uses [1, 6, 33, 41]. These three lines, efficient design, attention, and verifiable explanation, are individually well developed but are rarely brought together in the BdSL literature. Deployability is the property that decides whether any of this reaches a user. An assistive BdSL recognizer will most plausibly run offline on a mid-range Android phone, a classroom tablet, or a low-cost embedded board, sharing memory and battery with the application around it. A 20M-parameter backbone executing hundreds of millions of multiply–accumulate operations per frame is a poor fit under that constraint, however strong its benchmark accuracy: accuracy per parameter, per multiply–accumulate operation, and per megabyte matters as much as accuracy itself, and should be measured on the target hardware rather than inferred from parameter counts alone. Despite this broader progress, BdSL recognition remains comparatively underexplored, for three reasons. First, expert-verified BdSL data is scarce: the existing public datasets, BDSL49 [15], BdSL36 [17], KUBdSL [21], BAUST Lipi [12], BdSL47 [39], and Shongket [14], share few contributors (typically 10 to 42), predominantly non-signing volunteers, no complete expert linguistic verification (BdSL36 [17] being a partial exception, collected at a deaf school and filtered by signer experts), and controlled capture that does not reflect real-world diversity, all of which constrain generalizability. Second, prior BdSL models are either heavyweight pretrained architectures not optimized for efficient deployment, or custom models evaluated only on their own data without cross-dataset or ablation validation [20, 51]. Third, the evaluation protocols are permissive: results are almost universally reported on class-stratified splits in which images of the same signer appear in both partitions, so the reported figure silently includes what the model has learned about individual people, and neither signer-independent nor zero-shot cross-corpus performance is characterized. It therefore often remains unclear whether reported accuracies reflect architectural merit, dataset idiosyncrasies, or evaluation leakage. To address these gaps, we propose RSBdSL38, an expert-validated BdSL dataset collected from real signers, together with a lightweight attention-based recognition model designed for resource-constrained deployment, and an evaluation protocol that measures the properties deployment actually depends on. Our contributions are four-fold: • We introduce RSBdSL38, a BdSL dataset of 10,874 images covering all 38 BdSL hand signs (51 Bangla letters), collected from real signers at three special-needs schools in three regions of Bangladesh together with additional volunteers, and validated in full by a sign language expert to ensure linguistic authenticity. • We design a lightweight attention-based CNN of only 298,470 parameters (1.14 MB, 132.7 M multiply– accumulate operations) integrating grouped bottleneck residual blocks, channel and spatial attention, a multi-scale depthwise hand-feature block, dual-pooling aggregation, and Swish activations, which trained from scratch is competitive with nine modern ImageNet-pretrained efficient architectures at 8.5 to 68× fewer parameters and generalizes to six public BdSL benchmarks and a merged four-dataset corpus without architectural change.
2
• We validate the design through a stage-wise depth ablation covering all 14 stage-removal combinations and parameter-matched component controls that isolate the training recipe and the activation function from model capacity, and verify that the learned attention localizes the signing hand using Grad-CAM and Grad-CAM++ maps with deletion and insertion faithfulness measures and a weight-randomization sanity check. • We report the deployment-facing evaluation the BdSL literature omits: a signer-independent protocol holding out 6 of the 36 signers entirely, zero-shot cross-corpus transfer without fine-tuning, and end-toend efficiency measurements including multiply–accumulate cost, quantized model size, and on-device latency and memory on a commodity Android smartphone. We investigate the following Research Questions (RQs): • RQ1: Can a lightweight model trained from scratch match modern ImageNet-pretrained efficient architectures on BdSL recognition at a fraction of the parameter budget? • RQ2: How well does the proposed architecture generalize across public BdSL benchmarks and a merged multi-dataset corpus without any architectural modification, and how much of that performance survives when the trained model is transferred to a new corpus with no adaptation? • RQ3: Which architectural components and training-recipe elements contribute most to recognition performance, as quantified by systematic ablation? • RQ4: Does expert-validated data collected from real signers (RSBdSL38) constitute a more challenging and ecologically valid benchmark than existing volunteer-collected BdSL datasets, and how much accuracy is lost when the evaluation removes signer overlap? • RQ5: Does the model base its predictions on the signing hand rather than on background context, as required for deployment in uncontrolled environments? The paper is organized as follows. Section 2 presents the background concepts and Section 3 reviews related work and identifies the research gaps. Section 4 introduces RSBdSL38, Section 5 details the architecture and methodology, and Section 6 reports the experiments and findings. Section 7 concludes; supporting material, including the detailed architecture diagram, the per-class classification report, and the complete ablation tables, is provided in the appendices. 2. Background This section reviews the concepts the proposed recognizer builds on. Fig. 1 summarizes how they relate to one another and to the contributions of this paper. 2.1. Bangla Sign Language and Alphabet-Level Recognition BdSL is not a visual copy of spoken Bangla; it has its own signing conventions, hand shapes, and movement patterns. Its manual alphabet uses 38 canonical hand signs for the 51 letters of the written script, because multiple letters share an identical sign form [22, 30]. Alphabet-level recognition is foundational, supporting fingerspelling, classroom communication, assistive translation, and later word- and sentence-level systems [38], but demanding: several classes are separated only by the position of a single finger, so the recognizer must resolve fine articulatory detail rather than coarse hand silhouette. 2.2. Need for Realistic and Expert-Verified Data Recognizers are highly sensitive to how the data are collected: a model trained on posed gestures from a few volunteers can score well on a test split from the same setting and fail on real users in new environments. Expert verification matters for a specific reason: small changes in finger shape or hand orientation change a sign’s meaning, and a volunteer who does not sign daily may produce a form close to, but not, the canonical one, which then enters the training set as label noise. A realistic benchmark therefore needs authentic signers, diverse capture conditions, expert validation, and a protocol that does not place one signer’s images in both partitions. 3
Bangla Sign Language
Realistic and Verified Data
Compact Vision Models
Model Training and Deployment
Visual language shaped by hand form and movement
Authentic signers
Focus on fingers, palm, and hand position
Small task-specific model trained from scratch
Manual alphabet connects signs with Bangla letters
Varied backgrounds and capture conditions
Reduce attention to irrelevant backgrounds
Modern pretrained models provide strong comparisons
Expert-verified labels
Learn compact and selective visual features
Balance accuracy, compactness, and practical deployment
Foundation for communication and broader recognition, especially for deaf people
Figure 1: Conceptual overview of the background for Bangla Sign Language recognition: the structure of the BdSL manual alphabet, the data-collection requirements of a realistic benchmark, the role of channel and spatial attention in compact models, the building blocks of efficient convolutional design, and the choice between ImageNet-pretrained backbones and task-specific networks trained from scratch.
2.3. Attention in Lightweight Vision Models Attention mechanisms help a network focus on the most informative parts of an image. In hand-sign recognition the evidence is concentrated around the fingers, palm, and relative hand positions, while the background carries little class information: channel attention emphasizes useful feature types and spatial attention highlights important regions [18, 56]. Both are cheap, a channel-attention module with reduction ratio r adding only 2C 2 /r weights to a C-channel feature map and a single-map spatial gate one convolution kernel, which makes them the cheapest way for a sub-megabyte network to decide where to spend capacity. 2.4. Efficient Convolutional Design Efficient convolutional networks reduce computational cost by reusing simple building blocks: residual connections, bottleneck layers, grouped convolutions, and depthwise operations [7, 16, 24, 57]. A bottleneck halves the channel count before the spatial convolution and restores it afterwards; a grouped convolution with g groups divides the cost of that layer by g; a depthwise convolution takes this to its limit by giving every channel its own kernel. These designs suit assistive technologies that must run on smartphones, classroom devices, or low-cost embedded hardware. Here the model is designed from the outset as a small BdSL-specific recognizer rather than a reduced version of a much larger one. 2.5. Pretrained Backbones and Training from Scratch Transfer learning from ImageNet-pretrained models is common in sign language recognition because it often improves accuracy when target data are limited [9, 22, 44], and modern efficient families such as MobileNetV4, MobileViT, EfficientNetV2, EfficientFormerV2, and GhostNetV2 offer strong baselines [25, 28, 29, 35, 48, 49]. Pretrained backbones nonetheless demand more memory and infrastructure than a compact task-specific model, and their capacity is allocated to a 1000-class natural-image problem whose statistics differ substantially from close-range hand imagery, which is the trade-off between accuracy, compactness, and deployment practicality that this paper examines. 2.6. Explaining and Verifying Model Behaviour Accuracy on a held-out split does not reveal which pixels a model used, and a recognizer that keys on a recurring background can score well and fail immediately in deployment. Grad-CAM [41] and Grad-CAM++ [6] produce class-conditional localization maps that make this visible, but a plausible-looking map is not itself evidence of faithfulness. The deletion and insertion curves of Petsiuk et al. [33] test whether the highlighted region is the evidence actually relied on, and the cascading weight-randomization test of Adebayo et al. [1] checks that the map depends on the learned parameters rather than the input’s edge content. This work uses all four, since each addresses a different way an explanation can mislead. 4
3. Related Work This section reviews prior BdSL recognition research as dataset-oriented, model-oriented, and combined dataset-and-model studies. Table 1 gives the per-study detail along four axes, the data used, the model proposed, the reported result, and the limitation that remains; the discussion below draws out the patterns, so that the gaps addressed by this paper can be traced to specific studies. 3.1. Dataset-Oriented Studies Dataset development has been a key part of BdSL research, as recognition performance depends heavily on dataset size, class coverage, signer diversity, and background variation. The largest public resource is BDSL49, with 29,490 images over 49 classes of alphabets, numerals, and special characters collected from 14 adult volunteers, released together with detection and recognition benchmarks [15]. BdSL36 took a different route, expanding a modest base of self-collected and external images through augmentation and large-scale background synthesis to improve visual diversity and robustness to background variation [17]. The remaining resources are smaller and more specialized. Ishara-Lipi and Ishara-Bochon expose how little usable public BdSL character data exists [8]; Okkhornama supports 49-class detection with more than 110 images per class and targets real-time edge devices [43]; BdSL47 adds landmark-based representations to 4,700 RGB images of 47 classes from 10 participants [39]; KU-BdSL offers 1,500 images across 30 classes from 39 participants as an open resource paper [21]; and Shongket covers 36 letters and 10 digits in 5,820 images, with a CNN reaching 95% on digits and 91.4% on letters [14]. Across this group, the recurring pattern is a small contributor pool, a controlled capture setting, and the absence of any documented linguistic review of the collected images. 3.2. Model-Oriented Studies Model-oriented research has pursued accuracy through transfer learning, ensembles, explainable AI, and privacy-preserving frameworks. A max-voting ensemble of five pretrained CNNs (Xception, InceptionV3, DenseNet121, ResNet50, and MobileNetV2) reaches 96.62% on BdSL-38 and 99.92% on BDSL-49, showing the effectiveness of ensemble-based decision fusion [22], while federated training with FedAvg, FedProx, and FedOpt on landmark representations of BdSL47 reports 98.36% with VGG19 and FedAvg, demonstrating that privacy-preserving learning need not cost recognition performance [10]. Transfer learning is the most widely explored single strategy: among MobileNet, Xception, ResNet50, and InceptionV3 on BDSL-49, Xception attains the best result at 97.86% [44], and a CNN with squeeze-andexcitation blocks [18], SHAP interpretation, and a Flutter front end reaches 99.86% on an augmented KUBdSL [36]. A multimodal ensemble over spatial, skeletal, and edge-based streams reports training accuracies of 99.77%, 98.11%, and 99.30% on a 38-class corpus [42]. Closest to the present setting, a self-attention CNN (SA-CNN) of 671,942 parameters improves a plain CNN from 92.32% to 93.47% on a 38-class dataset, showing that attention pays off even within compact architectures [51]; at the opposite extreme, a fine-tuned DINOv2 vision transformer (ViT-S/14) reaches 99.7% accuracy and F1-score on BDSL49 [53]. The accuracy ceiling in this group is high, but it is reached either by ensembling several heavyweight backbones or by finetuning a 21M-parameter transformer, and no study in the group reports the compute, memory, or latency that such a system would require on a mobile device. 3.3. Combined Dataset-and-Model Studies A large portion of BdSL research follows a combined strategy in which authors first construct or extend a dataset and then validate a proposed model on that same dataset. Examples span a 2,660-image letterand-digit corpus on which ResNet152V2 reaches 98.5% [5]; BAUST Lipi, an 18,000-image set of 36 alphabets from 15 volunteers paired with a hybrid CNN-LSTM at 97.28% [12]; and a 2,340-sample RGB set with varied backgrounds classified at 92% by a custom CNN [20]. Real-time recognition and translation prototypes follow the same pattern on self-curated data: 3,600 images from 12 volunteers with a 2D CNN and adaptive thresholding at 99.72% [50], a 4,600-image extension covering 36 letters and 10 digits at 99.57% [4], and a 9,000-image set augmented to 36,000 and classified by Google Teachable Machine models at 99.98% [11]. More specialized directions include numeral recognition from 300 images of 30 participants using MediaPipe landmarks, where SVM reaches 100% and LightGBM 95.60% [23], and the large BdSL-D1500 corpus of roughly 132,061 images across 87 classes with 5
6
ResNet50-based classifiers with background augmentation. Deep transfer learning with a random forest classifier. Edge-device detection models, including YOLOv7 and Faster R-CNN. Landmark-based artificial neural network (ANN) baseline. Open dataset resource paper.
Max-voting ensemble of five pretrained CNNs. Federated learning using FedAvg, FedProx, and FedOpt. Transfer learning models, including MobileNet and Xception. CNN with squeeze-and-excitation blocks and SHapley Additive exPlanations (SHAP) interpretation.
Self-attention CNN with 671,942 parameters. Fine-tuned DINOv2 ViT-S/14 with 21M parameters.
Hybrid CNN-LSTM model. Custom CNN architecture. 2D CNN with adaptive thresholding. 2D CNN recognition and translation pipeline. Google Teachable Machine models. MediaPipe landmarks with a support vector machine (SVM) and LightGBM. Classification and segmentation pipelines.
1,200 self-collected images and 1,700 external images, augmented with background synthesis.
Ishara-Lipi and Ishara-Bochon character and digit data.
Okkhornama dataset with 49 classes and more than 110 images per class.
4,700 RGB images from 10 participants covering 47 classes.
1,500 images from 39 participants covering 30 classes.
5,820 images covering 36 letters and 10 digits.
BdSL-38 and BDSL-49 datasets.
BdSL47 with landmark-based representations.
BDSL-49 dataset.
Augmented KU-BdSL dataset.
BdSL dataset with 38 classes and 12,581 images.
BdSL dataset with 38 classes and 12,160 images.
BDSL49 dataset.
2,660 images covering 36 letters and 10 digits.
18,000 images covering 36 alphabets.
2,340 RGB images with varying backgrounds.
3,600 images for 36 characters from 12 volunteers.
4,600 images for 36 letters and 10 digits.
9,000 images across 45 classes, augmented to 36,000 images.
300 images for numerals from 30 participants.
132,061 images across 87 classes, including 2,300 images for segmentation.
Hoque et al. (2020) [17]
Das et al. (2023) [8]
Siddique et al. (2023) [43]
Rayeed et al. (2023) [39]
Jim et al. (2023) [21]
Hasan et al. (2021) [14]
Kabir et al. (2025) [22]
Diba et al. (2024) [10]
Sraboni et al. (2024) [44]
Raihan et al. (2024) [36]
Shams et al. (2024) [42]
Tapu et al. (2025) [51]
Tasnim et al. (2026) [53]
Billah et al. (2022) [5]
Hadiuzzaman et al. (2024) [12]
Islam et al. (2022) [20]
Tanvir et al. (2021) [50]
Alam et al. (2021) [4]
Emon et al. (2025) [11]
Karim et al. (2025) [23]
Podder et al. (2022) [34]
Transfer learning CNNs.
Multimodal ensemble with three feature streams.
Classical and deep classifiers, including a CNN.
YOLOv4 and deep classification models.
29,490 images covering 49 classes from 14 adult volunteers using smartphone cameras.
Hasib et al. (2023) [15]
Model description
Dataset description
Study
99.99% accuracy with ResNet18.
100% with SVM and 95.60% with LightGBM.
99.98% accuracy.
99.57% accuracy.
99.72% validation accuracy.
92% accuracy.
97.28% accuracy.
ResNet152V2 achieved 98.5% accuracy.
99.7% accuracy and 99.7% F1-score.
Accuracy improved from 92.32% to 93.47%.
Training accuracies of 99.77%, 98.11%, and 99.30%.
99.86% test accuracy.
Xception achieved 97.86% accuracy.
98.36% test accuracy with VGG19 and FedAvg.
96.62% on BdSL-38 and 99.92% on BDSL-49.
95% accuracy on digits and 91.4% on letters.
Benchmark resource for later research.
97.84% accuracy with the ANN.
85–97% detection performance.
91.67% character accuracy using VGG16 and random forest.
Improved visual diversity and robustness.
99.4% detection with YOLOv4; up to 93% recognition.
Reported result
No cross-dataset or signer-independent testing.
Numerals only; extremely small dataset.
Limited model transparency; heavy augmentation.
Limited signer diversity.
Only 12 student signers; controlled setting.
Weak generalization beyond own dataset.
50 × 50 inputs discard fine hand detail.
Small dataset; heavy reliance on augmentation.
Heavyweight; offline only; no edge deployment test.
Single dataset; no explainability; limited augmentation.
Heavy preprocessing; MediaPipe dependency; static signs.
No benchmarking against other public BdSL datasets.
Signs still misrecognized in real-time use.
Depends on landmark preprocessing; structured data only.
Very heavy ensemble; source datasets have few participants.
Small scale; grayscale only; no attention mechanisms.
Only 1,500 images; consonants only.
Controlled capture settings; 100 images per class.
Small custom set; mostly teenage volunteers.
Small dataset; character recognition still weak.
Visually similar classes cause misclassification; small base set.
Only 14 volunteers; limited environmental diversity.
Remaining limitation
Table 1: Summary of the reviewed literature on Bangla Sign Language datasets and recognition models. Studies are grouped by their primary contribution: dataset construction, model design, or both. Reported results are quoted as published and are not directly comparable across rows, since the underlying datasets, class inventories, and evaluation splits differ.
Data resize
Discard Image
Source 1 Capture Images Source 2 From individuals Open Camera
No Usable? (Correct+ Clear?)
Initial Dataset Yes
Source 3
Raw Data 38 classes Merged from all source
Raw Image of Various Resolution
1000x1000 Aspect Ratio 1:1
224x224
Final Dataset 38 Classes
Figure 2: Creation pipeline of the RSBdSL38 dataset: participant recruitment at three special-needs schools in three districts of Bangladesh together with additional adult volunteers, smartphone capture under uncontrolled backgrounds, a manual qualityscreening pass by the research team followed by expert validation of the class labels, preprocessing to 224 × 224 RGB, and class-stratified partitioning into training, validation, and test sets. Table 2: Participant demographics of RSBdSL38. The cohort combines deaf and hard-of-hearing pupils recruited at three special-needs schools with adult volunteers recruited to broaden hand morphology and skin-tone coverage. Attribute
Group
Count
Gender
Male Female
17 19
Age (years)
8–15 (school signers) 20–28 (adult volunteers)
21 15
Total participants
36
the companion BdSLHD-2300 segmentation set, on which ResNet18 attains 99.99% [34]. The trend toward practical prototypes is clear, but the near-perfect accuracies are obtained on splits drawn from the same small volunteer pool that produced the training images. Several research gaps emerge. Nearly all public BdSL datasets were captured from small pools of hearing volunteers (10 to 42 people) in controlled environments without expert verification, so models trained on them may learn volunteer-specific articulations rather than authentic BdSL. The strongest reported results rely on heavyweight pretrained backbones such as ResNet152V2 and the 21M-parameter DINOv2, or on multi-model ensembles [22, 53], which suit on-device assistive applications poorly, and none reports compute cost, quantized size, or measured on-device latency. The few lightweight designs, such as SA-CNN [51], were validated on a single dataset only. Cross-dataset evaluation and component-level ablation are almost entirely absent, leaving the contribution of individual architectural components unquantified [20, 34], and signer-independent evaluation is effectively unreported, so the optimism introduced by signer overlap in stratified splits is unknown across the field. Our proposed dataset, model, and evaluation protocol address all of these gaps. 4. The RSBdSL38 Dataset Existing BdSL datasets are predominantly collected from hearing volunteers in controlled laboratory conditions, and most provide no verification by a sign language expert (Section 3). RSBdSL38 (Real-Signer Bangla Sign Language, 38 classes)[2] was therefore designed around three principles: authentic signers, expert verification, and environmental diversity. Fig. 2 illustrates the complete creation pipeline. (i) Participants and Collection Protocol. Images were collected from real signers at three specialneeds schools in three different districts of Bangladesh, where BdSL is the daily medium of communication, supplemented by additional volunteers to broaden hand-shape and skin-tone diversity. In total, 36 participants contributed (17 male, 19 female) in two age bands: 21 aged 8–15 years, the deaf and hard-of-hearing pupils recruited at the schools, and 15 aged 20–28 years, the adult volunteers (Table 2). Mixing native child signers with adult contributors means the retained hand shapes reflect both fluent day-to-day articulation and a wider range of hand morphology and skin tone. All signs were captured with smartphone cameras framed on the hand region and articulated naturally, without constraining hand orientation or requiring uniform backgrounds, so the corpus contains the classroom walls, furniture, floor tiling, and variable illumination of the recording sites. Informed consent was obtained from all participants or their guardians. 7
Table 3: Mapping between the 38 RSBdSL38 class labels and the Bangla letters they represent. A single manual sign covers several written letters wherever those letters share an identical canonical hand form, which is why 38 signs span the 51 letters of the Bangla alphabet. Label
Letter
Label
0 1 2 3 4 5 6 7
অ আ ই/ঈ উ/ঊ ঋ/ৠ/◌ৃ এ ঐ ও
8 9 10 11 12 13 14 15
Letter
Label
ঔ ক খ/ক্ষ গ ঘ ঙ চ ছ
16 17 18 19 20 21 22 23
Letter জ/য ঝ ঞ ট ঠ ড ঢ ন
Label 24 25 26 27 28 29 30 31
Letter ত/ৎ থ দ ধ প ফ ব/ভ ম
Label
Letter
32 33 34 35 36 37
ল শ/স/ষ হ ◌ঁ ◌ং ◌ঃ
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
Figure 3: Representative samples of the 38 canonical BdSL hand signs in RSBdSL38, one randomly drawn image per class. The panels illustrate the uncontrolled capture conditions of the corpus, including classroom walls, furniture, tiled floors, and variable illumination, as well as the fine articulatory differences that separate several of the classes.
(ii) Class Inventory. RSBdSL38 covers the complete canonical BdSL manual alphabet: 38 sign classes jointly representing the 51 letters of the written Bangla alphabet [30], which makes it directly comparable with the 38-class benchmarks of recent literature [22, 42, 51] while providing complete alphabet coverage. Of the 38 signs, 9 are vowels (shoroborno) and the remaining 29 consonants and diacritic modifiers (banjonborno), with written letters that share an identical manual form grouped under a single sign. Table 3 gives the correspondence between class labels and Bangla letters, and Fig. 3 shows the 38 signs. (iii) Quality Screening. Prior to expert validation, the research team performed a manual screening pass over the collected images to remove samples unsuitable for recognition, discarding those with severe blur, a truncated or partially out-of-frame hand, or otherwise poor framing in which the hand shape could not be clearly discerned. This step filtered low-quality captures on purely visual grounds and is independent of the linguistic label check described next. The retained images were standardised to 224 × 224 RGB for model input, with the training-time rescaling and augmentation detailed in Section 5. (iv) Expert Validation. After the research team assigned an initial class label to every image, the complete dataset was independently reviewed by an experienced senior Bangla Sign Language teacher at one of the participating schools, who instructs deaf and hard-of-hearing students in BdSL as part of her regular duties. The images were organised into their 38 class folders and examined class by class on a computer: for each class, the expert confirmed whether the grouped images corresponded to the correct canonical BdSL sign for that label. Images identified as mislabelled or incorrectly articulated were flagged, and the corresponding corrections were applied by the research team. This independent expert review, in place of the volunteer self-labelling relied upon by prior BdSL corpora, yields the validated corpus of 10,874 images, distributed 8
Table 4: RSBdSL38 compared with existing public BdSL datasets. Several existing corpora contain more raw images, but RSBdSL38 is the only one that combines full 38-class alphabet coverage, genuine signers recruited at multiple geographic sites, uncontrolled capture conditions, and complete expert validation. Dataset
Classes
Images
Contributors
Expert verified
BDSL49 [15] BdSL36 [17] KU-BdSL [21] BdSL47 [39] Shongket [14] BAUST Lipi [12] BdSL-38 [22]
49 36 30 47 46 36 38
29,490 2,712 1,500 4,700 5,820 18,000 12,581‡
14 volunteers Volunteers 39 volunteers 10 volunteers Volunteers 15 volunteers Volunteers
No Yes† No No No No No
RSBdSL38 (ours)
38
10,874
36 real signers and volunteers
Yes
† BdSL36 images were collected at a deaf school and individually filtered by BdSL signer experts [17]; RSBdSL38 differs in
combining real signers from multiple sites, full 38-class alphabet coverage, and uncontrolled capture with complete expert validation. ‡ Usable image counts reported for this release vary slightly across studies (12,160 in [51]); we quote the 12,581 images of the public distribution, which is the set used for the zero-shot transfer experiment of Section 6.6.
approximately uniformly across the 38 classes (≈286 per class) and partitioned by class-stratified sampling into training, validation, and test sets of 8,794 / 977 / 1,103 images (80.9% / 9.0% / 10.1%). The same frozen partition is used for the proposed model and for every baseline in Section 6. A signed validation statement from the expert is retained by the authors and available on request. (v) Class Balance. The dataset is approximately balanced. Fig. 4 shows the per-class image counts: mean 286.2 per class, standard deviation 15.5, and a maximum-to-minimum imbalance ratio of only 1.25 (largest class = 320, smallest = 255). This near-uniform distribution avoids the majority-class bias that can otherwise inflate weighted metrics, so no single class dominates the metrics reported in Section 6 and the weighted and macro averages agree to within 0.02 percentage points. Table 4 contrasts RSBdSL38 with the public datasets used in this study. Several contain more raw images, but RSBdSL38 is unique in combining full-alphabet coverage, genuine BdSL signers from multiple geographic sites, uncontrolled capture conditions, and complete expert validation, the properties most directly tied to real-world generalization (RQ4). Because participant identity is recorded for every image, it additionally supports the signer-independent protocol of Section 6.3, which none of the compared datasets documents. 5. Methodology This section presents the technical details of the proposed recognizer: its operators, the building blocks that constitute a stage, the composition of the complete network, its parameter and compute budget, and the training procedure. Every symbol used in this paper are defined and summarized in Appendix A; the layer-level architecture diagram, the individual block diagrams, and the stage-wise configuration table are given in Appendix B. 5.1. Design Principles The overall architecture is shown in Fig. 5: the network maps a 224 × 224 × 3 RGB image to a probability distribution over the K = 38 classes using only 298,470 parameters. Four principles govern the design. First, bottleneck factorization with grouped convolutions [16, 57] keeps the spatial layers small enough that all four stages fit within 0.30M weights. Second, convolutional block attention [56] directs that limited capacity towards the signing hand rather than the background, which matters because RSBdSL38 is captured against uncontrolled scenes. Third, a dedicated multi-scale depthwise hand-feature block [7] captures finger-level and palm-level structure simultaneously, the two characteristic scales at which BdSL signs differ. Fourth, smooth activations with strong regularization [19, 37, 45, 54] compensate for a training set of fewer than nine thousand images.
9
Sign class
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37
0
100
200
300
0
100
200
300
Number of images Figure 4: Per-class image distribution of RSBdSL38 across the 38 sign classes. Counts are near-uniform (mean 286.2, standard deviation 15.5, maximum-to-minimum imbalance ratio 1.25), so weighted and macro-averaged metrics are effectively equivalent on this benchmark.
5.2. Operators and Preliminaries Three operators recur throughout the network and are defined here once. A grouped convolution with g groups partitions an input X ∈ RH×W ×Cin into g disjoint channel blocks X(1) , . . . , X(g) of Cin /g channels each, convolves every block with its own kernel, and concatenates the results: i h (1) W ∗g X = W(1) ∗ X(1) ∥ · · · ∥ W(g) ∗ X(g) ,
10
Stage 1 Stage 2
CBAM
MS-DW
Enhanced Residual Block
Hand Feature Block
Stage 3
Stem
Softmax
Dense 128
GMP+GAP
MS-DW
CBAMx2
MS-DW
CBAMx2
Pool
MS-DW
CBAMx2
Pool
MS-DW
CBAMx2
Stem Conv2D (32) MaxPool (3x3)
Input
Dense 64
Conv2D BatchNormalization MaxPool
Stage 4
14x14x128 14x14x96
224x224x3 RGB
56x56x32
28x28x32
14x14x64
Figure 5: Overall architecture of the proposed lightweight recognizer. A strided convolutional stem reduces the 224 × 224 input by a factor of four and is followed by four stages of width 32, 64, 96, and 128. Each stage contains two grouped bottleneck residual attention blocks followed by a multi-scale depthwise hand-feature block; stages 1 and 2 end in 2 × 2 max pooling, whereas stages 3 and 4 preserve the 14 × 14 resolution. A dual-pooling head concatenates global average and global max descriptors and passes them through two fully connected layers to a 38-way softmax. The layer-level diagram and the internal structure of each block are given in Appendix Appendix B.
where W(j) ∈ Rk×k×(Cin /g)×(Cout /g) . The kernel cost therefore falls from k 2 Cin Cout to k 2 Cin Cout /g [24, 57]. A depthwise convolution is the limiting case g = Cin = Cout , in which every channel receives its own k × k kernel and no cross-channel mixing occurs [7]: h
DWk×k (X)
i = u,v,c
k k X X
Wa,b,c Xu+a, v+b, c ,
(2)
a=1 b=1
at a cost of k 2 C weights, independent of the number of output channels. Batch normalization [19] standardizes each channel over the mini-batch and restores scale and shift through learned parameters γ and β: x − EB [x] BN(x) = γ · p + β. (3) VarB [x] + ϵ At inference the batch statistics are replaced by exponential running estimates, which constitute the network’s 6,208 non-trainable parameters. The Swish (SiLU) activation is used throughout, δ(x) = x · σ(x) =
x , 1 + e−x
(4)
which is smooth, non-monotonic, and preserves small negative activations; Section 6.9 shows this choice worth +0.99 percentage points relative to the Rectified Linear Unit (ReLU). 5.3. Model Architecture (i) Stem. Given an input image I ∈ R224×224×3 , the stem S0 applies a strided 5 × 5 convolution with 32 filters followed by batch normalization, Swish, and overlapping max pooling: X0 = S0 (I) = MaxPool3, s=2 (δ(BN(Wstem ∗s=2 I))) ,
(5)
which reduces the resolution by a factor of four to 56 × 56 × 32 using 2,432 convolutional weights (the 2,560 reported for the stem in Fig. B.1 additionally counts its 128 batch-normalization parameters). A single 5 × 5 kernel at stride two is preferred to a stack of small kernels because the earliest layer operates at the highest resolution, where compute is most expensive. (ii) Grouped Bottleneck Residual Attention Block. Each of the four stages i ∈ {1, 2, 3, 4}, with (1) (2) channel widths Ci ∈ {32, 64, 96, 128}, contains two residual blocks Bi and Bi . Let X ∈ RH×W ×C be the 11
block input with C = Ci . A bottleneck path compresses the channels to C/2, processes them with a grouped 3 × 3 convolution with gi ∈ {2, 4, 8, 16} groups, and re-expands to C: C U = δ BN W1×1 ∗ X ∈ RH×W × 2 , (6) c C V = δ BN W3×3 ∗gi U ∈ RH×W × 2 , (7) g 1×1 H×W ×C Y = BN We ∗ V ∈ R . (8) The compression halves the width seen by the 3 × 3 layer and the grouping divides its remaining cost by gi , so the spatial convolution costs 9C 2 /(4gi ) weights instead of the 9C 2 of a dense 3 × 3 layer of the same width. The group count scales with the stage width, from g1 = 2 to g4 = 16, keeping the per-group channel count close to constant across depth while the widening stages remain affordable. (iii) Channel Attention. Following the Convolutional Block Attention Module (CBAM) [56], the feature Y is first recalibrated along the channel axis. Global average and global max pooling produce two channel descriptors that are passed through a shared two-layer bottleneck multi-layer perceptron (MLP) with reduction ratio r = 16, summed, and squashed: Mc = σ Wa1 ϕ Wa0 GAP(Y) + Wa1 ϕ Wa0 GMP(Y) , (9) where Wa0 ∈ R r ×C and Wa1 ∈ RC× r are bias-free and shared between the two pooling paths, so the module costs only 2C 2 /r weights. The average descriptor summarizes how strongly a channel responds overall and the max descriptor how strongly it responds at its most active location; sharing the MLP forces both onto the same scale. The channel-refined feature is Y′ = Mc ⊗ Y, where ⊗ broadcasts the C-dimensional gate over all spatial positions. (iv) Spatial Attention. A single-channel spatial saliency map is then computed with a bias-free 7 × 7 convolution and sigmoid gating, Ms = σ f 7×7 (Y′ ) ∈ RH×W ×1 , Y′′ = Ms ⊗ Y′ , (10) C
C
which suppresses background regions and concentrates the representation on the signing hand. The large 7 × 7 support is affordable because the map has a single output channel, costing 49C weights, and lets one gate decision see a neighbourhood wide enough to contain a whole finger group. The block output is formed by a residual addition and Swish, Z = δ(Y′′ + P(X)) , (11) where the shortcut P is a 1 × 1 convolution with batch normalization in the first block of each stage, where the width changes, and the identity in the second [16]. Because the attention gates are multiplicative and bounded in (0, 1), the identity path is what prevents attenuation across eight successive gated blocks. (v) Hand-Feature Block. BdSL signs are distinguished at two characteristic scales: individual finger configuration (fine) and overall hand pose (coarse). To capture both cheaply, each stage ends with a multiscale block Hi built from depthwise convolutions. Given the stage feature Z, a 1 × 1 projection is followed by two parallel depthwise branches with 3 × 3 and 5 × 5 kernels, whose outputs are concatenated, fused, and regularized: H = δ BN W1×1 ∗Z , (12) p 3×3 5×5 H3 = δ BN DW (H) , H5 = δ BN DW (H) , (13) Z′ = SDρi δ BN W1×1 ∗ [H3 ∥ H5 ] , (14) f with stage-wise increasing spatial dropout rates ρi ∈ {0.05, 0.10, 0.15, 0.20} [54]. Spatial dropout removes entire feature maps rather than individual activations, the appropriate form of noise here because neighbouring activations within one map are strongly correlated and element-wise dropout would leave the channel largely intact. The two depthwise branches contribute only 34Ci weights, so the multi-scale capacity is nearly free; the 1 × 1 projection and fusion account for the block’s remaining 3Ci2 weights. (vi) Stage Composition. A stage applies its two residual blocks, then its hand-feature block, then a transition πi : (2) (1) Z′i−1 , Z′0 = X0 , (15) Z′i = Si Z′i−1 = πi ◦ Hi ◦ Bi ◦ Bi 12
where πi = MaxPool2, s=2 for i ∈ {1, 2} and πi = id for i ∈ {3, 4}. The four stages therefore operate on feature maps of 562 × 32, 282 × 64, 142 × 96, and 142 × 128, and the resolution is deliberately held at 14 × 14 through the last two stages: further downsampling would collapse the finger detail on which several classes depend, so the widening channel count supplies the additional capacity instead. (vii) Dual-Pooling Classification Head. Global max pooling preserves the single strongest response, useful when a sign’s identity hinges on one localized finger configuration, whereas global average pooling summarizes the overall activation pattern and is more robust to noise. The head C concatenates both rather than choosing between them: v = [GMP(Z′4 ) ∥ GAP(Z′4 )] ∈ R256 . (16) The vector v is processed by two fully connected layers with Swish, batch normalization, and dropout (p = 0.3), (17) h1 = BN δ Wf c1 Dropp (v) + b1 ∈ R128 , 64 h2 = BN δ Wf c2 Dropp (h1 ) + b2 ∈ R , (18) and the posterior over the K = 38 classes is produced by softmax: exp w⊤ k h2 + bk ŷk = PK k = 1, . . . , K. , ⊤ j=1 exp wj h2 + bj
(19)
The complete network is thus the composition ŷ = F(I) = C ◦ S4 ◦ S3 ◦ S2 ◦ S1 ◦ S0 (I).
(20)
5.4. Parameter and Compute Budget Counting only kernel weights, a residual block and a hand-feature block of width Ci cost |Bi | =
1 2 2 Ci
|{z}
compress
|Hi | =
Ci2
|{z}
9Ci2 4gi
+ 12 Ci2 + |{z}
|{z}
grouped 3×3
expand
channel attn.
+ +
project
|{z} 34Ci | {z }
+ 2Ci2 .
DW 3×3, 5×5
fuse
2Ci2 r
+
49Ci | {z }
,
(21)
spatial attn.
(22)
|{z}
For the widest stage (C4 = 128, g4 = 16) a complete residual block occupies 27,776 parameters including biases and normalization, roughly 5.3× fewer than the 147,584 a dense 3 × 3 convolution of the same width would need. Over the stem, the eight residual blocks, the four hand-feature blocks, and the head, the network contains 298,470 parameters, 292,262 trainable and 6,208 non-trainable batch-normalization statistics, occupying 1.14 MB in single precision: roughly 8.5× fewer than the smallest pretrained baseline of Section 6 and 68× fewer than the largest. The inference cost follows from summing the per-layer multiply– accumulate (MAC) counts, X C in C out MACs = Hl Wl kl2 l l = 132.7 M, (23) gl l
at a 224 × 224 input, lower than every baseline in the comparison suite of Section 6.7. Table B.2 of Appendix Appendix B summarizes the stage-wise configuration. 5.5. Training Objective and Optimization The network is trained end-to-end by minimizing the ℓ2 -regularized categorical cross-entropy X 1 XX 2 ynk log ŷnk + λ ∥Wl ∥2 , N n=1 N
L=−
K
k=1
l
13
(24)
with λ = 10−5 applied to the stem kernel, the three bottleneck kernels and the shortcut projection of every residual block, and the two hidden fully connected layers. Optimization uses stochastic gradient descent (SGD) with Nesterov momentum [46], mt+1 = µ mt − ηt ∇θ L(θ t + µ mt ) ,
(25)
θ t+1 = θ t + mt+1 ,
(26)
with µ = 0.9 and initial learning rate η0 = 10−2 . Whenever the training loss fails to improve for five consecutive epochs the learning rate is halved, subject to a floor ηmin = 10−8 , ηt+1 = max 12 ηt , ηmin , (27) and training stops early if the training loss has not improved for thirty consecutive epochs, restoring the best weights, with a maximum budget of 300 epochs. Three checkpoints are retained throughout (best validation loss, best validation accuracy, and best training loss), and all reported results use the best-validation-accuracy checkpoint. The batch size is B = 32, pixel intensities are rescaled to [0, 1] for all three partitions, and all convolutional and dense kernels use He normal initialization [16]. 5.6. Data Augmentation To improve robustness to viewpoint and illumination variation, each training image is passed through a stochastic geometric operator followed by a stochastic photometric operator, Ĩ = (τpho ◦ τgeo )(I) ,
(28)
where τgeo composes a random rotation of up to ±15◦ , a random zoom of ±10%, and a random translation of ±10% along each axis, and τpho composes random brightness (±0.08), contrast (±10%), saturation (±10%), and hue (±0.08) jitter, every parameter drawn independently per image and per epoch. Horizontal and vertical flipping are deliberately excluded: BdSL signs are articulated with respect to a dominant hand and a fixed palm orientation, so a mirrored image is not a valid example of the same class and would inject label noise rather than useful invariance. The photometric jitter is kept mild because hue and saturation shifts interact with skin tone, a genuine source of variation in the dataset rather than a nuisance to be normalized away. Augmentation is applied on-the-fly to training data only, validation and test images being rescaled but never augmented, and its contribution is quantified in Section 6.9. 5.7. Implementation and Reproducibility The model is implemented in TensorFlow/Keras and trained on a single NVIDIA GPU, with a deterministic image pipeline seeded at 42 and the frozen class-stratified partition of Section 4 shared by the proposed model and every baseline. Unless stated otherwise, reported figures come from a single fixed-seed reference run; sensitivity to initialization is characterized separately by retraining from scratch over five seeds in Section 6.2. Trained weights, training histories, and per-run metrics are archived in Keras, CSV, and JSON form so that every number reported in Section 6 can be regenerated from the released artefacts. 6. Experimental Results We describe the experimental setup, report results on RSBdSL38 and six public BdSL benchmarks, quantify deployment efficiency, ablate the architecture and the training recipe, and examine what the trained model attends to, closing with a consolidated answer to the five research questions and the remaining limitations.
14
6.1. Experimental Setup All experiments ran in a cloud environment with NVIDIA GPU acceleration. The proposed model was implemented in TensorFlow/Keras and trained with the protocol of Section 5: SGD with Nesterov momentum, batch size 32, input 224×224, reduce-on-plateau scheduling, and early stopping. The pretrained baselines were implemented in PyTorch via timm and fine-tuned end-to-end from ImageNet weights [9] with AdamW [26] (learning rate 5 × 10−5 , weight decay 10−3 , classifier dropout 0.3) under the same scheduling and stopping rules. The optimizer differs by design, SGD suiting a network trained from scratch and AdamW being standard for fine-tuning; every other factor is fixed, including the frozen class-stratified 8,794 / 977 / 1,103 partition of Section 4 (80.9% / 9.0% / 10.1%), the input resolution, the batch size, and the augmentation pipeline. Unless otherwise noted a single fixed seed is used; the proposed model is additionally retrained over five seeds (Section 6.2). Performance is reported as accuracy, weighted precision, weighted recall, and weighted F1-score, computed in the standard way from the per-class counts of true positives, true negatives, false positives, and false negatives. Per-class values are aggregated by support-weighted averaging; because RSBdSL38 is close to uniform, the weighted and macro averages agree to within 0.02 percentage points, so the choice affects no conclusion below. 6.2. Results on RSBdSL38 Under the fixed reproducibility seed, the proposed model achieves 96.37% test accuracy on the 1,103image RSBdSL38 test set, with weighted precision 96.50%, recall 96.37%, and F1-score 96.38% (macro F1 96.37%). The best checkpoint was reached at epoch 181, with training accuracy 98.56% and validation accuracy 96.04%; the 2.52 percentage-point train–validation gap and the close agreement between validation and test accuracy indicate that the regularization suite controls overfitting without underfitting. Retraining from scratch over five seeds (42–46) gives a mean of 95.72% ± 0.54% accuracy, weighted precision 95.90% ± 0.46%, and F1-score 95.72% ± 0.54%; the standard deviation stays at or below 0.54 percentage points on every metric, the full range spans only 1.36 points (95.10 to 96.46%), and best validation accuracy is more stable still at 96.00% ± 0.19% (Table C.1, Appendix Appendix C; Fig. 6). The reference run lies 0.65 points above the sweep mean, within 1.2 standard deviations, so it is representative rather than exceptional; all headline comparisons use the single-run protocol applied to every model, with the sweep as the stability estimate. Fig. 7 shows the five-seed mean training and validation curves (±1 std bands): the reduce-on-plateau schedule converges smoothly with no divergence between training and validation loss. Run length varies from 184 to 263 epochs (206.2 ± 34.4) and training time from 118.9 to 177.4 minutes (136.0 ± 25.7) on a single GPU, so the model reproduces in roughly two hours. Unless stated otherwise, the per-class report (Table C.2, Appendix Appendix C) and the confusion matrix (Fig. 8) correspond to the single-seed reference run. Per-class F1 ranges from 0.87 to 1.00, with four classes (11, 17, 21, 32) classified perfectly and 28 of 38 at or above 0.95; no class falls below 0.85 in precision or recall, the minima being precision 0.86 (class 5) and recall 0.86 (class 12). Only 40 of the 1,103 test images are misclassified and the errors are diffuse: the largest off-diagonal entry is three images (class 12 predicted as class 36) and every remaining pair at most two. Residual confusion concentrates among sign pairs with near-identical finger configurations, consistent with prior BdSL work [17]. 6.3. Signer-Independent Evaluation The results so far use a class-stratified split, in which images from a given signer may appear in both partitions. This is the standard protocol in the BdSL literature, and Sections 6.4–6.7 adopt it so that every model is measured identically. It does, however, allow a model to exploit signer-specific cues such as hand morphology or articulation habit rather than the sign itself, inflating accuracy relative to deployment on an unseen user. We therefore also evaluate under a signer-independent protocol: of the 36 participants, 30 are assigned to training and 6 held out entirely, with validation and test images both drawn from those 6, and the network retrained from scratch under the identical protocol of Section 5. No test signer’s images are ever seen during training, so the evaluation measures generalization to new people rather than to new images of known people. Because validation comes from the same held-out pool, checkpoint selection is exposed to those signers even though the weights are not, making the figure conservative-leaning but not fully isolated. 15
97.5
Score (%)
97.0 96.5
95.72±0.54
95.90±0.46
95.72±0.54
95.72±0.54
96.0 95.5 seed 42 seed 43 seed 44
95.0 Accuracy
seed 45 seed 46 mean ± std
Precision
Recall
F1-score
Figure 6: Five-seed stability of the proposed model on RSBdSL38, each seed retrained from scratch under the identical protocol. Coloured points are the individual seeds (42–46) and red diamonds mark the mean ± std; the y-axis is zoomed to approximately 95–96.5% so that the run-to-run spread, which is at most 1.36 percentage points, remains visible.
Model Accuracy
Model Loss 6
1.0
5 4
0.6
Loss
Accuracy
0.8
0.4
3 2
0.2
1
Train (mean±std) Validation (mean±std)
0
0.0 0
50
100
150
0
Epoch
50
100
150
Epoch
Figure 7: Training and validation accuracy (left) and loss (right) of the proposed model on RSBdSL38, averaged over five seeds (42–46). Solid lines are the mean and shaded bands denote ±1 std; curves are truncated to the shortest run (184 epochs) so that every plotted epoch is a true five-seed mean. Training and validation loss track one another throughout, with no divergence indicative of overfitting.
Signer-independent accuracy is 85.18% (weighted precision 86.42%, F1 85.23%) over the 1,417 held-out test images, an 11.19 percentage-point drop from the stratified 96.37% (Table 5). This is the measured cost of signer leakage: roughly a ninth of the stratified accuracy is attributable to recognizing familiar signers rather than the signs themselves. We report it openly because most published BdSL results use stratified or random splits without isolating this effect, so their headline numbers carry a comparable and usually 16
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37
True
0 30 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 28 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 25 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0 0 0 27 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 5 0 0 0 0 0 25 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 27 0 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 2 0 26 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0 13 0 0 0 0 1 0 0 0 0 0 0 0 0 27 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 1 0 28 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 1 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 28 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 27 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 1 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 33 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 34 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 35 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 36 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28 0 37 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28
30
25
20
15
10
5
0
Predicted
Figure 8: Confusion matrix of the proposed model on the RSBdSL38 test set (1,103 images, 38 classes; single-seed reference run). Forty images in total are misclassified and no off-diagonal cell exceeds three, so the residual errors are spread across many sign pairs rather than concentrated in one systematic confusion. Table 5: Stratified versus signer-independent evaluation of the proposed model. The signer-independent partition holds out 6 of the 36 signers entirely from training and evaluates on their 1,417 images. Both models are trained from scratch under the identical protocol, so the gap isolates the effect of signer overlap. Protocol
Acc. (%)
Prec. (%)
Rec. (%)
F1 (%)
Stratified (Section 6.2) Signer-independent
96.37 85.18
96.50 86.42
96.37 85.18
96.38 85.23
Gap
11.19
10.08
11.19
11.15
unmeasured optimism; 85% on genuinely unseen signers predicts deployed performance more faithfully than a stratified number close to the ceiling. The degradation is also informative about what fails. The train–test gap is modest (92.19% versus 85.18%), so the drop is not simple overfitting to the 30 training signers. The worst classes here (19, 11, 32, 36, and 35, all between 0.65 and 0.75 F1) differ from those dominating the stratified errors (5 and 12),
17
Class
Stratified
Signer-independent
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
0.50
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37
0.75
1.00
0.50
0.75
1.00
F1-score Figure 9: Per-class F1 under the stratified and the signer-independent protocols. The largest drops fall on classes whose form is most sensitive to individual hand morphology (classes 19, 11, 32, 35, and 36) rather than on the sign pairs that dominate the stratified errors, indicating that the additional errors arise from signer variation rather than from intrinsic visual ambiguity.
so the additional errors arise from signer-specific variation in articulation rather than intrinsic ambiguity between sign pairs. Nine of the 38 classes fall below 0.80 F1 where none do under the stratified split (Fig. 9). The stratified protocol remains the primary comparison basis for consistency with the baselines and prior literature, with this figure reported alongside as the more demanding estimate.
18
Table 6: Comparison with modern efficient architectures fine-tuned on RSBdSL38 under an identical protocol (identical splits, 224 × 224 inputs, batch size 32, identical augmentation). All pretrained models are initialized from ImageNet weights, whereas the proposed model is trained from scratch. Parameter counts are totals as reported by the respective frameworks; 292,262 of the proposed model’s 298,470 parameters are trainable. Rows are ordered by accuracy. The proposed model follows the same single-run protocol as the baselines; its five-seed mean ± std is reported in Table C.1 and its training time is the five-seed mean. Model
Params
Accuracy (%)
Precision (%)
Recall (%)
F1 (%)
Train time (min)
MobileNetV4-Hybrid-M [35] EfficientNetV2-S [48] EfficientFormerV2-S0 [25] MobileNetV4-Conv-S [35] EfficientFormerV2-S1 [25] MobileViT-S [28] EfficientNetV2-B0 [48] MobileViTv2-1.0 [29] GhostNetV2-1.0 [49]
9,842,326 20,226,166 3,259,708 2,541,702 5,752,660 4,961,990 5,907,382 4,408,335 4,924,586
97.45 97.15 97.09 96.97 96.91 96.54 96.48 96.18 95.33
97.54 97.23 97.19 97.08 96.97 96.64 96.64 96.28 95.44
97.45 97.15 97.09 96.97 96.91 96.54 96.48 96.18 95.33
97.46 97.15 97.08 96.98 96.90 96.53 96.49 96.17 95.32
60.9 81.8 76.7 61.2 93.5 133.7 45.0 153.8 66.6
Proposed (from scratch)
298,470
96.37
96.50
96.37
96.38
136.0
Table 7: Cross-dataset evaluation: the identical architecture, with no structural change and no per-dataset hyperparameter tuning, retrained from scratch on each corpus. Public benchmarks are ordered by accuracy. Dataset
Accuracy (%)
KU-BdSL [21] BdSL47 [39] Shongket [14] BdSL-38 [22] BAUST Lipi [12] BdSL36 [17]
98.33 97.81 95.15 94.57 93.56 92.95
RSBdSL38 (proposed dataset)† Merged corpus (4 datasets)
96.37 97.04
† Single-seed run, consistent with the other single-run rows; the five-seed mean ± std for RSBdSL38 is reported in Table C.1.
6.4. Comparison with Modern Efficient Architectures Nine architectures spanning five efficient design families, MobileNetV4 [35], MobileViT and MobileViTv2 [28, 29], EfficientNetV2 [48], EfficientFormerV2 [25], and GhostNetV2 [49], were fine-tuned on RSBdSL38 under the identical protocol of Section 6.1, with results in Table 6. Three observations stand out. First, the accuracy band across all ten models is narrow (95.33 to 97.45%), so RSBdSL38 is challenging enough that even 20M-parameter ImageNet-pretrained backbones cannot saturate it. Second, the proposed model, trained from scratch without external data, reaches 96.37%: above GhostNetV2-1.0 (95.33%) and MobileViTv2-1.0 (96.18%), within 0.11 percentage points of EfficientNetV2B0 and 0.17 of MobileViT-S, and within 1.08 of the best model, MobileNetV4-Hybrid-M, at 33× fewer parameters. Third, in accuracy per parameter it is an order of magnitude more efficient than every baseline, the deciding property where memory, energy, and thermal budgets are tight. Against SA-CNN, the only lightweight custom BdSL architecture in the literature (671,942 parameters, 93.47% on a comparable 38-class task) [51], it is 2.25× smaller and 2.90 percentage points more accurate. 6.5. Cross-Dataset Generalization A central claim of this work is that the architecture is not tuned to the idiosyncrasies of its own dataset. The identical architecture, with no structural change and the same training protocol, was therefore retrained from scratch on six public BdSL benchmarks and on a merged corpus combining RSBdSL38 with BdSL-38, BdSL47, and KU-BdSL (classes aligned by a manual mapping of shared signs), as summarized in Table 7 and Fig. 10.
19
KU-BdSL BdSL47 Merged corpus RSBdSL38 (ours) Shongket BdSL-38 BAUST Lipi BdSL36
98.33 97.81 97.04 96.37 95.15 94.57 93.56 92.95
90
92 94 96 98 Test accuracy (%)
100
Figure 10: Test accuracy of the identical architecture retrained from scratch on six public BdSL benchmarks, on RSBdSL38, and on the merged four-dataset corpus. Accuracy exceeds 92.9% everywhere without any per-dataset tuning, and is highest on the small, controlled corpora and lowest on those with uncontrolled backgrounds or low-resolution images.
The model exceeds 92.9% on every benchmark without per-dataset tuning. On BdSL-38 it attains 94.57% as a single 0.30M-parameter network, against 96.62% from a five-model ensemble of heavyweight pretrained CNNs [22] and 93.47% from the 0.67M-parameter SA-CNN [51]. On the merged corpus it reaches 97.04% accuracy (weighted precision 97.06%, F1 97.04%), higher than on any constituent set of comparable difficulty, so the architecture benefits from rather than being confused by increased signer and environment diversity. Accuracy also tracks dataset difficulty inversely (Section 3): highest on the small, controlled KU-BdSL and BdSL47 sets, lowest on the uncontrolled backgrounds of BdSL36 and the low-resolution BAUST Lipi images. 6.6. Zero-Shot Cross-Dataset Transfer Section 6.5 retrains the architecture on each target dataset and so tests whether the design transfers. A stricter question is whether the trained model transfers with no adaptation at all, which is what a deployed model faces on data from a new source and is rarely reported in the BdSL literature. We evaluate the RSBdSL38-trained reference model directly on the full public distribution of BdSL-38 [22] (12,581 images, identical 38-class label scheme, verified one-to-one) without any fine-tuning. The model attains 76.25% zero-shot accuracy (macro F1 76.00%, weighted F1 76.03%). The contrast with the 94.57% obtained when the same architecture is retrained on BdSL-38 (Table 7) isolates the domain shift: the 18.32 percentage-point difference is the portion of BdSL-38 accuracy that depends on adapting to its specific signers, cameras, and capture conditions rather than on the cross-corpus invariant structure
20
Zero-shot F1 (%)
100 80
macro F1 76.0
60 40 20
Transfers well Mutually confused (15, 23) 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37
0 Class
Figure 11: Per-class F1 for zero-shot transfer of the RSBdSL38-trained model to BdSL-38, with no fine-tuning. Most classes transfer well, with 34 of 38 above 0.60 F1; the two low outliers (classes 15 and 23) are mutually confused rather than failing independently. Table 8: Deployment efficiency of the proposed model against the pretrained baselines. Multiply–accumulate operations (MACs) and FP32 size are measured at 224×224. The final row gives the baseline-to-proposed ratio, from the least to the most demanding baseline on each axis; larger is better for the proposed model. Quantized sizes and measured on-device latency are reported for the proposed model in the text and in Table D.2. Params
MACs (M)
FP32 size (MB)
Accuracy (%)
MobileNetV4-Hybrid-M [35] EfficientNetV2-S [48] EfficientFormerV2-S0 [25] MobileNetV4-Conv-S [35] EfficientFormerV2-S1 [25] MobileViT-S [28] EfficientNetV2-B0 [48] MobileViTv2-1.0 [29] GhostNetV2-1.0 [49]
9,842,326 20,226,166 3,259,708 2,541,702 5,752,660 4,961,990 5,907,382 4,408,335 4,924,586
952.7 2873.0 406.7 188.8 667.4 1441.3 726.4 1436.3 176.3
37.5 77.2 12.4 9.7 21.9 18.9 22.5 16.8 18.8
97.45 97.15 97.09 96.97 96.91 96.54 96.48 96.18 95.33
Proposed (from scratch) ratio (min–max)
298,470 8.5–68×
132.7 1.3–21.7×
1.14 8.5–68×
96.37 —
Model
of the signs. That a model which has never seen a BdSL-38 image classifies three quarters of it correctly indicates substantially signer- and source-agnostic representations rather than memorized dataset artifacts. The per-class breakdown (Fig. 11) shows broadly even transfer, 34 of 38 classes above 0.60 F1 and a majority above 0.75, but two degrade sharply: class 15 (0.23 F1) and class 23 (0.47). These are not independent failures: of the 340 class-15 test images, 191 are predicted as class 23, and 93 class-23 images as class 15. Because the label mapping was verified beforehand, this is a genuine visual near-degeneracy in how BdSL-38 renders the two articulations rather than an annotation mismatch, and the retrained result confirms it is recoverable with a little target-domain fine-tuning. We report the zero-shot figure as a lower bound on deployed performance; it is not comparable to the retrained baselines of Section 6.4 and is used in no accuracy comparison against them. 6.7. Deployment Efficiency Parameter count alone does not determine deployability; compute cost, latency, and on-disk size matter as much on resource-constrained hardware. This section reports all three for the proposed model against the nine pretrained baselines of Section 6.4 on identical 224 × 224 inputs, summarized in Table 8 and plotted against compute cost in Fig. 12. Compute. At 132.7 M MACs the proposed model is the cheapest in the comparison, needing 1.3× fewer MACs than the next-lightest baseline (GhostNetV2-1.0) and 21.7× fewer than the heaviest (EfficientNetV221
98.0 Test accuracy (%)
97.5 97.0 96.5 96.0 95.5
MobileNetV4-Hyb-M EfficientFormerV2-S0 EfficientNetV2-S EfficientFormerV2-S1 MobileNetV4-Conv-S MobileViT-S EfficientNetV2-B0 Proposed MobileViTv2-1.0
GhostNetV2-1.0
Pretrained (timm) Proposed model
95.0
103 Compute (MACs, millions, log scale) Figure 12: Accuracy versus compute cost (MACs, logarithmic scale) on RSBdSL38. The proposed model (star) has the lowest compute cost of the ten models compared, and no model within 1.1 percentage points of its accuracy costs fewer multiply– accumulate operations.
S). The two MobileViT transformer baselines cost roughly 11× its compute; of these, only MobileViT-S is more accurate, and by just 0.17 percentage points (96.54% versus 96.37%), while MobileViTv2-1.0 is in fact 0.19 points behind it. In either case the compute penalty is far larger than the accuracy difference. On-disk size. As a single-precision Keras model the network occupies 1.14 MB, 8.5 to 68× smaller than the baselines. Post-training quantization compresses it further with negligible loss: dynamic-range TensorFlow Lite (TFLite) to 0.43 MB and full-integer INT8 to 0.46–0.48 MB, the latter actually improving test accuracy fractionally to 96.46%. At under half a megabyte it fits the flash budget of low-cost microcontrollers, which no pretrained baseline approaches. Latency. Measured single-image inference latency is 10.2 ± 0.8 ms on GPU (batch size 1) and 11.8 ms on desktop CPU through the XNNPACK delegate. Because latency depends on the measurement platform, we report it only for the proposed model and use MACs as the hardware-independent compute proxy in Fig. 12. On-device deployment. We deployed the 0.48 MB INT8 TFLite model on a commodity Android smartphone (Snapdragon 7+ Gen 3, 12 GB RAM) with the XNNPACK delegate and four threads. Over 249 timed runs the mean latency is 3.98 ± 0.09 ms (median 3.96, 95th percentile 4.16), approximately 251 frames per second, with peak memory 15.5 MB, initialization 13.8 ms, and 241 of 315 operators hardware-delegated (Table D.2, Appendix Appendix D). This exceeds the desktop-CPU figure because integer quantization matches the vector units of the mobile system-on-chip (SoC), establishing real-time recognition within a mobile memory budget without a GPU. Together these measurements substantiate the deployability claim in the paper’s title: the model is not merely small in parameter count but cheap to compute, sub-megabyte on disk, and real-time on a commodity smartphone, within 1.1 percentage points of backbones one to two orders of magnitude larger on every efficiency axis.
22
Full-model baseline
96.55 284K 298K
85.31
255K
Parameter count
300 85.22
84.86 79.87
80
Test accuracy (%)
Stage-removal accuracy
88.94 82.96
80.05
83.05
75.79 217K
60
80.15
250
75.70
74.07 241K
200
203K
173K
167K
158K
152K
150 124K
40
31.10
Parameters (K)
100
100
83K 69K
20
50
37K
7.25 22K
0 D0 Full
D1 -S1
D2 -S2
D3 -S3
D4 -S4
D5 -S1-S2
D6 -S1-S3
D7 -S1-S4
D8 -S2-S3
D9 -S2-S4
D10 -S3-S4
D11 -S1-S2-S3
D12 -S1-S3-S4
D13 -S2-S3-S4
0
D14 -All
Figure 13: Stage-wise depth ablation relative to the common D0 baseline. Bars show test accuracy for each of the 14 stageremoval configurations and the dashed line shows the corresponding parameter count. Every configuration degrades substantially, and the ordering of the bars does not follow the ordering of the parameter counts, showing that which stages remain matters more than how many parameters remain.
6.8. Ablation Study A: Stage-Wise Depth Ablation The first ablation asks how much each of the four stages contributes. We evaluate all 14 non-empty stageremoval configurations (four single, six pairwise, three triple, and all four) and retrain each from scratch under the full protocol of Section 5 on the identical split. All comparisons use one reference point, the full model D0, which reached 96.55% with 298,470 parameters in 192 epochs; this is an independent run of the same configuration as the reference model of Section 6.2 (96.37%), the 0.18-point difference lying well inside the ±0.54 seed variability of Table C.1, and fixing one baseline lets this study and Section 6.9 share an operating point. Multi-stage runs retain the fixed 2 × 2 downsampling transitions of Stages 1 and 2 so that downstream spatial resolution stays comparable; single-stage runs follow their recorded stage-skip definitions, including removal of the stage-local pooling when Stage 1 or Stage 2 is omitted. Fig. 13 summarizes the results, with per-variant metrics in Table D.1 of Appendix Appendix D. Every single-stage removal produces a material loss. Stage 2 is the least damaging omission: D2 reaches 88.94%, 7.61 percentage points below D0, for a 14.4% parameter saving. Removing Stage 1 or Stage 3 costs 11.24 and 11.33 points respectively, and Stage 4 is the most important: D4 falls to 75.79%, a 20.76 percentage-point deficit. The late 128-filter stage therefore contributes information the earlier stages cannot recover on their own. The pairwise results reveal interactions hidden by the single-stage runs. D6 (without S1 and S3) is the strongest pairwise removal at 84.86%, whereas removing both late stages (D10) reduces accuracy to 74.07%. Parameter count does not explain this ordering: D9 retains only 123,686 parameters (58.6% fewer than D0) yet reaches 83.05%, while D5 has 241,030 parameters but reaches only 79.87%. Which stages remain therefore matters more than raw model size. The triple and all-stage removals clarify the hierarchy: retaining only Stage 4 (D11) gives 80.15%, only Stage 2 (D12) 75.70%, and only Stage 1 (D13) 31.10%, while D14, which keeps only the stem, the fixed transitions, the pooling fusion, and the classifier head, reaches 7.25%. Shallow features alone are therefore insufficient, and the deeper stages, especially Stage 4, carry most of the class-discriminative representation; Fig. D.1 in Appendix Appendix D agrees, the severely reduced variants converging at substantially higher loss. For deployment the study exposes a genuine trade-off rather than a nearly free reduction: D2 is the highest-accuracy reduced configuration but still 7.61 percentage points down, and D9 retains 83.05% at 58.6% fewer parameters, so no stage-removal variant remains close to D0. We therefore keep the full fourstage network as the reference architecture and rely on post-training quantization, rather than architectural trimming, to reach the sub-megabyte deployment target of Section 6.7. 6.9. Ablation Study B: Component Controls The second ablation isolates the training recipe and the activation function from model capacity. Three controls are evaluated against the same full-model baseline, relabelled V0: no data augmentation, no dropout, 23
Table 9: Parameter-matched component controls. All variants share the 298,470-parameter architecture of V0, so the differences isolate the removed mechanism rather than a change in capacity. Metrics are percentages and ∆ is the accuracy degradation relative to V0. Variant
Acc. (%)
Prec. (%)
Rec. (%)
F1 (%)
Ep.
∆ (pp)
V0: Full model V8: w/o augmentation V10: w/o dropout V7: ReLU instead of Swish
96.55 93.38 94.92 95.56
96.65 93.51 95.10 95.71
96.55 93.38 94.92 95.56
96.55 93.37 94.90 95.58
192 234 111 198
0.00 +3.17 +1.63 +0.99
(a) Validated component controls +3.17
V8: w/o augmentation +1.63
V10: w/o dropout +0.99
V7: ReLU instead of Swish 0.0
0.5
1.0
1.5
2.0
2.5
3.0
3.5
Accuracy drop vs full-model baseline (pp)
(b) All rerun stage-removal ablations 1 stage removed 2 stages removed
+11.24
D1: w/o S1
3 stages removed 4 stages removed
+7.61
D2: w/o S2
+11.33
D3: w/o S3
+20.76
D4: w/o S4
+16.68
D5: w/o S1+S2
+11.69
D6: w/o S1+S3
+13.59
D7: w/o S1+S4
+16.50
D8: w/o S2+S3
+13.50
D9: w/o S2+S4
+22.48
D10: w/o S3+S4 +16.40
D11: w/o S1+S2+S3
+20.85
D12: w/o S1+S3+S4
+65.45
D13: w/o S2+S3+S4
+89.30
D14: w/o S1+S2+S3+S4 0
10
20
30
40
50
60
70
80
90
Accuracy drop vs full-model baseline (pp) Figure 14: Consolidated accuracy degradation relative to the common full-model baseline (96.55%). Panel (a) contains the three parameter-matched component controls and panel (b) contains all 14 stage-removal configurations (D1–D14). The two panels use different horizontal ranges so that the smaller component effects remain legible, so cross-panel comparisons should be read from the printed bar-end values rather than from bar lengths. The baseline has zero degradation and is therefore not drawn as a bar.
and ReLU in place of Swish. All three share V0’s exact 298,470-parameter architecture, so their differences must reflect the removed mechanism rather than capacity. Table 9 reports the four configurations and Fig. 14 places them alongside all 14 stage removals against the common 96.55% baseline; variant identifiers follow the experiment log so that the figure, the table, and the released artefacts can be cross-referenced. 24
Data augmentation has the largest effect: removing it drops accuracy from 96.55% to 93.38% (−3.17 percentage points) and runs 42 epochs longer before early stopping, consistent with a model still fitting an unaugmented set it has begun to memorize. Removing dropout lowers accuracy to 94.92% (−1.63) and cuts the run to 111 epochs, the shortest of the four and the signature of premature convergence onto a sharper minimum. Replacing Swish with ReLU gives the smallest but still consistent reduction, to 95.56% (−0.99), supporting the smooth activation of the full model [37]. Because the parameter count is identical, none of these gaps reflects model size. Fig. 14 clarifies the relative scale: the component controls span 0.99 to 3.17 percentage points, the 14 stage removals 7.61 to 89.30, and even D2, the least damaging stage removal, costs 2.4× what removing augmentation does. Preserving the full stage hierarchy therefore matters far more, though augmentation, dropout, and Swish each add measurable gains, so neither the four-stage extractor nor the regularized recipe can be dispensed with to reproduce the full-model operating point. 6.10. Explainability Analysis The ablation studies establish which parts of the network matter for accuracy, but not what it attends to. Because the deployment setting involves uncontrolled backgrounds, we must confirm that predictions follow the signing hand rather than incidental scene context, a failure mode accuracy cannot detect (RQ5). We combine qualitative attribution maps with quantitative faithfulness measures and a sanity check. (i) Method. We apply Grad-CAM [41] and its generalization Grad-CAM++ [6] to the output of the Stage-4 hand-feature block, the deepest 14 × 14 × 128 representation that still retains spatial structure. Let Ak denote the k-th channel of that feature map and y c the pre-softmax score of class c. Grad-CAM weights each channel by its spatially averaged gradient, αkc =
1 H ′W ′
X X ∂y c i
j
∂Akij
,
and forms the localization map as the rectified weighted combination ! X c c k L = ReLU αk A ,
(29)
(30)
k
which is min–max normalized and bilinearly upsampled to the 224 × 224 input grid. Grad-CAM++ replaces the uniform spatial average in Eq. (29) with a positive, pixel-wise weighting derived from higher-order derivatives of y c , which improves localization when several disjoint regions support the same class. (ii) Qualitative attribution. Fig. 15 shows maps for the four highest-F1 classes in Table C.2 (11, 17, 21, 32, all at 1.00) and the four lowest (5, 12, 14, 36), each predicted with essentially full confidence. The attribution peak falls on the signing hand in all eight cases, specifically on the configured fingers rather than the wrist or forearm, which are shared across classes and carry no discriminative signal. The behaviour under adverse capture conditions is more informative, because four of the eight samples were photographed against strongly structured backgrounds: saturated red, green, and pink lockers (class 12), a whiteboard covered in handwritten Bangla characters (class 17), a tiled floor with regular grout lines (class 21), and a wall crossed by a magenta stripe with furniture in frame (class 11). In each case the peak stays on the hand and the competing structure draws no comparable response, even though the background occupies most of the frame and, for the lockers and whiteboard, is higher in contrast than the hand. This is direct evidence that the spatial attention module suppresses background as intended in Section 5, and helps explain the transfer to uncontrolled capture conditions without per-dataset tuning (Section 6.5). (iii) Where the attribution refines. Fig. 16 traces the map through the four stages for classes 11, 17, and 21. Stage 1 behaves essentially as an edge detector, responding along every contour with no preference for the hand; Stage 2 begins to separate hand from background but retains substantial off-hand response; Stage 3 produces sharp, multi-modal peaks on individual extended fingers; Stage 4 consolidates these into a single region covering the discriminative finger–palm configuration. Background rejection is therefore established between Stages 2 and 3, consistent with the depth ablation of Section 6.8, where removing Stage 2 or Stage 3 costs 7.61 and 11.33 percentage points even though both leave the deepest stage intact, and with the design intent of Section 5. 25
C17
C21
C32
C05
C12
C14
C36
100.0%
100.0%
100.0%
100.0%
100.0%
100.0%
100.0%
100.0%
Grad-CAM++
Grad-CAM
Input
C11
Figure 15: Grad-CAM (middle row) and Grad-CAM++ (bottom row) localization maps for eight RSBdSL38 test images, the four highest-F1 and the four lowest-F1 classes, with the predicted-class probability printed beneath each map. The attribution peak falls on the configured fingers in every case, including the four samples captured against high-contrast structured backgrounds.
Stage 1
Stage 2
Stage 3
Stage 4
C21
C17
C11
Input
Figure 16: Stage-wise evolution of the Grad-CAM map for three classes. Attribution moves from a generic edge response at Stage 1, through partial figure–ground separation at Stage 2 and sharp per-finger peaks at Stage 3, to a single consolidated hand region at Stage 4.
(iv) Failure analysis. Fig. 17 renders, for five misclassified test images, the map for the ground-truth class alongside that for the predicted class. In all five the two maps fall on the same hand, so the model 26
T:C13 P:C18
T:C12 P:C36
T:C30 P:C33
T:C37 P:C00
p(true)=0.0%
p(true)=0.0%
p(true)=0.0%
p(true)=0.2%
p(true)=0.1%
p(pred)=100.0%
p(pred)=100.0%
p(pred)=100.0%
p(pred)=99.8%
p(pred)=99.7%
CAM: predicted
CAM: true class
Input
T:C06 P:C08
Figure 17: Failure analysis of five misclassified test images. For each image (top row), the Grad-CAM map for the ground-truth class (middle row) and for the predicted class (bottom row) are shown with the corresponding class probabilities. Both maps fall on the same hand region in every case, indicating a discrimination failure rather than a localization failure.
localizes correctly and fails at discrimination rather than at attention. What separates them is extent rather than position: the ground-truth map is tight on the finger detail that distinguishes the true sign, the predicted-class map broader, covering the palm and the adjacent finger group. The third column is the dominant error mode, class 12 predicted as class 36, where both maps sit on the same fist-and-thumb configuration and the distinction is finer than the 14 × 14 attribution grid can resolve. The confidence distribution over the 40 errors corroborates this: mean probability 0.81 on the wrong class, 19 of the 40 above 0.9 and 11 above 0.99, against only 0.09 on the true class, with just 5 errors exceeding 0.3. The model is confidently rather than marginally wrong, so with the localization evidence the residual errors arise from genuine visual near-degeneracy between sign pairs, most prominently classes 12 and 36, rather than from background distraction. Higher input or feature resolution, not stronger attention, is the appropriate remedy; the errors persist at full four-stage capacity, so they are not a symptom of insufficient depth. (v) Faithfulness. Visual plausibility does not establish that a map reflects the evidence the network uses. We compute the deletion and insertion measures of Petsiuk et al. [33] over 200 test images, progressively removing pixels from or restoring them to a blurred baseline in order of decreasing attribution and recording the area under the resulting predicted-probability curve (AUC); a faithful map gives a low deletion AUC and a high insertion AUC. We also report the average confidence drop and increase-in-confidence rate of Chattopadhay et al. [6], obtained by masking the input with the normalized map (Table 10). Fig. 18 plots the full curves. Both attribution methods separate clearly from the random control, confirming that the highlighted region is the evidence the network relies on rather than a plausible-looking overlay: deleting pixels in Grad-CAM order collapses the predicted-class probability roughly 2.6× faster than random deletion (deletion AUC 0.081 versus 0.211), and restoring them recovers the prediction far sooner (insertion AUC 0.888 versus 0.605). 27
Table 10: Faithfulness of the attribution maps over 200 test images. Lower deletion AUC, higher insertion AUC, lower average confidence drop, and higher increase-in-confidence rate indicate a more faithful explanation. The random control ranks pixels arbitrarily and bounds the performance of an uninformative map. Method
Del. AUC ↓
Ins. AUC ↑
Avg. drop (%) ↓
Increase (%) ↑
0.211 0.110 0.081
0.605 0.774 0.888
— 97.40 53.71
— 0.50 7.50
Random (control) Grad-CAM++ Grad-CAM
1.0
Insertion (higher is better) Predicted-class probability
Predicted-class probability
Deletion (lower is better) Grad-CAM Grad-CAM++ Random
0.8 0.6 0.4 0.2 0.0 0
20
40
60
80
100
Pixels removed (%)
1.0 0.8 0.6 0.4 Grad-CAM Grad-CAM++ Random
0.2
0
20
40
60
80
100
Pixels inserted (%)
Figure 18: Deletion (left) and insertion (right) faithfulness curves for Grad-CAM, Grad-CAM++, and a random control, averaged over 200 test images. Pixels are removed from (deletion) or restored to (insertion) a blurred baseline in order of decreasing attribution. A faithful map drives the predicted-class probability down fastest, giving the smallest area under the deletion curve, and recovers it soonest, giving the largest area under the insertion curve; Grad-CAM dominates on both criteria and separates clearly from the random baseline.
Grad-CAM [41] is the more faithful of the two on every measure, and the gap is explained by map sparsity, visible in Fig. 15: the Grad-CAM++ maps are compact and tightly bounded to the fingers, the Grad-CAM maps extend over the whole hand and somewhat beyond. The sharper maps are the less faithful, because restricting the input to the Grad-CAM++ region discards contextual evidence the network in fact uses, producing near-total confidence collapse under masking (97.40% average drop). Since the compact backbone aggregates evidence over the whole hand rather than a few isolated keypoints, the broader maps describe its behaviour more accurately, and all qualitative analysis here uses Grad-CAM. (vi) Sanity check. Following Adebayo et al. [1], we verify that the attribution depends on the learned parameters rather than acting as an edge detector. After cascading randomization of the classifier head and the final stage, the maps collapse to a near-uniform field with no correspondence to the hand (Fig. 19), unlike the sharply localized maps of the trained model. They notably do not fall back on the contour structure that dominates Stage 1, confirming that localization is a property of the learned weights rather than of the input’s edge content, so the explanations satisfy a model-sensitivity criterion that many published saliency analyses fail. The analysis is subject to one methodological caveat. Because Stage 4 operates on a 14 × 14 grid, each map cell corresponds to a 16 × 16 input patch, so the maps identify the discriminative region but cannot resolve individual finger boundaries; the Stage-3 maps in Fig. 16 are correspondingly sharper. 6.11. Summary of Findings Careful architectural design, attention, multi-scale depthwise features, and aggressive parameter sharing, lets a from-scratch 0.30M-parameter model operate within striking distance of ImageNet-pretrained backbones 8.5 to 68× its size. On RQ1, it attains 96.37% on RSBdSL38 (five-seed mean 95.72% ± 0.54%), ahead
28
C17
C21
C32
Randomised
Trained
Input
C11
Figure 19: Sanity check by cascading weight randomization [1]. The input images (top), the Grad-CAM maps of the trained model (middle), and the maps obtained after randomizing the final stage and the classifier head (bottom). The randomized maps collapse to a near-uniform field, so the localization is a property of the learned weights rather than of the input’s edge content.
of two pretrained baselines and within 1.08 percentage points of the best, while being the most computeand memory-efficient model in the suite (Section 6.7). On RQ2, the identical architecture exceeds 92.9% on all six public benchmarks and reaches 97.04% on the merged corpus, so the design is not tuned to its own dataset and in fact benefits from increased signer and environment diversity; zero-shot transfer to BdSL-38 at 76.25% shows its representations to be largely source-agnostic. For RQ3, the two ablation studies separate architecture from training recipe, and the stage hierarchy dominates: no stage can be removed without material loss, the least damaging omission still costing 7.61 percentage points, while the parameter-matched controls add 3.17, 1.63, and 0.99 points for augmentation, dropout, and Swish. No trimmed variant is a viable deployment alternative, which is why Section 6.7 relies on quantization rather than architectural reduction. Section 6.10 answers RQ5: the maps concentrate on the signing hand and suppress background even in cluttered classroom scenes, the deletion and insertion measures (deletion AUC 0.081 versus 0.211 for a random control) confirm that the highlighted region is the evidence actually used, and the randomization check confirms dependence on the learned parameters. For RQ4, the narrow 95.33 to 97.45% band across
29
ten models, including 20M-parameter backbones that saturate other BdSL benchmarks above 99% [34, 53], makes RSBdSL38 a more challenging and ecologically valid benchmark than volunteer-collected datasets; the signer-independent drop of 11.19 points to 85.18% (Section 6.3) reinforces this, a gap most stratified-split results leave unmeasured. Several limitations remain. RSBdSL38 covers static alphabet signs only; dynamic word- and sentencelevel signing needs temporal modeling outside this architecture’s scope. On-device latency and memory are measured on a commodity smartphone SoC, but energy consumption and sustained-load thermal behaviour are not. The primary comparison uses stratified splits for consistency with the baselines and prior literature, and although the signer-independent evaluation quantifies the roughly 11-point optimism this introduces, the baselines are not re-evaluated under that protocol. The component study covers the training recipe and the activation function but not the individual attention modules, whose isolated contributions remain unquantified. Finally, the explainability analysis is limited by the 14 × 14 attribution resolution and is not complemented by a perturbation-based method such as SHAP [27]. 7. Conclusion We introduced RSBdSL38, an expert-validated Bangla Sign Language dataset of 10,874 images collected from real signers across three regions of Bangladesh, together with a lightweight attention-based convolutional network of only 298,470 parameters (1.14 MB, 132.7 M multiply–accumulate operations). Trained from scratch it achieves 96.37% accuracy on RSBdSL38 (95.72% ± 0.54% over five seeds), competitive with nine modern ImageNet-pretrained efficient architectures at 8.5 to 68× fewer parameters; it quantizes to a 0.48 MB INT8 model running at 3.98 ms per image on a commodity smartphone, generalizes across six public BdSL benchmarks (92.95 to 98.33%) and a merged four-dataset corpus (97.04%) without any architectural change, and transfers zero-shot to BdSL-38 at 76.25%. A signer-independent evaluation holding out 6 of the 36 signers entirely attains 85.18%, quantifying the roughly 11-point optimism of the stratified splits standard in BdSL research. Two ablation studies separate architecture from training recipe, showing that no stage can be removed without material loss while augmentation, dropout, and the Swish activation each contribute a smaller but consistent part of the operating point. An explainability analysis using Grad-CAM [41] and Grad-CAM++ [6], validated by deletion and insertion faithfulness measures [33] and a weight-randomization sanity check [1], confirms that the model localizes the signing hand rather than background context, including in cluttered classroom scenes. Future work will extend the attribution analysis with perturbation-based methods such as SHAP [27], isolate the channel and spatial attention modules through parameter-matched controls, extend RSBdSL38 to dynamic word-level signing and to a larger signer pool that supports signer-independent evaluation of the baselines as well, and characterize the energy and sustained-load thermal behaviour of the quantized model on target hardware. The dataset, trained models, and all experiment code are released publicly to support reproducible research on low-resource sign language recognition. 8. Declaration of generative AI and AI-assisted technologies in the manuscript preparation process Large language models (LLMs) were used during the preparation of this manuscript as assistive tools for language editing and code debugging. Every AI-assisted output was reviewed, verified, and corrected by the authors, who take full responsibility for the correctness, originality, and integrity of this work. Originality. LLM assistance was editorial in nature. Drafted and refined passages were fact-checked and rewritten by the authors so that every statement matches the underlying research findings. All figures, tables, and quantitative results, including every technical description and reported numerical value, were produced entirely by the authors without AI involvement. Transparency. LLMs were also used during code development, primarily to debug and locate implementation issues. The experimental pipeline nonetheless required substantial manual design, step-by-step correction, and repeated testing, as AI-generated suggestions alone were insufficient. Every reported result was obtained
30
Table A.1: Summary of notation used throughout the paper. Symbol I Ĩ H, W, C H′, W ′ K N B i Ci gi ρi r p λ ∗ ∗g ∗s DWk×k
Description Input RGB image, I ∈ R224×224×3 Augmented training image Height, width, channels of a feature map Size of the attribution grid (14 × 14) Number of sign classes (K = 38) Number of training samples Mini-batch size (B = 32) Stage index, i ∈ {1, 2, 3, 4} Stage width, Ci ∈ {32, 64, 96, 128} Convolution groups, gi ∈ {2, 4, 8, 16} Spatial-dropout rate, ρi ∈ {0.05, . . . , 0.20} Channel-attention reduction ratio (r = 16) Head dropout rate (p = 0.3) ℓ2 regularization coefficient (10−5 ) Standard (dense) convolution Grouped convolution with g groups Convolution of stride s Depthwise convolution with k × k kernel
Symbol X0 X U, V Y Y′ , Y′′ Mc , Ms Z Z′i H H3 , H5 v h1 , h2 Wstem Wc1×1 , W1×1 e W3×3 g Wa0 , Wa1 f 7×7 1×1 Wp , W1×1 f
Description Stem output, 56 × 56 × 32 Input of a residual block, RH×W ×C Compressed and grouped bottleneck features Bottleneck output before attention Channel- and spatially-refined features Channel and spatial attention maps Residual-block output Output of stage i Projected input of the hand-feature block Outputs of the 3 × 3/5 × 5 depthwise branches Dual-pooled descriptor, v ∈ R256 Hidden activations, R128 and R64 Stem kernel (5 × 5, 32 filters) Bottleneck compression and expansion kernels Grouped bottleneck kernel Shared channel-attention MLP weights Spatial-attention convolution Hand-feature projection and fusion kernels
BN(·) γ, β, ϵ GAP, GMP MaxPoolk,s SDρ Dropp ∥ ⊗ ◦
Batch normalization BN scale, shift, and numerical constant Global average and global max pooling Max pooling, window k, stride s Spatial (channel-wise) dropout at rate ρ Element-wise dropout at rate p Channel-wise concatenation Broadcast element-wise multiplication Function composition
Wf c1 , Wf c2 b1 , b2 wk , bk θ Wl L ηt , η0 , ηmin µ, mt τgeo , τpho
δ(·) σ(·) ϕ(·) P(·) S0 , Si
Swish (SiLU) activation Logistic sigmoid ReLU, used inside the attention MLP Residual shortcut projection Stem operator and stage-i operator
ynk ŷk , ŷnk T P, T N F P, F N F1
Fully connected weight matrices Fully connected bias vectors Classifier weight vector and bias of class k All trainable parameters of the network Kernel of the l-th regularized layer Regularized training objective Learning rate at step t, initial, and floor Nesterov momentum and velocity buffer Geometric and photometric augmentation operators One-hot target of sample n for class k Predicted posterior probability True positives and true negatives False positives and false negatives F1-score, harmonic mean of precision and recall
(1)
First and second residual block of stage i Hand-feature block of stage i Stage transition (max pooling or identity) Classifier head and complete network
∆ Ak , y c αck , Lc MACs
Accuracy degradation w.r.t. baseline (pp) k-th Stage-4 channel; pre-softmax score of class c Grad-CAM channel weight and localization map Multiply–accumulate operations per forward pass
(2)
Bi , Bi Hi πi C(·), F (·)
by running author-verified code and validated against expected behaviour before inclusion. The core methodology, the model architecture, and the RSBdSL38 experimental protocol were conceived and validated by the authors without LLM involvement. Responsibility. No sensitive, private, or proprietary information, including dataset images and participant data, was shared with any AI tool during writing or debugging, and all interactions respected ethical considerations regarding data ownership and intellectual property. LLM use was confined to general-purpose writing assistance and code debugging, and did not influence the scientific contributions or claims of this paper. Appendix A. Summary of Notations Table A.1 provides a detailed summary of notations. Appendix B. Detailed Architecture This appendix gives the layer-level view of the network summarized in Fig. 5 and formalized in Section 5: Fig. B.1 the complete computational graph, Fig. B.2 the internal structure of the three building blocks, and Table B.2 the stage-wise configuration and parameter budget. 31
Data Augmentation (training only) • RandomRotation • RandomZoom • RandomTranslation • RandomBrightness • RandomContrast • RandomSaturation • RandomHue
Input (H × W × 3) Size 224x224
Stem Conv2D 32 filters, 5×5 stride 2
Stage 1
Stage 2
(32 filters, groups = 2)
(64 filters, groups = 4)
Enhanced Residual Block ×2
Hand Feature Block (HFB)
Enhanced Residual Block ×2
Hand Feature Block (HFB)
Block 1 (projection shortcut)
filters = 32
Block 1 (projection shortcut)
filters = 64
dropout = 0.05
Block 2
dropout = 0.10
Block 2
Total Parameters Stage 1: 14,368 Stage 2: 38,464
Classifier Head Global Pool Fusion
MaxPool 2×2
MaxPool 2×2
Global Avg Pooling
Swish
Stage 3
Stage 4
Concatenate
(96 filters, groups = 8)
(128 filters, groups = 16)
Total Parameters 2,560
Enhanced Residual Block ×2
Hand Feature Block (HFB)
Enhanced Residual Block ×2
Hand Feature Block (HFB)
Block 1 (projection shortcut)
filters = 96
Block 1 (projection shortcut)
filters = 128
dropout = 0.15
Block 2
Dense 128 Swish + BatchNorm
Global Max Pooling
BatchNorm
MaxPool 3×3, stride 2
Dropout (0.30)
dropout = 0.20
Dropout (0.30) Dense 64 Swish + BatchNorm Dense num_classes Softmax
Total Parameters 0 (pooling and dropout have no parameters)
Total Class 38
Total Parameters 44,390
Grand Total Parameters 298,470
Total Parameters
(Counts include trainable weights and BatchNorm state.)
Stage 3: 75,168 Stage 4: 123,520
Block 2
Predicted Sign Class
Figure B.1: Layer-level architecture of the proposed model. The strided 5 × 5 stem is followed by four stages of increasing width (32, 64, 96, and 128 channels), each composed of two grouped bottleneck residual attention blocks and one multi-scale handfeature block. Stages 1 and 2 terminate in 2 × 2 max pooling; stages 3 and 4 preserve the 14 × 14 resolution so that finger-level detail is not discarded. The dual-pooling head concatenates global max and global average descriptors into a 256-dimensional vector and maps it through two fully connected layers to the 38-way softmax. Table B.2: Stage-wise configuration of the proposed model. Output size is the spatial resolution after the stage transition πi ; HFB denotes the multi-scale hand-feature block, gi the number of convolution groups, ρi the spatial-dropout rate, and p the head dropout rate. Module
Output size
Width Ci
gi / ρ i
56 × 56 28 × 28 14 × 14 14 × 14 14 × 14 1×1
32 32 64 96 128 —
— g=2, ρ=0.05 g=4, ρ=0.10 g=8, ρ=0.15 g=16, ρ=0.20 p=0.3
Stem (5 × 5, s=2, + pool) Stage 1 (2 blocks + HFB) Stage 2 (2 blocks + HFB) Stage 3 (2 blocks + HFB) Stage 4 (2 blocks + HFB) Dual-pool head (FC 128→64→38)
Total: 298,470 parameters (≈ 0.30M; 292,262 trainable; 1.14 MB)
Table C.1: Five-seed stability of the proposed model on RSBdSL38 (seeds 42–46), each retrained from scratch under the identical protocol. Epochs are the total run length before early stopping, and time is the wall-clock training time on a single GPU. Seed
Acc. (%)
Prec. (%)
Rec. (%)
F1 (%)
Ep.
Time (min)
42 43 44 45 46
96.46 95.92 95.10 95.83 95.29
96.56 96.00 95.44 96.03 95.48
96.46 95.92 95.10 95.83 95.29
96.46 95.91 95.12 95.83 95.30
184 184 185 215 263
119.1 118.9 119.5 145.0 177.4
Mean 95.72 Std 0.54 Min 95.10 Max 96.46
95.90 0.46 95.44 96.56
95.72 0.54 95.10 96.46
95.72 0.54 95.12 96.46
206.2 34.4 184 263
136.0 25.7 118.9 177.4
Appendix C. Detailed Results on RSBdSL38 This appendix reports the per-seed stability statistics summarized in Section 6.2 and the complete perclass classification report of the single-seed reference run.
32
Shared MLP (r = 16; shared weights) Global Average Pooling (1 × 1 × C)
Input Feature Map (C × H × W)
Reshape (1 × 1 × C)
Dense (C/r)
Dense (C)
ReLU
Global Max Pooling (1 × 1 × C)
Reshape (1 × 1 × C)
Dense (C/r)
Dense (C)
ReLU
Channel Weights (1 × 1 × C)
Sigmoid (1 × 1 × C)
Add
Output Feature Map (C × H × W)
Multiply
(a) Channel-attention block. Global average- and max-pooled descriptors pass through a shared, bias-free two-layer MLP with reduction ratio r = 16 to generate channel weights, which rescale the input feature map (Eq. (9)). Input (H × W × C_in)
1×1 Conv filters/2 stride 1
Batch Norm
Grouped Conv k×k default 3×3 groups = g stride = s
Swish
Yes
Shape matches Bottleneck width: output?
filters / 2
Swish
Batch Norm
Channel Attention
Spatial Attention
Channel Attention (see Fig. C)
Conv 7×7 + sigmoid
× Multiply
Output channels: filters
Identity shortcut
1×1 Conv projection stride = s
No
Batch Norm
1×1 Conv filters stride 1
Batch Norm
+ Add
Swish
Output (H_out × W_out × C_out)
(b) Grouped bottleneck residual attention block. A 1 × 1 compression, a grouped 3 × 3 convolution, and a 1 × 1 expansion are followed by channel and spatial attention, while an identity or projection shortcut supports residual learning (Eqs. (6)– (11)). Branch 1 Depthwise Conv 3×3 Input
1×1 Conv
BatchNorm
BatchNorm
Swish
Swish
1×1 Conv (fusion)
Concatenate Depthwise Conv 5×5
BatchNorm
BatchNorm
SpatialDropout2D d by stage: 0.05 · 0.10 · 0.15 · 0.20
Swish
Swish
Output
Branch 2
(c) Hand-feature block. Parallel 3 × 3 and 5 × 5 depthwise convolutions capture finger-level and palm-level structure, and their outputs are concatenated, fused by a 1 × 1 convolution, and regularized by spatial dropout (Eqs. (12)–(14)).
Figure B.2: Internal structure of the three building blocks used in the proposed lightweight Bangla Sign Language recognition network: (a) the channel-attention block, (b) the grouped bottleneck residual attention block, and (c) the multi-scale handfeature block. Without Stage 1
6
5
4 3 2 1
Loss
0
0
50
100
150
200
250
Without Stages 2 + 3
6
Without Stage 2
6
5
Without Stage 3
6
Training Loss Validation Loss
Without Stage 4
6
Without Stages 1 + 2
6
Without Stages 1 + 3
6
5
5
5
5
4
4
4
4
4
4
3
3
3
3
3
3
2
2
2
2
2
2
1
1
1
1
1
0
0
50
100
150
200
250
Without Stages 2 + 4
6
0
0
50
100
150
200
250
Without Stages 3 + 4
6
0
0
50
100
150
200
250
Without Stages 1 + 2 + 3
6
0
0
50
100
150
200
250
Without Stages 1 + 3 + 4
6
0
1
0
50
100
150
200
250
Without Stages 2 + 3 + 4
6
0
5
5
5
5
5
5
4
4
4
4
4
4
4
3
3
3
3
3
3
3
2
2
2
2
2
2
1
1
1
1
1
1
0
50
100
150
200
250
0
0
50
100
150
200
250
0
0
50
100
150
200
250
0
0
50
100
150
200
250
0
0
50
100
150
200
250
0
0
50
100
150
200
250
Without Stages 1 + 2 + 3 + 4
6
5
0
Without Stages 1 + 4
6
5
2 1
0
50
100
150
200
250
0
0
50
100
150
200
250
Epoch
Figure D.1: Training and validation loss for the 14 stage-removal configurations of Table D.1. All panels use identical epoch and loss scales, while each curve ends at its own completed training length; markers are drawn at regular intervals for legibility. The high residual losses of the most aggressively reduced variants agree with their large test-accuracy deficits.
Appendix D. Complete Ablation and Deployment Measurements This appendix reports the complete per-variant metrics of the stage-wise depth ablation of Section 6.8, the corresponding loss curves, and the full on-device measurement summarized in Section 6.7. Appendix E. Data and Code Availability The public BdSL datasets used in this study are available from their original sources and are cited in the manuscript. The RSBdSL38 dataset introduced here is archived with a permanent DOI at https:
33
Table C.2: Per-class classification report of the proposed model on the RSBdSL38 test set (1,103 images, single-seed reference run). Support is the number of test images in each class. Four classes reach a perfect F1 of 1.00 and no class falls below 0.85 in either precision or recall. Class
Precision
Recall
F1-score
Support
Class
Precision
Recall
F1-score
Support
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
0.97 1.00 1.00 0.90 0.93 0.86 0.93 0.96 0.93 1.00 0.94 1.00 0.89 1.00 0.97 0.94 0.96 1.00 0.94
1.00 0.97 0.93 0.96 0.96 0.93 0.93 0.93 1.00 0.96 0.94 1.00 0.86 0.93 0.90 1.00 0.96 1.00 1.00
0.98 0.98 0.96 0.93 0.95 0.89 0.93 0.95 0.97 0.98 0.94 1.00 0.87 0.96 0.93 0.97 0.96 1.00 0.97
30 29 27 28 27 27 29 28 28 27 31 26 28 29 31 32 28 28 29
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37
0.93 1.00 1.00 1.00 0.94 1.00 0.97 1.00 1.00 0.91 1.00 1.00 1.00 1.00 0.97 0.97 0.97 0.90 1.00
0.93 0.93 1.00 0.94 1.00 0.97 1.00 0.97 0.93 1.00 0.96 0.97 0.97 1.00 0.97 1.00 1.00 0.97 0.97
0.93 0.97 1.00 0.97 0.97 0.98 0.98 0.98 0.96 0.95 0.98 0.98 0.98 1.00 0.97 0.98 0.98 0.93 0.98
30 30 30 31 29 31 30 29 28 29 28 30 29 26 31 30 32 29 29
0.96 0.97
0.96 0.96
0.96 0.96 0.96
1,103 1,103 1,103
Accuracy Macro avg Weighted avg
Table D.1: Complete stage-wise depth ablation. D0 is the full-model baseline and every other row is an independently trained stage-removal configuration. Metrics are percentages and ∆ is the accuracy degradation relative to D0, so larger values indicate a more damaging removal. Epochs are the total run length before early stopping. Variant
Removed stages
Active stages
Params
Acc.
Prec.
Recall
F1
Epochs ∆ (pp)
D0: Full model
None
S1+S2+S3+S4 298,470
96.55
96.65
96.55
96.55
192
0.00
D1 D2 D3 D4
S1 S2 S3 S4
S2+S3+S4 S1+S3+S4 S1+S2+S4 S1+S2+S3
284,102 255,398 217,158 166,758
85.31 88.94 85.22 75.79
86.58 90.75 88.03 77.25
85.31 88.94 85.22 75.79
84.78 88.64 84.67 72.95
172 221 172 172
+11.24 +7.61 +11.33 +20.76
D5 D6 D7 D8 D9 D10
S1+S2 S1+S3 S1+S4 S2+S3 S2+S4 S3+S4
S3+S4 S2+S4 S2+S3 S1+S4 S1+S3 S1+S2
241,030 202,790 152,390 172,550 123,686 83,398
79.87 84.86 82.96 80.05 83.05 74.07
83.40 87.43 87.34 84.65 86.87 76.86
79.87 84.86 82.96 80.05 83.05 74.07
78.02 83.88 81.33 78.22 81.56 73.03
156 198 198 173 171 96
+16.68 +11.69 +13.59 +16.50 +13.50 +22.48
D11 D12 D13 D14
S1+S2+S3 S1+S3+S4 S2+S3+S4 S1+S2+S3+S4
S4 S2 S1 None
158,182 69,030 36,742 22,374
80.15 75.70 31.10 7.25
82.16 79.04 29.17 2.09
80.15 75.70 31.10 7.25
78.81 74.01 26.06 2.64
114 120 43 40
+16.40 +20.85 +65.45 +89.30
//doi.org/10.17632/tgvmb2jsdb.1. The trained weights, training histories, per-run metrics, and all code required to reproduce the reported results are available at https://github.com/saadbaust/rsbdsl38.
34
Table D.2: On-device inference of the full-integer INT8 model on a commodity Android smartphone (Snapdragon 7+ Gen 3, 12 GB RAM, XNNPACK delegate, 4 threads, 249 timed runs at 224 × 224). Metric
Value
Model size (INT8 TFLite) Mean latency Median / p95 latency Throughput Peak memory Initialization time Delegated operators
0.48 MB 3.98 ± 0.09 ms 3.96 / 4.16 ms ≈251 images/s 15.5 MB 13.8 ms 241 / 315
References [1] Adebayo, J., Gilmer, J., Muelly, M., Goodfellow, I., Hardt, M., Kim, B., 2018. Sanity checks for saliency maps, in: Advances in Neural Information Processing Systems (NeurIPS), pp. 9505–9515. [2] Ahmed, S., Syfullah, M.K., 2026. RSBdSL38-v1. URL: https://doi.org/10.17632/tgvmb2jsdb.1, doi:10.17632/tgvmb2jsdb.1. [3] Al-Qurishi, M., Khalid, T., Souissi, R., 2021. Deep learning for sign language recognition: Current techniques, benchmarks, and open issues. IEEE Access 9, 126917–126951. [4] Alam, M.S., Tanvir, M., Saha, D.K., Das, S.K., 2021. Two dimensional convolutional neural network approach for real-time bangla sign language characters recognition and translation. SN Computer Science 2, 387. [5] Billah, A.R., Fahad, F.I., Raaz, S.R., Saha, A., Eity, Q.N., 2022. Recognition of bangla sign language characters and digits using cnn, in: 2022 International Conference on Innovations in Science, Engineering and Technology (ICISET), IEEE. pp. 239–244. [6] Chattopadhay, A., Sarkar, A., Howlader, P., Balasubramanian, V.N., 2018. Grad-cam++: Generalized gradient-based visual explanations for deep convolutional networks, in: IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE. pp. 839–847. [7] Chollet, F., 2017. Xception: Deep learning with depthwise separable convolutions, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1251–1258. [8] Das, S., Imtiaz, M.S., Neom, N.H., Siddique, N., Wang, H., 2023. A hybrid approach for bangla sign language recognition using deep transfer learning model with random forest classifier. Expert Systems with Applications 213, 118914. [9] Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L., 2009. Imagenet: A large-scale hierarchical image database, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 248–255. [10] Diba, B.S., Plabon, J.D., Rahman, M.M., Mistry, D., Saha, A.K., Mridha, M.F., 2024. Explainable federated learning for privacy-preserving bangla sign language detection. Engineering Applications of Artificial Intelligence 134, 108657. [11] Emon, S.H., Chowdhury, A.R., Siddique, M.A.I., Hassan, M.M., Hossen, A., Sade, M.S., 2025. Real-time detection and translation of bangla sign language characters using deep learning, in: 2025 International Conference on Quantum Photonics, Artificial Intelligence, and Networking (QPAIN), IEEE. pp. 1–6. [12] Hadiuzzaman, M., Ali, M., Miah, A.S., Raj Shafi, A., Shin, J., 2024. Baust lipi: A bdsl dataset with deep learning based bangla sign language recognition, in: Proceedings of the 3rd International Conference on Computing Advancements, pp. 280–285.
35
[13] Haque, A., Pulok, R.A., Rahman, M.M., Akter, S., Khan, N., Haque, S., 2023. Recognition of bangladeshi sign language (bdsl) words using deep convolutional neural networks (dcnns). Emerging Science Journal 7, 2183–2201. [14] Hasan, S.N., Hasan, M.J., Alam, K.S., 2021. Shongket: A comprehensive and multipurpose dataset for bangla sign language detection, in: 2021 International Conference on Electronics, Communications and Information Technology (ICECIT), IEEE. pp. 1–4. [15] Hasib, A., Eva, J.F., Khan, S.S., Khatun, M.N., Haque, A., Shahrin, N., Rahman, R., Murad, H., Islam, M.R., Hussein, M.R., 2023. Bdsl 49: A comprehensive dataset of bangla sign language. Data in Brief 49, 109329. [16] He, K., Zhang, X., Ren, S., Sun, J., 2016. Deep residual learning for image recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778. [17] Hoque, O.B., Jubair, M.I., Akash, A.F., Islam, S., 2020. Bdsl36: A dataset for bangladeshi sign letters recognition, in: Proceedings of the Asian Conference on Computer Vision (ACCV) Workshops. [18] Hu, J., Shen, L., Sun, G., 2018. Squeeze-and-excitation networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7132–7141. [19] Ioffe, S., Szegedy, C., 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift, in: International Conference on Machine Learning (ICML), pp. 448–456. [20] Islam, M.S., Das, D., Das, S., Ullah, M.N., 2022. Sign language recognition for bangla alphabets using deep learning methods, in: 2022 4th International Conference on Sustainable Technologies for Industry 4.0 (STI), IEEE. pp. 1–6. [21] Jim, A.A.J., Rafi, I., Akon, M.Z., Biswas, U., Nahid, A.A., 2023. Ku-bdsl: An open dataset for bengali sign language recognition. Data in Brief 51, 109797. [22] Kabir, M.H., Miah, A.S.M., Hadiuzzaman, M., Shin, J., 2025. Combining state-of-the-art pre-trained deep learning models: A novel approach for bangla sign language recognition using max voting ensemble. Systems and Soft Computing 7, 200230. [23] Karim, M.B., Nabi, M., Zim, F., Srizon, A.Y., 2025. Empowering the deaf community through a visionbased approach to bangla sign language numerals recognition, in: 2025 International Conference on Electrical, Computer and Communication Engineering (ECCE), IEEE. pp. 1–6. [24] Krizhevsky, A., Sutskever, I., Hinton, G.E., 2012. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems 25. [25] Li, Y., Hu, J., Wen, Y., Evangelidis, G., Salahi, K., Wang, Y., Tulyakov, S., Ren, J., 2023. Rethinking vision transformers for mobilenet size and speed, in: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 16889–16900. [26] Loshchilov, I., Hutter, F., 2019. Decoupled weight decay regularization, in: International Conference on Learning Representations (ICLR). ArXiv:1711.05101. [27] Lundberg, S.M., Lee, S.I., 2017. A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems 30. [28] Mehta, S., Rastegari, M., 2022a. Mobilevit: Light-weight, general-purpose, and mobile-friendly vision transformer, in: International Conference on Learning Representations (ICLR). ArXiv:2110.02178. [29] Mehta, S., Rastegari, M., 2022b. Separable self-attention for mobile vision transformers. arXiv preprint arXiv:2206.02680 . [30] Nihal, R.A., Rahman, S., Broti, N.M., Deowan, S.A., 2021. Bangla sign alphabet recognition with zero-shot and transfer learning. Pattern Recognition Letters 150, 84–93. 36
[31] Oquab, M., Darcet, T., Moutakanni, T., Vo, H., Szafraniec, M., Khalidov, V., Fernandez, P., Haziza, D., Massa, F., El-Nouby, A., et al., 2023. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193 . [32] Organization, W.H., 2023. Deafness and hearing loss. URL: https://www.who.int/news-room/ fact-sheets/detail/deafness-and-hearing-loss. accessed: 2023-03-27. [33] Petsiuk, V., Das, A., Saenko, K., 2018. Rise: Randomized input sampling for explanation of black-box models, in: British Machine Vision Conference (BMVC). ArXiv:1806.07421. [34] Podder, K.K., Chowdhury, M.E., Tahir, A.M., Mahbub, Z.B., Khandakar, A., Hossain, M.S., Kadir, M.A., 2022. Bangla sign language (bdsl) alphabets and numerals classification using a deep learning model. Sensors 22, 574. [35] Qin, D., Leichner, C., Delakis, M., Fornoni, M., Luo, S., Yang, F., Wang, W., Banbury, C., Ye, C., Akin, B., et al., 2024. Mobilenetv4: Universal models for the mobile ecosystem, in: European Conference on Computer Vision (ECCV), pp. 78–96. [36] Raihan, M.J., Labib, M.I., Jim, A.A.J., Tiang, J.J., Biswas, U., Nahid, A.A., 2024. Bengali-sign: A machine learning-based bengali sign language interpretation for deaf and non-verbal people. Sensors 24, 5351. [37] Ramachandran, P., Zoph, B., Le, Q.V., 2017. Searching for activation functions. arXiv preprint arXiv:1710.05941 . [38] Rastgoo, R., Kiani, K., Escalera, S., 2021. Sign language recognition: A deep survey. Expert systems with applications 164, 113794. [39] Rayeed, S., Tuba, S.T., Mahmud, H., Md, M.H.U.M., Md, S.H.M., Md, K.H., 2023. Bdsl47: A complete depth-based bangla sign alphabet and digit dataset. Data in Brief 51, 109799. [40] Renjith, S., Manazhy, R., 2024. Sign language: a systematic review on classification and recognition. Multimedia Tools and Applications 83, 77077–77127. [41] Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D., 2017. Grad-cam: Visual explanations from deep networks via gradient-based localization, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 618–626. [42] Shams, K.A., Reaz, M.R., Rafi, M.R.U., Islam, S., Rahman, M.S., Rahman, R., Reza, M.T., Parvez, M.Z., Chakraborty, S., Pradhan, B., et al., 2024. Multimodal ensemble approach leveraging spatial, skeletal, and edge features for enhanced bangla sign language recognition. IEEE Access 12, 83638–83657. [43] Siddique, S., Islam, S., Neon, E., Sabbir, T., Naheen, I., Khan, R., 2023. Deep learning-based bangla sign language detection with an edge device. intelligent systems with applications, 18, 200224. [44] Sraboni, S.A., Sultana, A., 2024. Real-time bangla sign language recognition using transfer learning model, in: 2024 International Conference on Innovations in Science, Engineering and Technology (ICISET), IEEE. pp. 1–5. [45] Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R., 2014. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research 15, 1929–1958. [46] Sutskever, I., Martens, J., Dahl, G., Hinton, G., 2013. On the importance of initialization and momentum in deep learning, in: International Conference on Machine Learning (ICML), pp. 1139–1147. [47] Sutton-Spence, R., Woll, B., 1999. The linguistics of British Sign Language: an introduction. Cambridge University Press. [48] Tan, M., Le, Q., 2021. Efficientnetv2: Smaller models and faster training, in: International Conference on Machine Learning (ICML), pp. 10096–10106. 37
[49] Tang, Y., Han, K., Guo, J., Xu, C., Xu, C., Wang, Y., 2022. Ghostnetv2: Enhance cheap operation with long-range attention. Advances in Neural Information Processing Systems 35, 9969–9982. [50] Tanvir, M., Alam, M.S., Saha, D.K., Hasib, S.A., Islam, S., 2021. Real-time recognition of bangla sign language characters: A computer vision based approach using convolutional neural network, in: 2021 3rd International Conference on Electrical & Electronic Engineering (ICEEE), IEEE. pp. 177–180. [51] Tapu, T.K., Faiaz, F., Sikder, A.R., 2025. Lightweight convolutional neural network with self-attention mechanism for bangla sign language recognition, in: 2025 International Conference on Electrical, Computer and Communication Engineering (ECCE), pp. 1–6. doi:10.1109/ECCE64574.2025.11013937. [52] Tarafder, K., Akhtar, N., Zaman, M., Rasel, M., Bhuiyan, M., Datta, P., 2015. Disabling hearing impairment in the bangladeshi population. The Journal of Laryngology & Otology 129, 126–135. [53] Tasnim, S.A., Mahmud, R., Ahmed, T., Karmaker, D., 2026. A vision transformer-based fine-tuned dinov2 model for bangla sign language recognition. Multimedia Tools and Applications 85, 163. [54] Tompson, J., Goroshin, R., Jain, A., LeCun, Y., Bregler, C., 2015. Efficient object localization using convolutional networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 648–656. [55] Valli, C., Lucas, C., 2000. Linguistics of American sign language: An introduction. Gallaudet University Press. [56] Woo, S., Park, J., Lee, J.Y., Kweon, I.S., 2018. Cbam: Convolutional block attention module, in: Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19. [57] Xie, S., Girshick, R., Dollár, P., Tu, Z., He, K., 2017. Aggregated residual transformations for deep neural networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1492–1500.
38
Related documents
- Visually challenging conditions on sign language intelligibility show behavioural analogies with spoken language.#280825
- Cortical tracking of sign language: The role of language knowledge in tracking of different articulators.#280801
- How reliable are subjective ratings? The issue of reliability in psycholinguistic measures of sign frequency and iconicity in German Sign Language (DGS)#672351
- How reliable are subjective ratings? The issue of reliability in psycholinguistic measures of sign frequency and iconicity in German Sign Language (DGS)#672147
- SIGN LANGUAGE AND LINGUISTIC UNIVERSALS#341421
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive