CERTIoT-6G: Continuous Cybersecurity Certification for IoT Devices in 5G/6G Networks
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
arXiv:2608.23339v1 [cs.NI] 24 Aug 2026
CERTIoT-6G: Continuous Cybersecurity Certification for IoT Devices in 5G/6G Networks Evangelos Lempesis
Fabio Palmese
Hamed Haddadi
Anna Maria Mandalari
Mulini
Mulini
Mulini Imperial College London
Mulini University College London
Abstract—The massive adoption of Internet of Things (IoT) devices across critical domains such as healthcare, smart cities, industrial automation, and critical infrastructure introduces significant cybersecurity and regulatory challenges. Current and forthcoming European regulations, including the Cyber Resilience Act (CRA) and the NIS2 Directive, require manufacturers, operators, and other organizations to ensure secureby-design devices, continuous vulnerability management, and resilient operation throughout the device lifecycle. Traditional certification mechanisms remain static, manual, and difficult to scale across heterogeneous IoT ecosystems. This paper presents CERTIoT-6G, a Security-as-a-Service (SECaaS) framework that enables automated cybersecurity certification and continuous compliance monitoring of IoT devices operating in 5G and future 6G networks. The framework integrates automated compliance analysis, real-time traffic monitoring, and adversarial testing capabilities. We validate the CERTIoT-6G framework on different IoT device categories operating in an advanced 5G testbed. Evaluation results reveal critical compliance gaps, particularly in traffic encryption and availability under unstable conditions, and demonstrate that the framework produces actionable verdicts mapped to regulatory requirements across heterogeneous device types. Furthermore, we show that the monitoring pipeline has a negligible impact on live 5G traffic. Index Terms—Cybersecurity Certification, IoT security, 5G/6G Networks, Continuous Compliance Monitoring
I. I NTRODUCTION The exponential growth of the Internet of Things (IoT) is reshaping critical sectors including healthcare, smart cities, and industrial automation. Large numbers of heterogeneous connected devices generate continuous data streams that enable advanced monitoring and automation at scale. However, this same proliferation substantially expands the attack surface: vulnerable devices may expose sensitive personal information [1], allow unauthorized access, or serve as entry points for large-scale attacks. As IoT deployments increasingly rely on 5G [2] and future 6G infrastructures, the scale and dynamism of these ecosystems make manual security assessment both impractical and insufficient. European Union legislation has responded by establishing binding cybersecurity obligations for both manufacturers of connected products and organizations operating critical networked systems. The Cyber Resilience Act (CRA) [3] mandates that manufacturers of connected products demonstrate secure-by-design principles, active vulnerability management, and compliance monitoring throughout the device lifecycle, not only at launch time. The NIS2 Directive extends these obligations to operators of
essential services that depend on networked IoT deployments. Together, these frameworks create a regulatory environment in which certification must be continuous, evidence-based, and scalable to large device populations. Existing certification practices, however, remain largely manual and point-in-time. Standards such as ETSI EN 303 645 [4] and its conformance specification ETSI TS 103 701 [5] define the security requirements, yet the testing processes are typically performed once at product launch and do not track the evolving security posture of devices in operation. Recent work has shown that even with standard network security tooling, only 52–70% of ETSI TS 103 701 tests can be automated [6], highlighting the need for continuous monitoring solutions. This paper introduces CERTIoT-6G, a framework that transforms IoT device certification from a static exercise into a continuous, automated service embedded within the 5G network infrastructure. Operating at the User Plane Function (UPF) via Local Breakout (LBO), the framework inspects live device traffic, executes adversarial compliance tests, and produces structured compliance reports mapped to specific CRA and NIS2 requirements, without requiring device software manipulation. We validate the framework on commercial IoT devices operating on a 5G network, uncovering significant compliance gaps and demonstrating that automated, networkembedded certification can produce compliance evidence at scale. The main contributions of this paper are: • A Security-as-a-Service (SECaaS) architecture enabling continuous cybersecurity certification of IoT devices in 5G and future 6G networks. • An automated compliance monitoring pipeline translating regulatory frameworks (CRA, NIS2, ETSI EN 303 645) into network-level compliance tests with per-requirement verdicts. • Integration within an advanced 5G Standalone (SA) testbed, demonstrating real-time traffic monitoring via UPF/LBO. • An early experimental validation across three representative device categories revealing critical gaps in traffic encryption and denial-of-service resilience, with planned extension to a larger and more diverse device population. II. R ELATED W ORK A. IoT Security Measurement and Evaluation Early systematic efforts to evaluate the security of IoT deployments revealed widespread and structural weaknesses.
Alrawi et al. [7] systematized the attack surface of homebased IoT across firmware, network, application, and cloud components, showing that vulnerabilities span the entire deployment stack. Ren et al. [1] quantified the breadth of personal data exposed through unencrypted or insufficiently protected traffic in consumer IoT devices, findings strongly corroborated by our experimental results. Huang et al. [8] demonstrated that gateway-level traffic collection can yield labeled datasets suitable for large-scale security and privacy analysis of smart-home devices, and Shahid et al. [9] showed that passive traffic features alone are sufficient to identify IoT devices by type and vendor without device-side access. B. Compliance-Oriented IoT Security Frameworks Most directly related to CERTIoT-6G is COPSEC [10], a compliance-oriented framework that automatically probes IoT devices at the network gateway and evaluates them against security guidelines and privacy regulations. COPSEC extracts measurable metrics from standards including ETSI EN 303 645 and ENISA guidelines, applies them through automated network experiments, and reports compliance verdicts. CERTIoT-6G shares COPSEC’s gateway-level measurement paradigm and regulatory grounding, but extends it in three critical directions: it operates within a live 5G network infrastructure, leveraging the UPF and LBO rather than a local WiFi gateway, it incorporates active adversarial testing beyond passive traffic analysis, and it maps each verdict directly to individual CRA and NIS2 requirements for regulatory auditability. C. Automated Security Testing Standards ETSI TS 103 701 [5] defines a conformance assessment methodology for consumer IoT devices against ETSI EN 303 645. While comprehensive, its procedure is designed for manual execution by accredited testing laboratories. Kaksonen et al. [6] investigated the degree to which standard network security tools can automate the 56 test units relevant to network attacks within ETSI TS 103 701, finding 52% coverage with basic tooling and up to 70% with advanced tools, leaving a significant automation gap. CERTIoT-6G addresses this by embedding a curated set of automated compliance tests, covering service exposure, encryption, authentication, data leakage, and resilience directly within the 5G network plane, enabling continuous coverage aligned with CRA requirements. D. IoT Security in 5G and 6G Networks The adoption of cellular connectivity in IoT deployments introduces specific security considerations. Hasan et al. [2] provide a comprehensive survey of threats for 5G-enabled Internet of Medical Things, identifying credential attacks, protocol vulnerabilities, and denial-of-service as primary threats, all of which are exercised by the CERTIoT-6G validation engine. The 3rd Generation Partnership Project (3GPP) system architecture for 5G [11] provides the UPF and LBO mechanisms that CERTIoT-6G exploits to position its monitoring functions at the network edge. As 6G standardisation advances,
Fig. 1. CERTIoT-6G four-engine architecture. The Regulatory Interpretation Engine maps standards to test bindings; the Device Identification Engine autoregisters devices; the Validation Engine runs passive and active tests; the Reporting Engine aggregates verdicts into compliance reports.
AI-native network management is expected to become a core design principle, creating further demand for adaptive compliance services beyond what static certification can provide. E. Positioning of CERTIoT-6G Unlike prior measurement tools that operate on local networks and evaluate devices passively [8], [10], and unlike testing frameworks designed for laboratory execution against a conformance specification [5], [6], CERTIoT-6G operates continuously inside a live 5G network infrastructure. It combines passive monitoring, active adversarial testing, and natural language processing (NLP)-based personal-data detection into a single pipeline that produces machine-readable compliance evidence bound to specific regulatory requirements, a capability not provided by existing tools. III. CERTI OT-6G F RAMEWORK CERTIoT-6G is a SECaaS platform that continuously monitors IoT devices connected to 5G or future 6G networks and verifies their compliance with applicable cybersecurity regulations. Figure 1 illustrates the four functional components and the data flows between them. A. Regulatory Interpretation Engine The interpretation engine decomposes cybersecurity regulations into structured, machine-readable requirement bindings. Frameworks and guidance - including the CRA [3], the NIS2 Directive [12], ETSI EN 303 645 [4], together with ENISA guidelines [13] and NIST recommendations [14] - are mapped to concrete security tests so that each result is bound to one or more specific requirements. The mapping is many-to-many: a single test can provide evidence for multiple requirements, allowing the framework to amortise testing effort across overlapping regulatory obligations. B. Device Identification Engine The identification engine discovers and registers devices as they join the network, relying on passive traffic sniffing. Each time a new device is detected on the network, the identification module is triggered to obtain the required device information:
category, vendor, model, and version. In our case, the identification pipeline is based on the method described in [15]. The first 30 seconds of device traffic after its detection is extracted, and DNS-based statistical features serve as input to a machine learning classifier that determines the device type. The derived device attributes allow the system to associate each device with the appropriate set of compliance checks and enable deviceclass-specific policies without manual onboarding. C. Validation Engine The validation engine instantiates and executes the test suite produced by the Regulatory Interpretation Engine, receiving a structured set of test bindings that associate each compliance check with one or more specific regulatory requirements. The test suite is not automatically generated: each test is defined and validated by security experts with knowledge of both the relevant regulatory requirements and the network-level mechanisms through which those requirements can be violated, ensuring that verdicts are legally defensible and technically grounded. Table I summarizes part of the test suite, derived from a thorough analysis of recent regulations. The table also reports the binding of the tests to the ETSI EN 303 645 standard, from which many of the CRA standards are derived. Tests are executed in two complementary modes: passive traffic monitoring, which observes device behavior without interfering with it, and active security probing, which subjects the device to controlled adversarial activity and measures its response. Passive monitoring. The device traffic is captured using standard tools (e.g., tshark or tcpdump) and classified by application-layer protocol to compute the proportion of encrypted versus cleartext flows. This drives two tests: • Encrypted Traffic: measures what fraction of device flows use a recognised encryption protocol. Devices transmitting part of their data in cleartext are flagged as non-compliant with confidentiality requirements. • Personal Information: captured payloads are scanned by a pre-trained NLP entity-recognition model to detect personally identifiable information (PII) such as names, locations, device identifiers, and similar attributes transmitted without adequate protection. These tests are entirely passive and do not interfere with normal operation of the device. The duration of each test is inherently device-dependent: an adequate observation window is essential for accurate verdicts, since a window that is too short may fail to capture the full range of a device’s communication behavior and produce misleading results. Active probing. The engine executes a sequence of targeted adversarial tests: • Unused Ports: a TCP/UDP port scan enumerates open services and compares them against the services observed in passive captures; ports that are open but absent from legitimate traffic are flagged as unnecessary attack surface. • TLS Interception: an intercepting proxy is inserted between the device and its cloud endpoint to assess whether the
TABLE I CERTI OT-6G T ESTS WITH TARGETED P ROPERTIES AND R EQUIREMENTS
Test
Property
EN 303 645 Req.
Unused Ports (Port) TLS Interception (TLS) Encrypted Traffic (Enc) Dictionary Attack (Dict) Replay Attack (Rep) DoS Attack (DoS) Personal Info (PII) Reliability (Rel)
Attack Surface Confidentiality Confidentiality Authentication Integrity Availability Privacy Resilience
5.6.1 5.1. 5.3, 5.5 5.1, 5.3, 5.5, 5.8 5.1 5.5 5.9.3 5.8 5.9.3
device validates the server certificate chain and rejects connections through an untrusted intermediary. This verifies the device resilience to Man-in-the-Middle attacks (MITM). • Dictionary Attack: a credential brute-forcing sequence is run against exposed authentication interfaces (e.g., SSH, HTTP); the test checks whether the device enforces rate limiting or account lockout under repeated failed attempts. • Replay Attack: previously captured valid traffic frames are replayed to assess whether the device implements messagefreshness mechanisms (e.g., nonces, sequence numbers) sufficient to reject replayed commands. • DoS Attack and Reliability: a flood attack is directed at the device for a controlled duration; the test records whether the device remains responsive during the attack and measures the time to full service recovery afterwards, combining availability and resilience into a paired verdict. Each test produces a binary verdict as compliant or noncompliant, together with the triggering evidence, and passes the result to the Reporting Engine. D. Reporting Engine The reporting engine generates structured compliance reports and user-friendly web-based alerts when non-compliance is detected. Rather than enforcing network-level mitigations - which may not be feasible for every topology or installation - the engine documents the non-compliance, classifies its severity, and provides actionable remediation recommendations such as closing insecure ports, restricting exposed services, or applying firmware updates, keeping remediation authority with device owners and operators. Each test yields a binary compliant or non-compliant verdict with a humanreadable rationale, a proposed remediation step, and the bound regulatory requirement; results are aggregated into reports that can support certification, audit, and conformity-assessment processes. IV. I NTEGRATION IN 5G T ESTBEDS To validate the proposed solution in a real-world operational 5G testbed, we deploy CERTIoT-6G in the CARL-W testbed at Karlstad University (KAU)1 , leveraging its 5G SA 1 https://6gpath.eu/testbeds/karlstad-university-testbed/
TABLE II C OMPLIANCE VERDICTS ACROSS THE THREE DEVICE CATEGORIES .
Fig. 2. CERTIoT-6G deployment in the KAU CARL-W 5G testbed. IoT devices connect directly to the 5G network as UEs. Traffic is inspected at the analysis VM via LBO; the Mulini cloud is reached over WireGuard VPN.
infrastructure for network-level IoT evaluation [16]. The key integration point is the UPF with LBO [11]. In this configuration, the user-plane traffic generated by the IoT devices is locally steered toward a dedicated analysis virtual machine (VM) before being forwarded to the Internet. This allows the monitoring platform to inspect device communications in-path, close to the network edge, while avoiding unnecessary traversal of remote cloud infrastructure and minimizing additional latency. The deployment architecture is shown in Figure 2. IoT devices attach to the CARL-W 5G SA network as UEs [17]. On the radio side, the testbed relies on the CARL-W Radio Access Network infrastructure, including Ericsson radio dots, indoor radio units, and the gNodeB. User-plane traffic is then carried through the 5G data path and anchored at the locally deployed UPF in Karlstad. Through LBO, selected traffic is steered to the CERTIoT-6G VM deployed in the KAU edge environment before being forwarded to the Internet. This placement allows CERTIoT-6G to inspect live IoT traffic, close to the 5G edge, without requiring modifications to the devices. The VM hosts the remote capture agent and the compliance analysis modules, including protocol classification, personal-data inspection, and the active security tests. Secure connectivity between the Mulini cloud infrastructure and the KAU testbed is maintained through WireGuard VPN tunnels. This enables coordination between the cloud-side management components and the edge-deployed monitoring VM, supporting synchronised monitoring and reporting across both environments. V. E XPERIMENTAL VALIDATION A. Setup and Device Set As an early validation of the framework, three representative IoT devices were selected to cover a range of communication patterns, data sensitivity levels, and service exposure characteristics, belonging to three distinct categories:surveillance, lighting, and environment. These categories reflect typical
Device
TLS
Enc
Port
PII
Rel
Dict
DoS
Rep
Surveillance Lighting Environment
✓ ✗ ✓
✗ ✗ ✗
✓ ✓ ✓
✗ ✓ ✓
✓ ✓ ✓
– ✓ –
✗ ✗ ✓
✓ ✗ ✓
Pass rate
66.7%
0%
100% 66.7% 100% 100% 33.3% 66.7%
IoT deployments in smart-home and smart-city scenarios and present meaningfully different compliance profiles. The devices operated as 5G User Equipment (UE) devices, with their traffic forwarded to the analysis VM via the 5G network and LBO path. Each device was subjected to the full battery of eight compliance tests listed in Table I, where applicable. The Replay Attack test was executed only for devices that expose locally reachable services; the Dictionary Attack test was applied only to devices that present authentication interfaces. Extension of the validation to a larger and more diverse device population is planned for future work. B. Analysis and Key Findings Table II reports the compliance verdict for each device category across all applicable tests (✓ means compliant, ✗ non-compliant, and – not applicable). The last row of the table summarises per-test compliance rates across the three device categories. Despite the small initial device set, the results reveal a clear and consistent disparity between security properties, establishing a baseline picture that motivates the planned broader evaluation. Strengths. All three devices (100%) recovered to full operation after the DoS probing phase (Reliability), and the single device presenting an authentication interface (the smart light) resisted credential brute-forcing (Dictionary Attack 100%). Port hygiene was consistent across all categories: no device exposed unnecessary network services (Unused Ports 100%), confirming that basic attack surface reduction is implemented even at the lower end of the device spectrum. Critical failure: traffic encryption. Encrypted Traffic was the most critical compliance failure as all the tested devices transmitted at least part of their information in cleartext, exposing data to passive eavesdropping. This finding corroborates patterns documented in prior network measurement studies [1], [10] and constitutes a direct violation of many cybersecurity requirements for confidentiality of data in transit. The fact that this failure appears in both a media-rich device (camera) and a lightweight constrained device (lighting) suggests it is not specific to a single device class. Availability and integrity. Only the environmental sensor passed the DoS Attack test, indicating that the camera and lighting device fail to maintain service continuity under flooding conditions, a concern for deployments where availability carries safety implications. For the Replay Attack, the camera and environmental sensor passed, as their services rejected replayed messages, while the lighting device failed, allowing