Success Story: Securing AI across the Machine Learning Operations chain: Piloting cybersecurity and data sovereignty of AI in supercomputing

—

by

Graphic showing the technical solution overview with Edge/Data Owners, the Federated Learning FLOW, the HLRS HPC environment, and an AI Shield security layer. The use-case workflow underneath shows: collecting data in CARLA → training local models on edge clients → federated aggregation on HLRS → HPC validation via verifier-as-a-client → robust global model for real-world deployment.

Highlights

  • Federated learning applied to steering angle prediction reduced the need for data transfers.
  • The federated steering-angle model reduced estimated data network transfer approximately by 60%.
  • Continuous model evaluation integrated as a “verifier-as-a-client” architecture.

Challenges

During industrial partnerships, cross-organizational AI development often depends on large, distributed and sensitive datasets that cannot be freely transferred to a central supercomputing environment because of privacy, security, regulatory and bandwidth constraints. Centralized training typically requires moving substantial volumes of raw data, increasing network load, storage demand, computing time and operational cost, while also exposing AI workloads and models to additional cybersecurity risks. This can limit collaboration between organizations and slow the validation of AI models on supercomputing infrastructure.

Solution

Bosch Global Software Technologies GmbH (BGSG), located in Stuttgart, Germany, develops software, digital systems, and IT solutions for enterprises. Working with HammerHAI, BGSG tested an approach that combines federated learning and secure model validation to train automotive AI models without the need to exchange raw vehicle datasets. Distributed clients trained local steering-angle models using the Flower open-source federated learning framework. No data were exchanged among clients except for model parameters, which were aggregated into a global model. HLRS GPU infrastructure provided through HammerHAI was integrated into a customized validation workflow, which included a “verifier-as-a-client” concept for evaluating global models during training. The AI security platform “AI Shield” was deployed in the HPC environment to strengthen protection of AI workloads. The approach enabled collaborative model development among data owners and sources and created a reusable edge-to-HPC workflow for secure industrial AI development and validation.

Benefits and Impact

The project demonstrated that federated learning can combine knowledge from distributed automotive datasets without requiring the transfer of the underlying raw data. Compared to a centralized approach, the federated steering-angle model prediction demonstrated significantly better generalization across operating environments, without a huge drop in accuracy. Estimated network traffic was reduced by approximately 60%, lowering bandwidth, storage and data-management requirements. Integration with the HLRS supercomputing environment established a reusable workflow for GPU-based model validation by internal teams, while AI Shield extended the approach toward securing AI workloads on HPC infrastructure.

This solution offers a scalable foundation that will make it easier for industrial partners to collaborate on the development and validation of secure AI models without exposing proprietary or sensitive data. It holds the additional benefit that reduced data movement can also decrease infrastructure load and associated energy consumption. Direct energy or monetary savings were, however, not measured in this project.

Next Steps

As the project continues, it will investigate approaches for scaling the federated workflow to include more edge and mobile clients, automating MLOps workflows in the HLRS infrastructure, and hosting reusable aggregation services on the supercomputing platform. Further work will look at strengthening cybersecurity integration with HPC, and extend the approach to broader domain agnostic AI use cases.

Contact

Rane Abhijeet, Bosch Global Software Technologies GmbH,
Abhijeet.Rane@in.bosch.com

Funding

The acquisition and operation of the EuroHPC Al-optimised supercomputer is funded jointly by the EuroHPC Joint Undertaking, through the European Union’s Digital Europe Programme, as well as by the German Federal Ministry of Research, Technology and Space (BMFTR) and the Baden-Württemberg Ministry of Science, Research and the Arts.

Views and opinions expressed are those of the author(s) only and do not necessarily reflect those of the European Union or the EuroHPC JU. This project has received funding from the European High Performance Computing Joint Undertaking under grant agreement No. 101234027. It is co-funded by the European Commission, the German Federal Ministry of Research, Technology and Space (BMFTR), the Baden-Württemberg Ministry of Science, Research and the Arts, the Bavarian State Ministry of Science and the Arts and the Lower Saxony Ministry of Science and Culture.

Logo of the Federal Ministry of Research, Technology and Space of Germany. A black eagle icon (coat of arms of Germany) on the left, a vertical strip in the colors of the German flag (black, red, yellow) to the right of it and even further to the right the wordmark "Bundesministerium für Forschung, Technologie und Raumfahrt".
Logo of the Federal Ministry of Research, Technology and Space of Germany. A black eagle icon (coat of arms of Germany) on the left, a vertical strip in the colors of the German flag (black, red, yellow) to the right of it and even further to the right the wordmark "Bundesministerium für Forschung, Technologie und Raumfahrt".