Technologie & Wissenschaft

Teaming up with AI? The risks and global security implications of military AI

Stage 6
Robin Geiss, Mennatallah El-Assady, Marcel Baltzer, Joanna J. Bryson
What are key concerns and risks arising from the use of AI in military decision-making and operations? What safeguards can ensure AI-supported systems consistently remain aligned with the user’s intentions, ethical standards and international law? Can human-AI teaming mitigate these risks and in turn, which specific risks arise from it?
Teaming up with AI?  The risks and global security implications of military AI Advances in the field of artificial intelligence are rapidly transforming all aspects of society. AI will also revolutionize how militaries operate and how future wars will be fought, and competitive pressures in today’s fraught global security environment will only accelerate this trend. With AI technology advancing in leaps and bounds, the time to act is now. AI will help to increase the speed and accuracy of military decision-making, planning and operations. In combination with robotic platforms and next-generation sensor technology, it will open up a vast spectrum of military applications, from AI-enabled logistical support, early warning systems, and intelligence gathering to AI-supported command structures, cyber operations and autonomous weapons systems. But an enabling technology as powerful and transformative as AI comes with a long list of significant risks, not least inadvertent escalation, misperception and malfunction, and concerns about lack of transparency, discrimination and bias. Crucially, however, military AI also raises profound ethical and legal questions about human agency and human control, especially in matters of life and death. The UN Secretary General has unequivocally stated that: “Human agency must be preserved at all cost”. Human-AI teaming seeks to leverage the strengths of humans and AI systems while overcoming their respective limitations, but human control retains priority over AI control. The concept of teaming evokes the integration of humans and AI systems as coordinated units, working to achieve strategic and operational goals through an agile and dynamic distribution of tasks. But the use of AI systems as “teammates” still raises critical questions about the risks and challenges inherent in the use of AI in the military domain. To explore these issues, the panel will discuss the following questions: What are key concerns and risks arising from the use of AI in military decision-making and operations? What safeguards can be used to ensure AI-supported systems consistently remain aligned with the user’s intentions, ethical standards and international law? Can human-AI teaming mitigate these risks? And in turn, which specific risks arise from human-AI teaming itself?

Additional information

Type Panel-Diskussion
Language English

More sessions

Pending
Technologie & Wissenschaft
Mary Maggic
Wetlab
How do our bodies become-with invisible molecules, whose boundaries blur between natural and synthetic? This installation is the result of the workshop, "Worlding with the Molecular" where participants extract hormones from their own urine and build a scenography that embodies the very agency of molecules.
Pending
Technologie & Wissenschaft
Steffen Köhn, Nestor Siré
Location: Arena Club - Media Parcours FRAGILE CONNECTIONS ist eine interaktive Dokumentation des kubanischen Graswurzel-Netzwerks SNET - entstanden als Reaktion auf den stark beschränkten Internetzugang in Kuba.
Pending
Technologie & Wissenschaft
Katharina Zweig, Marc Hauer, Leon Sproten, Lea J Becker, tba, Jan Harbeke, Alexander Wilhelm, Natalia Syrnicka
Location: Glashaus Wie erkenne ich diskriminierende KI? Die Frage wirst Du Dir spätestens stellen, wenn es eine KI ist, die über Deinen Kredit entscheidet. Wir zeigen Dir anhand von Entscheidungsbäumen, dass die Antwort gar nicht so einfach ist. Du erfährst , wie Diskriminierung verschleiert werden kann, und kannst es direkt selbst versuchen!
Pending
Technologie & Wissenschaft
Sonderforschungsbereich/Transregio 318 „Constructing Explainability“ , Nils Klowait, Biere Lea, Helen Beierling , Mathis Tibbe, Tim Jonas Rittig, Arthur Maximilian Noller
KI entdecken: Kann ein Roboter mit deiner Hilfe besser Minigolf spielen? Und wie gut kommst du mit einer KI klar, von der du gar nicht weißt, was sie tut? Im Sonderforschungsbereich/Transregio 318 „Constructing Explainability“ erforschen wir, wie wir die Mensch-Maschine-Interaktion mit Erklärungen verbessern können – und du kannst uns unterstützen.
Pending
Technologie & Wissenschaft
Mike Shorter, Sabine Junginger, Aurelio Todisco, Aysun Aytaç, Paola Pierri
Money Talks is an installation that lifts the curtain on our power dynamics and financial relationships with speech recognition AI. Talk to this AI in order to understand not only what it hears, but the inner workings we never get to see. How has it interpreted you? How confident is it? What are the true costs?
Pending
Technologie & Wissenschaft
Fadia Elgharib, Daniel Wessolek, Sara Diaz Rodriguez, Natalija Krasnoperova, Spyros Libre Water, LibreWater, Tom Dietel, Bezawork Tilahun Mindaye, Sarah Prien
Makerspace
The Open Hardware Exhibition will showcase a worldwide collection of open hardware, demonstrating how open hardware can end some global challenges and offer new ways to solve these challenges. Pass by the Makerspace to get a closer look!
Pending
Technologie & Wissenschaft
Christian Zöllner
Location: Fabmobil Wie geht das eigentlich: Co Creation mit einem Roboter? Wie fühlt sich das an: Wenn ein Roboter auf Augenhöhe mitgestaltet? Mit Studierenden der Burg Giebichenstein Kunsthochschule Halle könnt ihr mit Roboterarmen zeichnen üben!