
From drones delivering medical supplies to digital assistants performing everyday tasks, AI-powered systems are becoming increasingly embedded in everyday life. The creators of these innovations promise transformative benefits. For some people, mainstream applications such as ChatGPT and Claude can seem like magic. But these systems are not magical, nor are they foolproof – they can and do regularly fail to work as intended.
AI systems can malfunction due to technical design flaws or biased training data. They can also suffer from vulnerabilities in their code, which can be exploited by malicious hackers. Isolating the cause of an AI failure is imperative for fixing the system.
But AI systems are typically opaque, even to their creators. The challenge is how to investigate AI systems after they fail or fall victim to attack. There are techniques for inspecting AI systems, but they require access to the AI system’s internal data. This access is not guaranteed, especially to forensic investigators called in to determine the cause of a proprietary AI system failure, making investigation impossible.
ECE Ph.D. student David Oygenblik and associate professor Brendan Saltaformaggio are computer scientists who study digital forensics. Their team at the Georgia Tech has built a system, AI Psychiatry, or AIP, that can recreate the scenario in which an AI failed in order to determine what went wrong. The system addresses the challenges of AI forensics by recovering and “reanimating” a suspect AI model so it can be systematically tested.
Read the full story from The Conversation:
Related Content
A new high-voltage breaker can clear grid-scale faults without greenhouse gas
From IEEE Spectrum: Lukas Graber and the Plasma and Dielectrics Laboratory are reimagining high-voltage circuit breakers to operate without gases that are bad for the environment and harmful to humans.
Fill-in-the-Blank Training Primes AI to Interpret Health Data From Smartwatches, Fitness Trackers
The human body constantly generates a variety of signals that can be measured from outside the body with wearable devices.