Autonomous Anomaly Detection and Explanation

2024 - work done with NEC corporation

Team members:
Shivendra Agrawal (lead)
Ashutosh Naik (Graduate researcher)
Dusty Woods (Lab Manager)
Bradley Hayes (Advisor)

We developed a proof-of-concept system that employs a Vision Language Model (VLM)—specifically GPT-4o—and a mobile robot (Husky) to autonomously detect and explain spatial anomalies by analyzing discrepancies in human spatial behavior.

Video with sound (recommended version)




Poster