T-Mobile

Drone AI: Real-Time 5G Video Analysis and Agentic LLM

This project, sponsored by T-Mobile, developed a 5G-based real-time drone video analysis system integrated with agentic LLMs. Drone video and telemetry data are transmitted via 5G to an edge node, where YOLOv12 performs object detection and Gemma3-4B generates captions. GPT-based models handle higher-level summarization and reasoning. Results, including detections and key flight/network KPIs, are stored in a database and visualized through an operator dashboard. The system supports natural language queries via an agent orchestrator and features an end-to-end, real-time, asynchronous processing pipeline.