Exploring the intersection of embedded systems and artificial intelligence
Real-Time Crowd Behavior Analytics | IIT Tirupati STARTP
Developed a comprehensive real-time crowd analytics system using YOLOv11 for person detection and ByteTrack for multi-object tracking. Designed four spatiotemporal heatmap models: position, path, dwell time, and velocity for identifying bottlenecks and high-risk zones.
Domain-Specific Document AI
Designed a domain-specific OCR pipeline for cadastral map documents using EasyOCR and OpenCV. Implemented multi-color text detection, fallback OCR strategies, and symbol recognition modules with configuration-driven detection pipelines.
LSTM-Based Temporal Prediction
Implemented YOLO-based detection with LSTM-based temporal prediction for crowd safety monitoring. Performed spatiotemporal feature extraction and behavioral pattern analysis with real-time dashboard visualization.
Low-Latency Wireless Firmware
Problem: Existing wireless protocols (WiFi, BLE) had too much latency and overhead for real-time multi-robot coordination.
My Solution: Developed custom Embedded C firmware using ESP-NOW protocol for peer-to-peer communication. Implemented UART-based debugging, packet acknowledgment, and timing synchronization.
Tech: ESP32, Embedded C, ESP-NOW, UART, FreeRTOS
Outcome: Achieved <10ms latency between nodes. Debugged and resolved packet loss issues. System validated for reliability through 1000+ transmission tests.
Vision-Based Position Estimation
Integrated IMU and vision sensor data using I2C and UART interfaces for position estimation. Developed firmware routines for sensor calibration, noise filtering, and control signal stability.
Real-Time Servo Control
Designed firmware for real-time servo motor control with feedback monitoring. Tested actuation accuracy and resolved jitter through timing optimization and signal filtering.
ESP32-CAM with Advanced Web Interface
Developed an advanced WiFi-controlled car using ESP32-CAM with real-time video streaming. Features a professional web interface with glassmorphism design, WebSocket communication for low-latency control, and live camera feed with latency monitoring.
ESP32-CAM with Servo-Based Movement
Extended the WiFi camera car with pan-tilt functionality using servo motors for 2-axis camera movement. Enables remote directional camera control synchronized with vehicle movement.
ESP-NOW Wireless Communication
Built a wireless robot control system using ESP32 and ESP8266 with ESP-NOW protocol. Implemented joystick-based control with real-time data transmission for smooth, low-latency operation.
NITK Surathkal Research | IEEE Published
Problem: Coordinating multiple robots in formation without centralized control, handling real-world communication delays and localization errors.
My Solution: Designed and built a hybrid swarm system with TurtleBot (ROS) as leader and ESP32-based robots as followers. Implemented ESP-NOW for decentralized peer-to-peer communication and ArUco markers for vision-based relative positioning.
Tech: ESP32, ROS, ESP-NOW, ArUco Markers, C/C++, Python
Outcome: Published at IEEE ICRM 2025. Achieved <100ms communication latency. Validated formation control accuracy and reliability through extensive testing.
Hardware Validation Through Simulation
Built a ROS2 + Gazebo simulation environment that closely matched real hardware behavior to reduce trial-and-error on physical robots. Validated navigation logic before hardware deployment.
PID Control with Real Sensor Noise Handling
Built a self-balancing robot using MPU6050 IMU and ESP32, implementing PID control tuned based on real sensor noise and drift. Demonstrates practical understanding of how control theory behaves on real hardware.
ESP32-C3 + GPS + OLED | No Internet Required
Developed a fully offline boundary detection system using ESP32-C3, GPS module, OLED display, and buzzer. Emphasis on reliability without internet dependency for field applications.
MAX30102 Heart Rate & SpO2 Sensor
Developed a real-time health monitoring system using MAX30102 sensor for continuous heart rate and blood oxygen saturation (SpO2) measurements. Implemented I2C communication and signal processing algorithms for accurate readings.
Python-Based Video Capture & Recording
Created a Python application to receive and record video streams from ESP32-CAM via serial communication. Implemented JPEG frame parsing and real-time video display with OpenCV.
Arduino-Based Voting Solution
Built a functional electronic voting machine using Arduino with LCD display and button inputs. Features real-time vote counting, result calculation with percentages, and visual feedback using LED indicators.
Location Tracking System
Integrated GPS module with Arduino for real-time location tracking and navigation applications. Implemented NMEA sentence parsing and serial communication for geographic data acquisition.
2025 International Conference on Robotics and Mechatronics (ICRM) | IEEE
Designed a decentralized wireless communication framework for real-time control of omni-directional mobile robots. Compared ESP-NOW and Wi-Fi TCP/IP protocols for latency, reliability, and power efficiency. Integrated ArUco-based vision localization achieving <0.5cm distance error and <4° yaw accuracy. Research conducted at NITK Surathkal Robotics Lab.