Avaia: AI Voice Assistant & Smart Dustbin

Project Overview

Avaia is an AI-powered smart robotics project originally designed for a CS exhibition. It combines custom hardware control using an ESP32 microcontroller with a Python Flask backend for advanced AI integration. By leveraging OpenAI's LLMs alongside speech-to-text functionality, the project transcends simple hardware, turning a robotic dustbin into an interactive, voice-controlled entity that can respond to natural language commands, move towards the user, open its lid, and navigate back to a home base. This project is a highlight of Om Girkar's portfolio, showcasing his skills in both software and hardware integration.

Key Features

• Voice Control Interface: Interact seamlessly using natural language commands rather than rigid programmed inputs.
• Autonomous Navigation: Dual DC motors allow the unit to move towards the user and return to an IR-detected home position.
• Obstacle Avoidance: Basic real-time obstacle detection utilizing ultrasonic sensors to prevent collisions.
• Lid Automation: Automated lid opening and closing controlled via a servo motor.

Hardware Architecture

The system is built on lightweight, cost-effective components wired together without a breadboard for maximum space efficiency:

• ESP32 Development Board: The core logic controller, handling Wi-Fi networking and sensor communication.
• L298N Motor Driver: Manages the voltage and direction for the dual DC motors handling mobility.
• HC-SR04 Ultrasonic Sensor: Used for precise distance measurement and obstacle avoidance.
• MG90S Servo Motor: Provides the torque needed to smoothly automate the bin's lid.

Software Architecture

The backend runs locally on Python 3.8+ utilizing the Flask framework. The server acts as a bridge between the ESP32 and OpenAI's APIs, parsing the user's voice input, making logical decisions based on intent, and firing HTTP commands back to the hardware.