Design, development, and deployment of a multi-sensory children's storytelling device combining projected illustrations, sound playback, and BLE + Wi-Fi IoT integration, supported by a Flutter-based mobile app and Firebase backend.

In partnership with our client, we developed a connected storytelling device that creates an immersive experience for children by projecting illustrations while playing mp3 stories. The project encompassed custom hardware design, firmware development on ESP32, Flutter app development for Android and iOS, and Firebase + cloud integration.

The app allows parents to manage devices, unlock story content, and update settings. Key technical features include BLE-based Wi-Fi provisioning, Wi-Fi-based story content download, and BLE for device settings and control.

‍

Problem Statement

The client’s product development, requiring:

• Playback with Wi-Fi content download.
• Adding BLE provisioning for Wi-Fi and BLE-based control.
• Ensuring seamless cross-platform app performance on iOS and Android.
• Enabling mass manufacturing for China, including sourcing and QC.
• Improving cloud backend security and Firebase UX features.

‍

1. Hardware Design & Firmware Development
   • Custom PCB designed for ESP32, supporting audio output, projection control, EEPROM, and RFID support.
   • Firmware developed to handle:
     • BLE provisioning of Wi-Fi
     • Story download via Wi-Fi (MP3 files)
     • Playback and scene control
     • EEPROM/RFID story unlocking
   • Manufacturing-ready BOM with sourcing and QC checklist for China.
2. Cross-Platform Mobile App (Flutter)
   • Built in Flutter to target Android and iOS.
   • Core features:
     • Device provisioning (BLE + Wi-Fi)
     • Story disk management
     • Device control panel
     • User profile + unlock management
3. Cloud Integration & Firebase Setup
   • Firebase used for:
     • Authentication (with branded domain)
     • Firestore database with IP-restricted access rules
     • Hosting & storage for MP3 content
   • Configured custom domain links for email verification
   • Provided Firestore + DigitalOcean backup and recovery strategy
4. App Store Support
   • Guided setup for Google Play & Apple Developer accounts
   • Documentation for uploading, updating, and configuring builds
5. Web Admin Panel
   • Admin UI to:
     • Manage user accounts
     • View/edit device configurations
     • Control unlocked stories
     • Track and manage story disks

‍

Value Add

• Delivered an all-in-one connected storytelling platform tailored to young users and parents
• Enabled future scalability with OTA updates and modular content management
• Simplified BLE/Wi-Fi onboarding via intuitive provisioning flows
• Created a manufacturing-ready solution with full firmware/hardware synergy

‍