realrobotshk
/
little_sophia_brain
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10 Commits
1 Branch
0 Tags
460 KiB
Python 88.7%
C++ 11.3%
 
 
Go to file
Jake ee92e1a484 added i2s Device Tree Files and i2s streaming test (esp32->python) 2025-10-27 11:16:54 +08:00
i2s_streaming_test added i2s Device Tree Files and i2s streaming test (esp32->python) 2025-10-27 11:16:54 +08:00
.gitignore realtime.py voice-to-text added, needs to be integrated 2025-10-24 10:27:05 +00:00
README.md added file overview to readme again 2025-10-24 21:40:26 +08:00
RetinaFace.rknn face detect and video streaming 2025-10-24 10:11:17 +00:00
main.py face detection and voice-to-text integrated into flask stream 2025-10-24 21:13:18 +08:00
realtime.py realtime.py voice-to-text added, needs to be integrated 2025-10-24 10:27:05 +00:00
test.wav added i2s Device Tree Files and i2s streaming test (esp32->python) 2025-10-27 11:16:54 +08:00

README.md

Little Sophia's Brain

A modular Python script designed to run on Little Sophia's Radxa ZERO 3W. It handles higher-level input processing outside the abilities of the ESP32 central controller.

  • Face Detection
  • Voice-to-Text (V2T)

Installation

  1. Clone this repository to your Radxa ZERO 3W.
  2. Download and place the Vosk model in the install directory:
  3. (Jake needs to add the rest of the prerequisites here — e.g., Python packages, environment setup, etc.)

TODO:

Tested with usb mic and camera only (Logitech C920)

File Overview

File Description
RetinaFace.rknn RKNN model for face detection and video streaming.
main.py Core script. Integrates face detection and voice-to-text into Flask stream.
realtime.py Voice-to-text module (Vosk). For testing separately.