Alina Lozovskaya
commited on
Commit
·
77b4d45
1
Parent(s):
a871e10
Update architecture scheme and create docs folder
Browse files- README.md +2 -2
- {src/reachy_mini_conversation_demo/images → docs/assets}/conversation_demo_arch.svg +2 -2
- {src/reachy_mini_conversation_demo/images → docs/assets}/reachy_mini_dance.gif +0 -0
- docs/scheme.md +37 -0
- src/reachy_mini_conversation_demo/images/reachymini_avatar.png +0 -3
- src/reachy_mini_conversation_demo/images/user_avatar.png +0 -3
README.md
CHANGED
|
@@ -2,14 +2,14 @@
|
|
| 2 |
|
| 3 |
Conversational demo for the Reachy Mini robot combining OpenAI's realtime APIs, vision pipelines, and choreographed motion libraries.
|
| 4 |
|
| 5 |
-

|
| 6 |
|
| 7 |
## Architecture
|
| 8 |
|
| 9 |
The demo follows a layered architecture connecting the user, AI services, and robot hardware:
|
| 10 |
|
| 11 |
<p align="center">
|
| 12 |
+
<img src="docs/assets/conversation_demo_arch.svg" alt="Architecture Diagram" width="600"/>
|
| 13 |
</p>
|
| 14 |
|
| 15 |
## Overview
|
{src/reachy_mini_conversation_demo/images → docs/assets}/conversation_demo_arch.svg
RENAMED
|
File without changes
|
{src/reachy_mini_conversation_demo/images → docs/assets}/reachy_mini_dance.gif
RENAMED
|
File without changes
|
docs/scheme.md
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
config:
|
| 3 |
+
layout: fixed
|
| 4 |
+
flowchart:
|
| 5 |
+
htmlLabels: true
|
| 6 |
+
---
|
| 7 |
+
flowchart TB
|
| 8 |
+
User["User"] <-- voice --> UI@{ label: "<b>UI Layer</b><br><span style=\"font-size:11px;color:#01579b\">Gradio / Console</span>" }
|
| 9 |
+
UI <-- audio --> OpenAI@{ label: "<b>OpenAI Realtime Speech</b><br><span style=\"font-size:11px;color:#4a148c\">Tool Calls</span>" }
|
| 10 |
+
OpenAI -- tool calls --> Tools@{ label: "<b>Tool System</b><br><span style=\"font-size:10px;color:#01579b\">Dispatcher + Handlers</span>" }
|
| 11 |
+
OpenAI -- audio deltas --> Motion@{ label: "<b>Motion Control</b><br><span style=\"font-size:11px;color:#01579b\">Audio Offsets + Tracking + Commands</span>" }
|
| 12 |
+
Tools -- commands --> Motion
|
| 13 |
+
Tools <-- vision requests --> Vision@{ label: "<b>Vision</b><br><span style=\"font-size:11px;color:#4a148c\">Local VLM / OpenAI</span>" }
|
| 14 |
+
Tools -- frame requests --> Camera["<b>Camera Worker +<br>Face Tracking</b>"]
|
| 15 |
+
Tools -- tool results --> OpenAI
|
| 16 |
+
Robot["<b>reachy_mini repo</b>"] -- frames --> Camera
|
| 17 |
+
Camera -- frames --> Vision
|
| 18 |
+
Camera -- tracking offsets --> Motion
|
| 19 |
+
Motion -- commands --> Robot
|
| 20 |
+
UI@{ shape: rect}
|
| 21 |
+
OpenAI@{ shape: rect}
|
| 22 |
+
Tools@{ shape: rect}
|
| 23 |
+
Motion@{ shape: rect}
|
| 24 |
+
Vision@{ shape: rect}
|
| 25 |
+
User:::userStyle
|
| 26 |
+
UI:::uiStyle
|
| 27 |
+
OpenAI:::aiStyle
|
| 28 |
+
Tools:::coreStyle
|
| 29 |
+
Motion:::coreStyle
|
| 30 |
+
Vision:::aiStyle
|
| 31 |
+
Camera:::coreStyle
|
| 32 |
+
Robot:::hardwareStyle
|
| 33 |
+
classDef userStyle fill:#e1f5fe,stroke:#01579b,stroke-width:3px
|
| 34 |
+
classDef uiStyle fill:#b3e5fc,stroke:#0277bd,stroke-width:2px
|
| 35 |
+
classDef aiStyle fill:#e1bee7,stroke:#7b1fa2,stroke-width:3px
|
| 36 |
+
classDef coreStyle fill:#fff9c4,stroke:#f57f17,stroke-width:2px
|
| 37 |
+
classDef hardwareStyle fill:#ef9a9a,stroke:#c62828,stroke-width:3px
|
src/reachy_mini_conversation_demo/images/reachymini_avatar.png
DELETED
Git LFS Details
|
src/reachy_mini_conversation_demo/images/user_avatar.png
DELETED
Git LFS Details
|