Alina Lozovskaya commited on
Commit
77b4d45
·
1 Parent(s): a871e10

Update architecture scheme and create docs folder

Browse files
README.md CHANGED
@@ -2,14 +2,14 @@
2
 
3
  Conversational demo for the Reachy Mini robot combining OpenAI's realtime APIs, vision pipelines, and choreographed motion libraries.
4
 
5
- ![Reachy Mini Dance](src/reachy_mini_conversation_demo/images/reachy_mini_dance.gif)
6
 
7
  ## Architecture
8
 
9
  The demo follows a layered architecture connecting the user, AI services, and robot hardware:
10
 
11
  <p align="center">
12
- <img src="src/reachy_mini_conversation_demo/images/conversation_demo_arch.svg" alt="Architecture Diagram" width="600"/>
13
  </p>
14
 
15
  ## Overview
 
2
 
3
  Conversational demo for the Reachy Mini robot combining OpenAI's realtime APIs, vision pipelines, and choreographed motion libraries.
4
 
5
+ ![Reachy Mini Dance](docs/assets/reachy_mini_dance.gif)
6
 
7
  ## Architecture
8
 
9
  The demo follows a layered architecture connecting the user, AI services, and robot hardware:
10
 
11
  <p align="center">
12
+ <img src="docs/assets/conversation_demo_arch.svg" alt="Architecture Diagram" width="600"/>
13
  </p>
14
 
15
  ## Overview
{src/reachy_mini_conversation_demo/images → docs/assets}/conversation_demo_arch.svg RENAMED
File without changes
{src/reachy_mini_conversation_demo/images → docs/assets}/reachy_mini_dance.gif RENAMED
File without changes
docs/scheme.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ config:
3
+ layout: fixed
4
+ flowchart:
5
+ htmlLabels: true
6
+ ---
7
+ flowchart TB
8
+ User["User"] <-- voice --> UI@{ label: "<b>UI Layer</b><br><span style=\"font-size:11px;color:#01579b\">Gradio / Console</span>" }
9
+ UI <-- audio --> OpenAI@{ label: "<b>OpenAI Realtime Speech</b><br><span style=\"font-size:11px;color:#4a148c\">Tool Calls</span>" }
10
+ OpenAI -- tool calls --> Tools@{ label: "<b>Tool System</b><br><span style=\"font-size:10px;color:#01579b\">Dispatcher + Handlers</span>" }
11
+ OpenAI -- audio deltas --> Motion@{ label: "<b>Motion Control</b><br><span style=\"font-size:11px;color:#01579b\">Audio Offsets + Tracking + Commands</span>" }
12
+ Tools -- commands --> Motion
13
+ Tools <-- vision requests --> Vision@{ label: "<b>Vision</b><br><span style=\"font-size:11px;color:#4a148c\">Local VLM / OpenAI</span>" }
14
+ Tools -- frame requests --> Camera["<b>Camera Worker +<br>Face Tracking</b>"]
15
+ Tools -- tool results --> OpenAI
16
+ Robot["<b>reachy_mini repo</b>"] -- frames --> Camera
17
+ Camera -- frames --> Vision
18
+ Camera -- tracking offsets --> Motion
19
+ Motion -- commands --> Robot
20
+ UI@{ shape: rect}
21
+ OpenAI@{ shape: rect}
22
+ Tools@{ shape: rect}
23
+ Motion@{ shape: rect}
24
+ Vision@{ shape: rect}
25
+ User:::userStyle
26
+ UI:::uiStyle
27
+ OpenAI:::aiStyle
28
+ Tools:::coreStyle
29
+ Motion:::coreStyle
30
+ Vision:::aiStyle
31
+ Camera:::coreStyle
32
+ Robot:::hardwareStyle
33
+ classDef userStyle fill:#e1f5fe,stroke:#01579b,stroke-width:3px
34
+ classDef uiStyle fill:#b3e5fc,stroke:#0277bd,stroke-width:2px
35
+ classDef aiStyle fill:#e1bee7,stroke:#7b1fa2,stroke-width:3px
36
+ classDef coreStyle fill:#fff9c4,stroke:#f57f17,stroke-width:2px
37
+ classDef hardwareStyle fill:#ef9a9a,stroke:#c62828,stroke-width:3px
src/reachy_mini_conversation_demo/images/reachymini_avatar.png DELETED

Git LFS Details

  • SHA256: 5a63ac8802ff3542f01292c431c5278296880d74cd3580d219fcf4827bc235f9
  • Pointer size: 132 Bytes
  • Size of remote file: 1.23 MB
src/reachy_mini_conversation_demo/images/user_avatar.png DELETED

Git LFS Details

  • SHA256: e97ca125a86bacdaa41c8dca88abd9ca746fd5c9391eda24249c012432b0219b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.11 MB