Skip to content

Release 0.2.0#25

Draft
Popochounet wants to merge 111 commits into
mainfrom
dev
Draft

Release 0.2.0#25
Popochounet wants to merge 111 commits into
mainfrom
dev

Conversation

@Popochounet

@Popochounet Popochounet commented May 25, 2026

Copy link
Copy Markdown
Contributor

  • MAJOR: Complete refacto with Ray and k8s

  • Client refacto: websocket connection. Client can send Audio & Text.

  • Complete config files for HuRI, k8s, Clients, Modules

  • New modules:

  1. MIC: vad mic that detect speech
  2. STT: speech to text that transcribe speech with sliding windows
  3. TAG: transcript aggregator to aggregate transcript into one sentence when end of speech
  4. RAG: Call RAGHandle (Ollama, Qdrant, embedding, history) to get answer as stream
  5. TTS: answer to audio speech
  6. MOV: gesture generation

@Popochounet
add(event): events to serialize and deserialize
dc86b32
@Popochounet
evol(module): now use ModuleEvent
44680ff
@Popochounet
evol(modules): use of ModuleEvent
4859fd0
@Popochounet
wip(command): add CommandEvent (is not received yet)
4b90c4a
@Popochounet
evol(control_channel): dealer register with auth(wip) then start
8438ee9
@Popochounet
evol(agent): thread is now inside zmq classes
29079c1
@Popochounet
fix(core): agent and huri now exit cleanly
31c8fb1
@Popochounet
evol(events): update events naming
3ad3368
@Popochounet
wip(control_channel): huri can handle control
97f949d
@Popochounet
remove(archi): old deprecated archi files
9c2e564
@Popochounet
refacto(module): is now a basic processor with one input and output type
2ac1433
@Popochounet
feat(session+EventGraph): has an EventGraph that connects modules and…
d6eae24 
… publish events
@Popochounet
refacto(huri): huri is now a fastapi ray server, launching ray deploy…
efe6cf8 
…ment (connect via websocket)
@Popochounet
evol(launch_huri): launch deployement and bind them to main ray serve…
90b6d01 
…r (huri)
@Popochounet
wip(client): connect to huri via websocket, stream audio and receive …
3d6936c 
…huri's ou

tput
@Popochounet
evol(MIC+STT): changes for new archi
047a655
@Popochounet
add(Sender): module that sends huri output to client
78513e9
@Popochounet
remove(logger): deprecated logger
48e750b
@Popochounet
feat(linter): added linter config file + Makefile (make lint)
4bc4b6b
@Popochounet
fix(linter): make lint
d5071e1
@Popochounet
remove(config): deprecated config files + quick_launch.sh
06334b7
@Popochounet
Merge pull request #10 from Sentience-Robotics/aau/#9/refacto_ray
861d43e 
Aau/#9/refacto ray
@Popochounet
feat(config): module config and client config
aef8d0a
@Popochounet
evol(module): type ModuleWithHandle
9ff235d
@Popochounet
feat(factory): factory to build modules
e4fa54f
@Popochounet
evol(launch_huri): can now be launch via ray serve config file
727b975
@Popochounet
evol(huri): can now build client config modules and run them
5415fdd
@Popochounet
feat(client): can now send config to huri
1000fb8
@Popochounet
evol(stt): add STTHandle to STT
5c641df
@Popochounet
evol(Makefile): mypy check untyped defs
1c748f5
Popochounet and others added 30 commits May 28, 2026 08:17
@Popochounet
Merge pull request #27 from Sentience-Robotics/aau/#20/fix-doc-link
4e0904b 
fix(readme): wrong documentation link
@bernTP
fixed(tts): gesture and tts connection using pts + summarizing data f…
fe93959 
…etching on client
@bernTP
fixed(rag): init arguments not being taken in kube values + hot value…
b728cd8 
…s swap capability
@bernTP
fixed(tts): fixed bi stream capacity + debug logs support directly in…
ad7f658 
… dashboard
@bernTP
feated(stt): using kube PVC to store whisper model
080f342
@bernTP
feat(kube): ingress template to avoid port forwarding huri for the so…
5146a0e 
…cket and the dashboard
@bernTP
feat(kube): new values to support new ingress and stt cache system (+…
d17f6bf 
… avoid HF to redownload everytime models)
@bernTP
fix(tts): text to speech missing tokens in audio
69c614b
@bernTP
feat(client): option to save streamed TTS audio to .wav files
01ac7ef
@bernTP
fix(stt): missing lookup for PVC on kube init
28e279f
@bernTP
feat(gesture): warmup to generate output faster on first time
734aaf9
@bernTP
feat(tts): using CosyVoice3 model
191b6b0
@bernTP
fixed(stt): audio_in event for the pipeline, so that text is read by RAG
5bc82be
@bernTP
fix(stt): going back to previous STT impelmentation, with a simpler h…
14a06bf 
…andle and module
@bernTP
feat(rag): profile data from RAG based of uid
a1f5e6d
@bernTP
fixed(huri): Qdrant too old dependancy + new nvidia dependancies
2e74004
@bernTP
feat(huri): core config uid fetching
1164213
@bernTP
feat(huri): automatically exclude outputed .wav files
109491a
@bernTP
feat(rag): improved prompt to avoid too long sentences
f9d3a93
@bernTP
feat(sender): sending topic type to clients
a048d9a
@bernTP
fix(rag): missing previous prompt context
2e40400
@bernTP
fix(gesture): smoother transition from sliding window + small desync …
0b39013 
…in inference
@bernTP
fixed(gesture): warmup now works when cold starting
818bad8
@bernTP
feat(huri): refactorisation on modules and removing temp features
fa4bb76
@bernTP
fixed(rag): qdrant is installed on all dockerfiles
93237f7
@bernTP
fixed(rag): removing template code for debugging
c47bf7b
@MatthiasvonRakowski
add(btp): add beta test plan to the project
7da003f
@bernTP
fix(huri): refactored event datatypes and imports
6662830
@bernTP
feat(huri): local ray start config with all deployments
867d39b
@bernTP
Merge pull request #33 from Sentience-Robotics/tpm/#32/tts-gesture-rag
689a7e4 
feat(huri): kube local example with TTS + EMAGE + RAG
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Popochounet @MatthiasvonRakowski @bernTP