feat(memory): add Hindsight conversation memory#16
Open
hotwa wants to merge 7 commits into
Open
Conversation
Add reproducible Pixi environments for macOS ARM and Linux x86, document the setup across README variants, and add remote GPU docker-compose deployment files for FlashHead on host GPU 1.\n\nAdd a POST /sessions/{id}/close compatibility route and switch the frontend close call to it so remote deployments can avoid networks that block HTTP DELETE.\n\nVerification:\n- pixi run go-test\n- npm run --prefix frontend build\n- remote health + session create/close over http://122.205.95.186:8080
Configure Pixi Go tasks with GOPROXY and GOSUMDB so linux-x86 environments can download Go modules on the remote Ubuntu host.\n\nVerification:\n- pixi install -e macos-arm\n- remote pixi install -e linux-x86\n- remote pixi run -e linux-x86 python-agent-test\n- remote pixi run -e linux-x86 go-test\n- pixi run -e macos-arm go-test
Connect Hindsight retain and recall into PersonaAgent and the standard digital-human pipeline. Add local shadow fallback, text-input TTS/avatar rendering, deploy configuration, frontend task i18n, and focused Go/Python tests.
… features # Conflicts: # frontend/src/pages/LaunchConfigPage.vue # frontend/src/pages/SessionPage.vue # inference/plugins/voice_llm/persona_agent.py # server/internal/orchestrator/orchestrator.go # tests/unit/test_persona_agent_plugin.py
Implement Hindsight retain/recall wiring for PersonaAgent and the standard Go conversation path with dynamic user/character scoped bank IDs, tags, document IDs, metadata, and nonblocking retain behavior. Update examples, deployment docs, and focused tests for the Hindsight payloads and PersonaAgent recall injection flow. Remote smoke against http://w4ce.jmsu.top:8888 confirms CyberVerse writes documents into the expected bank, but durable recall remains blocked because the Hindsight backend currently completes extraction with zero memory units.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
中文说明
概要
本 PR 为 CyberVerse 增加 Hindsight 长期记忆接入,覆盖 PersonaAgent 数字人对话路径和 Go standard conversation path。
主要变化:
cv:user:{user_id}:character:{character_id}response_instructions注入长期记忆上下文.env.example、GPU 部署配置和开发计划文档当前验证状态
CyberVerse 侧接入和写入链路已验证通过:
但端到端“长期记忆可 recall”尚未完全成功。
远程 Hindsight 服务
http://w4ce.jmsu.top:8888当前 retain/reprocess operation 能完成,但生成结果为:memory_unit_count=0total_nodes=0usage.total_tokens=0这说明 CyberVerse 的写入 payload 已进入 Hindsight,但 Hindsight 后端抽取/LLM worker 目前没有生成 memory units。该问题需要在 Hindsight 服务侧继续排查。
测试
已执行:
结果:
26 passedgit diff --check: passedEnglish
Summary
This PR adds Hindsight long-term conversation memory support to CyberVerse, covering both the PersonaAgent digital-human path and the Go standard conversation path.
Main changes:
cv:user:{user_id}:character:{character_id}response_instructions.env.example, GPU deployment config, and the development planCurrent Verification Status
The CyberVerse integration and write path have been verified:
However, full end-to-end durable recall is not yet successful.
Against the remote Hindsight service at
http://w4ce.jmsu.top:8888, retain/reprocess operations complete, but extraction currently produces:memory_unit_count=0total_nodes=0usage.total_tokens=0This indicates the CyberVerse payload is reaching Hindsight correctly, but the Hindsight backend extraction/LLM worker is not generating memory units yet. That needs follow-up on the Hindsight service side.
Tests
Executed:
Results:
26 passedgit diff --check: passed