Repository navigation

axum_mistral_candle

Public

forked from danielclough/fireside-chat

About

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!!

3 stars

1 watching

Report repository

Name		Name	Last commit message	Last commit date
backend		backend
frontend		frontend
.gitignore		.gitignore
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md

Repository files navigation

Axum Mistral Candle

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!

Makefile

If you are using Debian/Ubuntu you should be able to get up and running with a single make init.

View make help to see all commands.

Running Server

Axum

Websocket is on localhost:3000

Leptos

Frontend is on localhost:8080

About

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!!

3 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages