Skip to content

fix(inference,webapp): bound inference requests and stop abandoned generations - #237

Merged
hijohnnylin merged 4 commits into
mainfrom
fix/inference-timeouts-and-failover
Sep 11, 2026
Merged

fix(inference,webapp): bound inference requests and stop abandoned generations#237
hijohnnylin merged 4 commits into
mainfrom
fix/inference-timeouts-and-failover

fix(webapp): hold steer's pass-1 headers deadline off until the pods …

24022f3
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar