idea: rolling context/auto-compaction , codesandbox support ??

[hanubgl]

Problem Statement

i am using this on rtx4050-6G vram, because of the limited vram, i set to 8k, as it overflows, it prompts the user to incr the context, eventually oom after a lengthy chat. when doing tasks it prompts user inbetween the task to incr

Feature Idea

1. chat auto compaction
   i see the rolling context/auto-compaction feature in unsloth/lmstudio with plugins, which wrks with a message popup whenvere it does compactions in a lengthy chat session. i set set 8k and the backend takes care of auto compaction, and it wont prompt user to incr the context when overflow happens. can something like this or better than this be implemented ?

or did i missing something which is already present in automic chat ?

2. sandbox support builtin into atomic chat

atomic chat is lightweight which i like than unsloth which heavy on downloads

thanks
hanu