Skip to content

Conversation cache: --conversation-cache-park-gain N (opt-in, default 0): a turn that grew a few hundred tokens no longer rewrites a whole 3 GB snapshot - #2265

Closed
Krypto-Whitehat wants to merge 1 commit into
Niko1221:mainfrom
Krypto-Whitehat:conversation-cache-park-gain
Closed

Conversation cache: --conversation-cache-park-gain N (opt-in, default 0): a turn that grew a few hundred tokens no longer rewrites a whole 3 GB snapshot#2265
Krypto-Whitehat wants to merge 1 commit into
Niko1221:mainfrom
Krypto-Whitehat:conversation-cache-park-gain

Conversation cache: --conversation-cache-park-gain N stops a turn tha…

58ca3f2
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs