Repository navigation

Xsn/server sleep - #62

Open

ngxson wants to merge 14 commits into

xsn/server_sleep

Open

Xsn/server sleep#62
ngxson wants to merge 14 commits into
masterfrom
xsn/server_sleep

Commits on Dec 20, 2025
- implement sleeping at queue level
  ngxson
  committed
  e1d7b43
- implement server-context suspend
  ngxson
  committed
  197e578
- add test
  ngxson
  committed
  db3b78d
- add docs
  ngxson
  committed
  aea8f8c
- optimization: add fast path
  ngxson
  committed
  44a5a26
- make sure to free llama_init
  ngxson
  committed
  e6ab62c
- nits
  ngxson
  committed
  937b064
- fix use-after-free
  ngxson
  committed
  105e2f3
- allow /models to be accessed during sleeping, fix use-after-free
  ngxson
  committed
  fd09f88
- don't allow accessing /models during sleep, it is not thread-safe
  ngxson
  committed
  0bb9bc4
- fix data race on accessing props and model_meta
  ngxson
  committed
  d850082
- small clean up
  ngxson
  committed
  1663d2f
- trailing whitespace
  ngxson
  committed
  b51da9a
- rm outdated comments
  ngxson
  committed
  06a5ebe