Repository navigation

speculative : add tree-based sampling example - #3624

Merged

ggerganov merged 18 commits into

speculative-tree

Oct 18, 2023

Merged

speculative : add tree-based sampling example#3624
ggerganov merged 18 commits into
masterfrom
speculative-tree

Commits on Oct 12, 2023
- sampling : one sequence per sampling context
  ggerganov
  committed
  5261aee
Commits on Oct 14, 2023
- speculative : add tree-based sampling support
  ggerganov
  committed
  4de5a2d
Commits on Oct 15, 2023
- speculative : reuse the n_parallel CLI param
  ggerganov
  committed
  32a67cb
- speculative : refactor sampling
  ggerganov
  committed
  4a7f43f
- examples : fix build after sampling refactoring
  ggerganov
  committed
  7e48e21
- batched : fix n_seq_id
  ggerganov
  committed
  0d96efa
- sampling : fix malloc
  ggerganov
  committed
  b5554b9
- swift : fix build
  ggerganov
  committed
  b8acb6c
- swift : try to fix build
  ggerganov
  committed
  5b34bfa
Commits on Oct 16, 2023
- prompts : add assistant.txt
  ggerganov
  committed
  0059491
- common : add llama_batch_add() and llama_batch_clear() helpers
  ggerganov
  committed
  360a333
- speculative : minor refactor
  ggerganov
  committed
  1c626e2
- minor : comments + rename
  ggerganov
  committed
  373d782
Commits on Oct 17, 2023
- speculative : fix off-by-one for n_drafted
  ggerganov
  committed
  f07cd35
- speculative : fix the n_drafted fix + p constants
  ggerganov
  committed
  e6dd81f
- Merge branch 'master' into speculative-tree
  ggerganov
  authored
  010c52e
- Merge branch 'master' into speculative-tree
  ggerganov
  authored
  bd9451c
Commits on Oct 18, 2023
- Merge branch 'master' into speculative-tree
  ggerganov
  committed
  ad2727d