Repository navigation

Implement classifier-free guidance - #2135

Merged

ggerganov merged 10 commits into

ggml-org:masterfrom

Jul 11, 2023

Merged

Implement classifier-free guidance#2135
ggerganov merged 10 commits into
ggml-org:masterfrom
bullno1:cfg

Commits on Jul 8, 2023
- Initial implementation
  bullno1
  committed
  d09d5ed
- Remove debug print
  bullno1
  committed
  4786300
- Restore signature of llama_init_from_gpt_params
  bullno1
  committed
  8ba5b13
- Free guidance context
  bullno1
  committed
  8f91b52
- Make freeing of guidance_ctx conditional
  bullno1
  committed
  114d4c5
- Make Classifier-Free Guidance a sampling function
  bullno1
  committed
  422a7ff
- Correct typo. CFG already means context-free grammar.
  bullno1
  committed
  66eb048
- Record sampling time in llama_sample_classifier_free_guidance
  bullno1
  committed
  8e66e59
- Shift all values by the max value before applying logsoftmax
  bullno1
  committed
  325fc88
Commits on Jul 10, 2023
- Fix styling based on review
  bullno1
  committed
  abf164d