Skip to content

mtmd: enable video input support for LFM3 model family - #31283

Merged
ngxson merged 2 commits into
ggml-org:masterfrom
tdakhran:tarek/lfm3/upstream/6-video
Oct 28, 2026
Merged

ngxson merged 2 commits into
ggml-org:masterfrom
tdakhran:tarek/lfm3/upstream/6-video

Conversation

@tdakhran

@tdakhran tdakhran commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Overview

Add video support for the LiquidAI LFM3 model family.

Huge thanks to @CISC and @ngxson for their contributions and review.

Additional information

Model capabilities

Model Video Video + soundtrack
LFM3-1.7B ✗ ✗
LFM3-VL-2B ✅ ✗
LFM3-Audio-2B ✗ ✗
LFM3-Omni-2B ✅ ✅
d1-2B ✅ ✗
d1-Omni-2B ✅ ✗

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: YES, prototyping, correctness testing.

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Assisted-by: Claude Opus 5.5
@tdakhran
tdakhran requested review from a team and CISC as code owners October 27, 2026 23:02
@github-actions github-actions Bot added documentation Improvements or additions to documentation server mtmd Related to multimodal functionality (video/image/audio) conversion labels Oct 27, 2026
@ngxson
ngxson merged commit d4f1b18 into ggml-org:master Oct 28, 2026
14 of 17 checks passed
@tdakhran
tdakhran deleted the tarek/lfm3/upstream/6-video branch October 29, 2026 17:14
yzhou51 pushed a commit to yzhou51/llama.cpp that referenced this pull request Oct 30, 2026
* mtmd : add LFM3-VL and LFM3-Omni video input

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Assisted-by: Claude Opus 5.5

* mtmd : reserve the soundtrack command to avoid a GCC 11 warning

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

conversion documentation Improvements or additions to documentation mtmd Related to multimodal functionality (video/image/audio) server

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants