Skip to content

Feature: support Pika-Labs/Pika-H3-Flex #2489

Open

Description

@willg-nv

Request type

New model or checkpoint support

Problem and use case

Support Pika-Labs/Pika-H3-Flex in TensorRT-Model-Connect for text-and-endpoint-frame-conditioned video and audio generation through the FL2VA adapter path. Provide a reproducible native build and runtime path with checkpoint-specific validation and documented limits.

Proposed outcome

Add family-owned checkpoint/runtime integration, a reproducible build recipe, documentation, and tests.

Acceptance criteria:

  • Load the selected public checkpoint and its required processor, tokenizer, or component assets; pin the selected revisions in the recipe.
  • Support the declared inputs and runtime behavior through the native public interfaces.
  • Load the required MiniMax-H3 base components with the selected Pika FL2VA adapter. Validate conditioning, output dimensions/duration, finite video/audio outputs, and reference-relative generation behavior using declared settings.
  • Compare native outputs with an independent upstream reference and record validation results.
  • Document supported precision, inputs, runtime limits, and remaining gaps.

Model and target details

  • Model: Pika-Labs/Pika-H3-Flex.
  • Task / initial scope: Text-and-endpoint-frame-conditioned video and audio generation through the FL2VA adapter path.
  • Initial precision: to be established during bring-up.
  • Runtime target: TensorRT-Model-Connect native runtime.
  • Target GPU and memory requirements: to be established during bring-up.

Alternatives considered

Use the public upstream inference path linked from the model card as a reference. Native Model Connect integration and validation are the requested outcome; no comparative evaluation is claimed here.

Additional context

  • Public model reference: Pika-Labs/Pika-H3-Flex.
  • The public model card describes Pika H3 Flex as adapters over MiniMax-H3. The initial request covers one documented local FL2VA workflow. Other adapters and conditioning workflows should have explicit coverage and limits. Public inference reference: Pika H3 Flex.
  • This request defines bring-up work; it does not claim validated support, accuracy, or performance.

Submission checks

  • I searched open and closed issues and found no duplicate request.
  • I removed secrets, private/internal evidence, personal paths, and restricted artifacts.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions