vllm.models.muse_spark.nvidia.multimodal

MuseSpark1x Omni for NVIDIA GPUs: the shared Omni towers over the CUDA text stack.

Classes:

• MuseSparkForConditionalGeneration –

  MuseSpark1x Omni: text stack plus NaViT vision and waveform audio.

MuseSparkForConditionalGeneration

Bases: MuseSpark1xOmniMixin, MuseSpark1xForCausalLM, SupportsMultiModal

MuseSpark1x Omni: text stack plus NaViT vision and waveform audio.

Source code in vllm/models/muse_spark/nvidia/multimodal.py

@register_omni_processor
class MuseSparkForConditionalGeneration(
    MuseSpark1xOmniMixin, MuseSpark1xForCausalLM, SupportsMultiModal
):
    """MuseSpark1x Omni: text stack plus NaViT vision and waveform audio."""

    hf_to_vllm_mapper = MuseSpark1xForCausalLM.hf_to_vllm_mapper | OMNI_WEIGHTS_MAPPER