vllm.models.muse_spark.amd.multimodal

MuseSpark1x Omni for AMD ROCm GPUs: the shared Omni towers over the ROCm stack.

Classes:

• MuseSparkForConditionalGeneration –

  MuseSpark1x Omni: ROCm text stack plus NaViT vision and waveform audio.

MuseSparkForConditionalGeneration

Bases: MuseSpark1xOmniMixin, MuseSpark1xForCausalLM, SupportsMultiModal

MuseSpark1x Omni: ROCm text stack plus NaViT vision and waveform audio.

Source code in vllm/models/muse_spark/amd/multimodal.py

@register_omni_processor
class MuseSparkForConditionalGeneration(
    MuseSpark1xOmniMixin, MuseSpark1xForCausalLM, SupportsMultiModal
):
    """MuseSpark1x Omni: ROCm text stack plus NaViT vision and waveform audio."""

    hf_to_vllm_mapper = MuseSpark1xForCausalLM.hf_to_vllm_mapper | OMNI_WEIGHTS_MAPPER