Skip to content

vllm.models.step5.nvidia

Modules:

  • flashinfer_sparse –

    Step5 sparse selection and attention using FlashInfer and PyTorch.

  • layernorm –

    Step5 normalization layers.

  • mega_moe –

    Step5 NVFP4/FP8/BF16 DeepGEMM MegaMoE with shared symmetric storage.

  • model –

    Inference-only Step5 model.

  • mtp –
  • ops –
  • sparse_attention –

    Hopper and B300 sparse attention using FlashInfer and Triton.

  • vl –

    Inference-only Step5 vision-language model.