linmult¶
LinMulT — Linear-complexity Multimodal Transformer.
A modular Transformer library for multimodal sequence modelling. Handles variable-length inputs across any number of modalities, supports missing-modality scenarios, and offers six attention variants from O(N²) softmax to O(N·s) gated linear attention — all behind a single config key.
Public API:
from linmult import LinMulT, LinT, LinMulTConfig, LinTConfig, HeadConfig, AttentionConfig