attention | Modular
Python package
Graph-based attention mechanisms for neural networks.
Modules
attention_with_rope: Attention with rotary position embeddings.interfaces: Attention interface definitions.mask_config: Attention mask configuration utilities.multi_latent_attention: Multi-latent attention mechanism.multihead_attention: Multi-head attention implementation.ragged_attention: Attention for variable-length sequences.
Thank you! We'll create more content like this.
Thank you for helping us improve!
😔 What went wrong?