Attention

May 10, 2024	Memory-Efficient Attention: MHA vs. MQA vs. GQA vs. MLA