optimizing-attention-flash
from Orchestra-Research/AI-research-SKILLs
Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 tokens), encountering GPU memory iss
v1.0.0MIT
368
Lines
1,287
Words
25
Code Blocks
Languages
bashpython
10-optimization/flash-attention/SKILL.md