This project has no flash-attn dependency, no custom triton kernel. Everything is implemented with FlexAttention. The code is commented, the structure is flat. Read the accompanying write-up: vLLM ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback