Tuesday 6 February 2024

Beyond self-attention: How a small language model predicts the next token

Beyond self-attention: How a small language model predicts the next token
463 by tplrbv | 85 comments


-
Labels:

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy 379 by weinzierl | 72 comments