Thursday 4 January 2024

Understand how transformers work by demystifying the math behind them

Understand how transformers work by demystifying the math behind them
438 by LaserPineapple | 111 comments


No comments:

Post a Comment

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy 379 by weinzierl | 72 comments