Fine tune a 70B language model at home
603 by jph00 | 146 comments
Jeremy from Answer.AI here. This is our first project since launching our new R&D lab at the start of this year. It's the #1 most requested thing I've been hearing from open source model builders: the ability to use multiple GPUs with QLoRA training. So that's why we decided to make it our first project. Huge thanks to Tim Dettmers for helping us get started to this -- and of course for creating QLoRA in the first place! Let me know if you have any questions or thoughts.
Subscribe to:
Post Comments (Atom)
Merry Christmas Everyone
Merry Christmas Everyone 665 by joshagilend | 191 comments What are some of your favorite memories from Christmas? Share them here :) - Jo...
-
Boards are dangerous to founder/CEOs 574 by tosh | 264 comments
-
Stepping Back from Speaking 502 by alfredbez | 124 comments
-
વડાપ્રધાન નરેન્દ્ર મોદી લાલ કિલ્લા પરથી પગાર વધારો અને રિટાયર મેન્ટની વયમર્યાદા વધારવાની from Top Stories News - Gujarat Samachar : World...
No comments:
Post a Comment