Training Large Language Models: From Pre-training to Fine-tuning and Beyond – SFT, PEFT, and RLHF12 December 2024·11 mins
Understanding BEST-RQ: A Simple Self-Supervised Pre-training Approach for Speech Recognition6 April 2024·8 mins