Unsloth is a user-friendly framework that offers fast inference and fine-tuning for large language models. It also supports saving models in multiple formats, including vLLM and GGUF.
https://www.kdnuggets.com/fine-tuning-llama-using-unsloth
Unsloth is a user-friendly framework that offers fast inference and fine-tuning for large language models. It also supports saving models in multiple formats, including vLLM and GGUF.
https://www.kdnuggets.com/fine-tuning-llama-using-unsloth