Finetuning Suite
1.0.0
Finetune any model with unparalled performance, speed, and reliability using Qlora, BNB, Lora, Peft in less than 30 seconds, just press GO.
Book a 1-on-1 Session with Kye, the Creator, to discuss any issues, provide feedback, or explore how we can improve Zeta for you.
$ pip3 install ft-suite
from fts import FineTuner# Initialize the fine tunermodel_id="google/flan-t5-xxl"dataset_name = "samsung"tuner = FineTuner( model_id=model_id, dataset_name=dataset_name, max_length=150, lora_r=16, lora_alpha=32, quantize=True)# Generate contentprompt_text = "Summarize this idea for me."print(tuner(prompt_text))
from fts import Inferencemodel = Inference( model_id="georgesung/llama2_7b_chat_uncensored", quantized=True)model.run("What is your name")from fts import GPTQInferencemodel_id = "facebook/opt-125m"model = GPTQInference(model_id=model_id, max_length=400)prompt = "in a land far far away"result = model.run(prompt)print(result)
World-Class Quantization: Get the most out of your models with top-tier performance and preserved accuracy! ?️♂️
Automated PEFT: Simplify your workflow! Let our toolkit handle the optimizations.
LoRA Configuration: Dive into the potential of flexible LoRA configurations, a game-changer for performance! ?
Seamless Integration: Designed to work seamlessly with popular models like LLAMA, Falcon, and more! ?
Here's a sneak peek into our ambitious roadmap! We're always evolving, and your feedback and contributions can shape our journey!
More Example Scripts:
Using GPT models
Transfer learning examples
Real-world application samples
Polymorphic Preprocessing Function:
Design a function to handle diverse datasets
Integrate with known dataset structures from popular sources
Custom dataset blueprint for user-defined structures
Extended Model Support:
Integration with Lama, Falcon, etc.
Support for non-English models
Comprehensive Documentation:
Detailed usage guide
Best practices for fine-tuning
Benchmarks for quantization and LoRA features
Interactive Web Interface:
GUI for easy fine-tuning
Visualization tools for model insights
Advanced Features:
Integration with other quantization techniques
Support for more task types beyond text generation
Model debugging and introspection tools
Integrate TRLX from Carper
... And so much more coming up!
We're excited about the journey ahead and would love to have you with us! For feedback, suggestions, or contributions, feel free to open an issue or a pull request. Let's shape the future of fine-tuning together! ?
MIT
Spread the message of the Finetuning-Suite, this is an foundational tool to help everyone quantize and finetune state of the art models.
Sharing the project helps us reach more people who could benefit from it, and it motivates us to continue developing and improving the suite.
Click the buttons below to share Finetuning-Suite on your favorite social media platforms:
Share on Twitter
Share on Facebook
Share on LinkedIn
Share on Reddit
Also, we'd love to see how you're using Finetuning-Suite! Share your projects and experiences with us by tagging us on Twitter @finetuning-suite.
Lastly, don't forget to ️ the repository if you find it useful. Your support means a lot to us! Thank you! ?
