awesome LLM resourses

全世界最好的大語言模型資源匯總持續更新

Check More Information

[在線閱讀]

Contents

• 數據Data
• 微調Fine-Tuning
• 推理Inference
• 評估Evaluation
• 體驗Usage
• 知識庫RAG
• 智能體Agents
• 搜索Search
• 書籍Book
• 課程Course
• 教程Tutorial
• 論文Paper
• Tips

數據Data

Note

此處命名為数据，但這裡並沒有提供具體數據集，而是提供了處理獲取大規模數據的方法

我們始終秉持授人以魚不如授人以漁

1. AotoLabel: Label, clean and enrich text datasets with LLMs.
2. LabelLLM: The Open-Source Data Annotation Platform.
3. data-juicer: A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs!
4. OmniParser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
5. MinerU: MinerU is a one-stop, open-source, high-quality data extraction tool, supports PDF/webpage/e-book extraction.
6. PDF-Extract-Kit: A Comprehensive Toolkit for High-Quality PDF Content Extraction.
7. Parsera: Lightweight library for scraping web-sites with LLMs.
8. Sparrow: Sparrow is an innovative open-source solution for efficient data extraction and processing from various documents and images.
9. Docling: Transform PDF to JSON or Markdown with ease and speed.
10. GOT-OCR2.0: OCR Model.
11. LLM Decontaminator: Rethinking Benchmark and Contamination for Language Models with Rephrased Samples.
12. DataTrove: DataTrove is a library to process, filter and deduplicate text data at a very large scale.
13. llm-swarm: Generate large synthetic datasets like Cosmopedia.
14. Distilabel: Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
15. Common-Crawl-Pipeline-Creator: The Common Crawl Pipeline Creator.
16. Tabled: Detect and extract tables to markdown and csv.
17. Zerox: Zero shot pdf OCR with gpt-4o-mini.
18. DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception.
19. TensorZero: make LLMs improve through experience.
20. Promptwright: Generate large synthetic data using a local LLM.
21. pdf-extract-api: Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models.
22. pdf2htmlEX: Convert PDF to HTML without losing text or format.
23. Extractous: Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

↥ back to top

微調Fine-Tuning

1. LLaMA-Factory: Unify Efficient Fine-Tuning of 100+ LLMs.
2. unsloth: 2-5X faster 80% less memory LLM finetuning.
3. TRL: Transformer Reinforcement Learning.
4. Firefly: Firefly: 大模型訓練工具，支持訓練數十種大模型
5. Xtuner: An efficient, flexible and full-featured toolkit for fine-tuning large models.
6. torchtune: A Native-PyTorch Library for LLM Fine-tuning.
7. Swift: Use PEFT or Full-parameter to finetune 200+ LLMs or 15+ MLLMs.
8. AutoTrain: A new way to automatically train, evaluate and deploy state-of-the-art Machine Learning models.
9. OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework (Support 70B+ full tuning & LoRA & Mixtral & KTO).
10. Ludwig: Low-code framework for building custom LLMs, neural networks, and other AI models.
11. mistral-finetune: A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models.
12. aikit: Fine-tune, build, and deploy open-source LLMs easily!
13. H2O-LLMStudio: H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs.
14. LitGPT: Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
15. LLMBox: A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
16. PaddleNLP: Easy-to-use and powerful NLP and LLM library.
17. workbench-llamafactory: This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
18. OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral).
19. TinyLLaVA Factory: A Framework of Small-scale Large Multimodal Models.
20. LLM-Foundry: LLM training code for Databricks foundation models.
21. lmms-finetune: A unified codebase for finetuning (full, lora) large multimodal models, supporting llava-1.5, qwen-vl, llava-interleave, llava-next-video, phi3-v etc.
22. Simplifine: Simplifine lets you invoke LLM finetuning with just one line of code using any Hugging Face dataset or model.
23. Transformer Lab: Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
24. Liger-Kernel: Efficient Triton Kernels for LLM Training.
25. ChatLearn: A flexible and efficient training framework for large-scale alignment.
26. nanotron: Minimalistic large language model 3D-parallelism training.
27. Proxy Tuning: Tuning Language Models by Proxy.
28. Effective LLM Alignment: Effective LLM Alignment Toolkit.
29. Autotrain-advanced
30. Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
31. Vision-LLM Alignemnt: This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vision models.
32. finetune-Qwen2-VL: Quick Start for Fine-tuning or continue pre-train Qwen2-VL Model.

↥ back to top

推理Inference

1. ollama: Get up and running with Llama 3, Mistral, Gemma, and other large language models.
2. Open WebUI: User-friendly WebUI for LLMs (Formerly Ollama WebUI).
3. Text Generation WebUI: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
4. Xinference: A powerful and versatile library designed to serve language, speech recognition, and multimodal models.
5. LangChain: Build context-aware reasoning applications.
6. LlamaIndex: A data framework for your LLM applications.
7. lobe-chat: an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers, Multi-Modals (Vision/TTS) and plugin system.
8. TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.
9. vllm: A high-throughput and memory-efficient inference and serving engine for LLMs.
10. LlamaChat: Chat with your favourite LLaMA models in a native macOS app.
11. NVIDIA ChatRTX: ChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, or other data.
12. LM Studio: Discover, download, and run local LLMs.
13. chat-with-mlx: Chat with your data natively on Apple Silicon using MLX Framework.
14. LLM Pricing: Quickly Find the Perfect Large Language Models (LLM) API for Your Budget! Use Our Free Tool for Instant Access to the Latest Prices from Top Providers.
15. Open Interpreter: A natural language interface for computers.
16. Chat-ollama: An open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.
17. chat-ui: Open source codebase powering the HuggingChat app.
18. MemGPT: Create LLM agents with long-term memory and custom tools.
19. koboldcpp: A simple one-file way to run various GGML and GGUF models with KoboldAI's UI.
20. LLMFarm: llama and other large language models on iOS and MacOS offline using GGML library.
21. enchanted: Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
22. Flowise: Drag & drop UI to build your customized LLM flow.
23. Jan: Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM).
24. LMDeploy: LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
25. RouteLLM: A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
26. MInference: About To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
27. Mem0: The memory layer for Personalized AI.
28. SGLang: SGLang is yet another fast serving framework for large language models and vision language models.
29. AirLLM: AirLLM optimizes inference memory usage, allowing 70B large language models to run inference on a single 4GB GPU card without quantization, distillation and pruning. And you can run 405B Llama3.1 on 8GB vram now.
30. LLMHub: LLMHub is a lightweight management platform designed to streamline the operation and interaction with various language models (LLMs).
31. YuanChat
32. LiteLLM: Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, Groq etc.]
33. GuideLLM: GuideLLM is a powerful tool for evaluating and optimizing the deployment of large language models (LLMs).
34. LLM-Engines: A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).
35. OARC: ollama_agent_roll_cage (OARC) is a local python agent fusing ollama llm's with Coqui-TTS speech models, Keras classifiers, Llava vision, Whisper recognition, and more to create a unified chatbot agent for local, custom automation.
36. g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains.
37. MemoryScope: MemoryScope provides LLM chatbots with powerful and flexible long-term memory capabilities, offering a framework for building such abilities.
38. OpenLLM: Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
39. Infinity: The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense embedding, sparse embedding, tensor and full-text.
40. optillm: an OpenAI API compatible optimizing inference proxy which implements several state-of-the-art techniques that can improve the accuracy and performance of LLMs.
41. LLaMA Box: LLM inference server implementation based on llama.cpp.

↥ back to top

評估Evaluation

1. lm-evaluation-harness: A framework for few-shot evaluation of language models.
2. opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
3. llm-comparator: LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed.
4. EvalScope
5. Weave: A lightweight toolkit for tracking and evaluating LLM applications.
6. MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures.
7. Evaluation guidebook: If you've ever wondered how to make sure an LLM performs well on your specific task, this guide is for you!
8. Ollama Benchmark: LLM Benchmark for Throughput via Ollama (Local LLMs).
9. VLMEvalKit: Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks.

LLM API 服务平台：

1. Groq
2. 矽基流動
3. 火山引擎
4. 文心千帆
5. DashScope

↥ back to top

體驗Usage

1. LMSYS Chatbot Arena: Benchmarking LLMs in the Wild
2. CompassArena 司南大模型競技場
3. 瑯琊榜
4. Huggingface Spaces
5. WiseModel Spaces
6. Poe
7. 林哥的大模型野榜
8. OpenRouter
9. AnyChat

↥ back to top

知識庫RAG

1. AnythingLLM: The all-in-one AI app for any LLM with full RAG and AI Agent capabilites.
2. MaxKB: 基於LLM 大語言模型的知識庫問答系統。開箱即用，支持快速嵌入到第三方業務系統
3. RAGFlow: An open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
4. Dify: An open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
5. FastGPT: A knowledge-based platform built on the LLM, offers out-of-the-box data processing and model invocation capabilities, allows for workflow orchestration through Flow visualization.
6. Langchain-Chatchat: 基於Langchain 與ChatGLM 等不同大語言模型的本地知識庫問答
7. QAnything: Question and Answer based on Anything.
8. Quivr: A personal productivity assistant (RAG) ⚡️? Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Local & Private alternative to OpenAI GPTs & ChatGPT powered by retrieval-augmented generation.
9. RAG-GPT: RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.
10. Verba: Retrieval Augmented Generation (RAG) chatbot powered by Weaviate.
11. FlashRAG: A Python Toolkit for Efficient RAG Research.
12. GraphRAG: A modular graph-based Retrieval-Augmented Generation (RAG) system.
13. LightRAG: LightRAG helps developers with both building and optimizing Retriever-Agent-Generator pipelines.
14. GraphRAG-Ollama-UI: GraphRAG using Ollama with Gradio UI and Extra Features.
15. nano-GraphRAG: A simple, easy-to-hack GraphRAG implementation.
16. RAG Techniques: This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.
17. ragas: Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines.
18. kotaemon: An open-source clean & customizable RAG UI for chatting with your documents. Built with both end users and developers in mind.
19. RAGapp: The easiest way to use Agentic RAG in any enterprise.
20. TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text.
21. LightRAG: Simple and Fast Retrieval-Augmented Generation.
22. TEN: the Next-Gen AI-Agent Framework, the world's first truly real-time multimodal AI agent framework.
23. AutoRAG: RAG AutoML tool for automatically finding an optimal RAG pipeline for your data.
24. KAG: KAG is a knowledge-enhanced generation framework based on OpenSPG engine, which is used to build knowledge-enhanced rigorous decision-making and information retrieval knowledge services.
25. Fast-GraphRAG: RAG that intelligently adapts to your use case, data, and queries.
26. Tiny-GraphRAG
27. DB-GPT GraphRAG: DB-GPT GraphRAG integrates both triplet-based knowledge graphs and document structure graphs while leveraging community and document retrieval mechanisms to enhance RAG capabilities, achieving comparable performance while consuming only 50% of the tokens required by Microsoft's GraphRAG. Refer to the DB-GPT Graph RAG User Manual for details.
28. Chonkie: The no-nonsense RAG chunking library that's lightweight, lightning-fast, and ready to CHONK your texts.

↥ back to top

智能體Agents

1. AutoGen: AutoGen is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks. AutoGen AIStudio
2. CrewAI: Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
3. Coze
4. AgentGPT: Assemble, configure, and deploy autonomous AI Agents in your browser.
5. XAgent: An Autonomous LLM Agent for Complex Task Solving.
6. MobileAgent: The Powerful Mobile Device Operation Assistant Family.
7. Lagent: A lightweight framework for building LLM-based agents.
8. Qwen-Agent: Agent framework and applications built upon Qwen2, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.
9. LinkAI: 一站式AI 智能體搭建平台
10. Baidu APPBuilder
11. agentUniverse: agentUniverse is a LLM multi-agent framework that allows developers to easily build multi-agent applications. Furthermore, through the community, they can exchange and share practices of patterns across different domains.
12. LazyLLM: 低代碼構建多Agent大模型應用的開發工具
13. AgentScope: Start building LLM-empowered multi-agent applications in an easier way.
14. MoA: Mixture of Agents (MoA) is a novel approach that leverages the collective strengths of multiple LLMs to enhance performance, achieving state-of-the-art results.
15. Agently: AI Agent Application Development Framework.
16. OmAgent: A multimodal agent framework for solving complex tasks.
17. Tribe: No code tool to rapidly build and coordinate multi-agent teams.
18. CAMEL: First LLM multi-agent framework and an open-source community dedicated to finding the scaling law of agents.
19. PraisonAI: PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LLM systems, focusing on simplicity, customisation, and efficient human-agent collaboration.
20. IoA: An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through internet-like connectivity.
21. llama-agentic-system : Agentic components of the Llama Stack APIs.
22. Agent Zero: Agent Zero is not a predefined agentic framework. It is designed to be dynamic, organically growing, and learning as you use it.
23. Agents: An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents.
24. AgentScope: Start building LLM-empowered multi-agent applications in an easier way.
25. FastAgency: The fastest way to bring multi-agent workflows to production.
26. Swarm: Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.
27. Agent-S: an open agentic framework that uses computers like a human.

↥ back to top

搜索Search

1. OpenSearch GPT: SearchGPT / Perplexity clone, but personalised for you.
2. MindSearch: An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT).
3. nanoPerplexityAI: The simplest open-source implementation of perplexity.ai.
4. curiosity: Try to build a Perplexity-like user experience.

↥ back to top

書籍Book

1. 《大規模語言模型：從理論到實踐》
2. 《大語言模型》
3. 《動手學大模型Dive into LLMs》
4. 《動手做AI Agent》
5. 《Build a Large Language Model (From Scratch)》
6. 《多模態大模型》
7. 《Generative AI Handbook: A Roadmap for Learning Resources》
8. 《Understanding Deep Learning》
9. 《Illustrated book to learn about Transformers & LLMs》
10. 《Building LLMs for Production: Enhancing LLM Abilities and Reliability with Prompting, Fine-Tuning, and RAG》
11. 《大型語言模型實戰指南：應用實踐與場景落地》
12. 《Hands-On Large Language Models》
13. 《自然語言處理：大模型理論與實踐》
14. 《動手學強化學習》
15. 《面向開發者的LLM入門教程》
16. 《大模型基礎》

↥ back to top

課程Course

LLM Resources Hub

1. 斯坦福CS224N: Natural Language Processing with Deep Learning
2. 吳恩達: Generative AI for Everyone
3. 吳恩達: LLM series of courses
4. ACL 2023 Tutorial: Retrieval-based Language Models and Applications
5. llm-course: Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
6. 微軟: Generative AI for Beginners
7. 微軟: State of GPT
8. HuggingFace NLP Course
9. 清華NLP 劉知遠團隊大模型公開課
10. 斯坦福CS25: Transformers United V4
11. 斯坦福CS324: Large Language Models
12. 普林斯頓COS 597G (Fall 2022): Understanding Large Language Models
13. 約翰霍普金斯CS 601.471/671 NLP: Self-supervised Models
14. 李宏毅GenAI課程
15. openai-cookbook: Examples and guides for using the OpenAI API.
16. Hands on llms: Learn about LLM, LLMOps, and vector DBS for free by designing, training, and deploying a real-time financial advisor LLM system.
17. 滑鐵盧大學CS 886: Recent Advances on Foundation Models
18. Mistral: Getting Started with Mistral
19. 斯坦福CS25: Transformers United V4
20. Coursera: Chatgpt 應用提示工程
21. LangGPT: Empowering everyone to become a prompt expert!
22. mistralai-cookbook
23. Introduction to Generative AI 2024 Spring
24. build nanoGPT: Video+code lecture on building nanoGPT from scratch.
25. LLM101n: Let's build a Storyteller.
26. Knowledge Graphs for RAG
27. LLMs From Scratch (Datawhale Version)
28. OpenRAG
29. 通往AGI之路
30. Andrej Karpathy - Neural Networks: Zero to Hero
31. Interactive visualization of Transformer
32. andysingal/llm-course
33. LM-class
34. Google Advanced: Generative AI for Developers Learning Path
35. Anthropics：Prompt Engineering Interactive Tutorial
36. LLMsBook
37. Large Language Model Agents
38. Cohere LLM University
39. LLMs and Transformers
40. Smol Vision: Recipes for shrinking, optimizing, customizing cutting edge vision models.
41. Multimodal RAG: Chat with Videos
42. LLMs Interview Note
43. RAG++ : From POC to production: Advanced RAG course.
44. Weights & Biases AI Academy: Finetuning, building with LLMs, Structured outputs and more LLM courses.
45. Prompt Engineering & AI tutorials & Resources
46. Learn RAG From Scratch – Python AI Tutorial from a LangChain Engineer
47. LLM Evaluation: A Complete Course

↥ back to top

教程Tutorial

1. 動手學大模型應用開發
2. AI開發者頻道
3. B站：五里墩茶社
4. B站：木羽Cheney
5. YTB：AI Anytime
6. B站：漆妮妮
7. Prompt Engineering Guide
8. YTB: AI超元域
9. B站：TechBeat人工智能社區
10. B站：黃益賀
11. B站：深度學習自然語言處理
12. LLM Visualization
13. 知乎: 原石人類
14. B站：小黑黑講AI
15. B站：面壁的車輛工程師
16. B站：AI老兵文哲
17. Large Language Models (LLMs) with Colab notebooks
18. YTB：IBM Technology
19. YTB: Unify Reading Paper Group
20. Chip Huyen
21. How Much VRAM
22. Blog: 科學空間（蘇劍林）
23. YTB: Hyung Won Chung
24. Blog: Tejaswi kashyap
25. Blog: 小昇的博客
26. 知乎: ybq
27. W&B articles
28. Huggingface Blog
29. Blog: GbyAI
30. Blog: mlabonne
31. LLM-Action
32. Blog: Lil'Log (OponAI)

↥ back to top

論文Paper

Note

?Huggingface Daily Papers、Cool Papers、ML Papers Explained

1. Hermes-3-Technical-Report
2. The Llama 3 Herd of Models
3. Qwen Technical Report
4. Qwen2 Technical Report
5. Qwen2-vl Technical Report
6. DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
7. DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
8. Baichuan 2: Open Large-scale Language Models
9. DataComp-LM: In search of the next generation of training sets for language models
10. OLMo: Accelerating the Science of Language Models
11. MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Series
12. Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model
13. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
14. Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
15. Jamba: A Hybrid Transformer-Mamba Language Model
16. Textbooks Are All You Need
17. Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models data
18. OLMoE: Open Mixture-of-Experts Language Models
19. Model Merging Paper
20. Baichuan-Omni Technical Report
21. 1.5-Pints Technical Report: Pretraining in Days, Not Months – Your Language Model Thrives on Quality Data
22. Baichuan Alignment Technical Report
23. Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent
24. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
25. TÜLU 3: Pushing Frontiers in Open Language Model Post-Training

↥ back to top

Tips

1. What We Learned from a Year of Building with LLMs (Part I)
2. What We Learned from a Year of Building with LLMs (Part II)
3. What We Learned from a Year of Building with LLMs (Part III): Strategy
4. 輕鬆入門大語言模型（LLM）
5. LLMs for Text Classification: A Guide to Supervised Learning
6. Unsupervised Text Classification: Categorize Natural Language With LLMs
7. Text Classification With LLMs: A Roundup of the Best Methods
8. LLM Pricing
9. Uncensor any LLM with abliteration
10. Tiny LLM Universe
11. Zero-Chatgpt
12. Zero-Qwen-VL
13. finetune-Qwen2-VL
14. MPP-LLaVA
15. build_MiniLLM_from_scratch
16. Tiny LLM zh
17. MiniMind: 3小時完全從0訓練一個僅有26M的小參數GPT，最低僅需2G顯卡即可推理訓練.
18. LLM-Travel: 致力於深入理解、探討以及實現與大模型相關的各種技術、原理和應用
19. Knowledge distillation: Teaching LLM's with synthetic data
20. Part 1: Methods for adapting large language models
21. Part 2: To fine-tune or not to fine-tune
22. Part 3: How to fine-tune: Focus on effective datasets
23. Reader-LM: Small Language Models for Cleaning and Converting HTML to Markdown
24. LLMs應用構建一年之心得
25. LLM訓練-pretrain
26. pytorch-llama: LLaMA 2 implemented from scratch in PyTorch.
27. Preference Optimization for Vision Language Models with TRL 【support model】
28. Fine-tuning visual language models using SFTTrainer 【docs】
29. A Visual Guide to Mixture of Experts (MoE)
30. Role-Playing in Large Language Models like ChatGPT
31. Distributed Training Guide: Best practices & guides on how to write distributed pytorch training code.
32. Chat Templates
33. Top 20+ RAG Interview Questions

↥ back to top

如果你覺得本項目對你有幫助，歡迎引用：

 @misc { wang2024llm ,
      title = { awesome-LLM-resourses } , 
      author = { Rongsheng Wang } ,
      year = { 2024 } ,
      publisher = { GitHub } ,
      journal = { GitHub repository } ,
      howpublished = { url{https://github.com/WangRongsheng/awesome-LLM-resourses} } ,
}