Home>Programming related>Other source code
Download

The world's best large language model resources are constantly updated

Check More Information

[Read online]

Contents

  • Data
  • Fine-Tuning
  • Inference
  • Evaluation
  • Experience Usage
  • Knowledge Base RAG
  • Agents
  • Search
  • Books
  • Course
  • Tutorial
  • Paper
  • Tips

Data

Note

Here is named数据, but there is no specific data set provided here, but a method for processing large-scale data acquisition is provided

We always believe that it is better to teach people how to fish than to teach people how to fish

  1. AotoLabel: Label, clean and enrich text datasets with LLMs.
  2. LabelLLM: The Open-Source Data Annotation Platform.
  3. data-juicer: A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs!
  4. OmniParser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
  5. MinerU: MinerU is a one-stop, open-source, high-quality data extraction tool, supports PDF/webpage/e-book extraction.
  6. PDF-Extract-Kit: A Comprehensive Toolkit for High-Quality PDF Content Extraction.
  7. Parsera: Lightweight library for scraping web-sites with LLMs.
  8. Sparrow: Sparrow is an innovative open-source solution for efficient data extraction and processing from various documents and images.
  9. Docling: Transform PDF to JSON or Markdown with ease and speed.
  10. GOT-OCR2.0: OCR Model.
  11. LLM Decontaminator: Rethinking Benchmark and Contamination for Language Models with Rephrased Samples.
  12. DataTrove: DataTrove is a library to process, filter and deduplicate text data at a very large scale.
  13. llm-swarm: Generate large synthetic datasets like Cosmopedia.
  14. Distilabel: Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
  15. Common-Crawl-Pipeline-Creator: The Common Crawl Pipeline Creator.
  16. Tabled: Detect and extract tables to markdown and csv.
  17. Zerox: Zero shot pdf OCR with gpt-4o-mini.
  18. DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception.
  19. TensorZero: make LLMs improve through experience.
  20. Promptwright: Generate large synthetic data using a local LLM.
  21. pdf-extract-api: Document (PDF) extraction and parse API using state of the art modern OCRs + Ollama supported models.
  22. pdf2htmlEX: Convert PDF to HTML without losing text or format.
  23. Extractous: Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
↥ back to top

Fine-Tuning

  1. LLaMA-Factory: Unify Efficient Fine-Tuning of 100+ LLMs.
  2. unsloth: 2-5X faster 80% less memory LLM finenetning.
  3. TRL: Transformer Reinforcement Learning.
  4. Firefly: Firefly: A big model training tool that supports training dozens of big models
  5. Xtuner: An efficient, flexible and full-featured toolkit for fine-tuning large models.
  6. torchtune: A Native-PyTorch Library for LLM Fine-tuning.
  7. Swift: Use PEFT or Full-parameter to finetune 200+ LLMs or 15+ MLLMs.
  8. AutoTrain: A new way to automatically train, evaluate and deploy state-of-the-art Machine Learning models.
  9. OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework (Support 70B+ full tuning & LoRA & Mixtral & KTO).
  10. Ludwig: Low-code framework for building custom LLMs, neural networks, and other AI models.
  11. mistral-finetune: A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models.
  12. aikit: Fine-tune, build, and deploy open-source LLMs easily!
  13. H2O-LLMStudio: H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs.
  14. LitGPT: Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
  15. LLMBox: A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
  16. PaddleNLP: Easy-to-use and powerful NLP and LLM library.
  17. workbench-llamafactory: This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  18. OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral).
  19. TinyLLaVA Factory: A Framework of Small-scale Large Multimodal Models.
  20. LLM-Foundry: LLM training code for Databricks foundation models.
  21. lmms-finetune: A unified codebase for finetuning (full, lora) large multimodal models, supporting llava-1.5, qwen-vl, llava-interleave, llava-next-video, phi3-v etc.
  22. Simplifine: Simplifine lets you invoke LLM finenetuning with just one line of code using any Hugging Face dataset or model.
  23. Transformer Lab: Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
  24. Liger-Kernel: Efficient Triton Kernels for LLM Training.
  25. ChatLearn: A flexible and efficient training framework for large-scale alignment.
  26. nanotron: Minimalistic large language model 3D-parallelism training.
  27. Proxy Tuning: Tuning Language Models by Proxy.
  28. Effective LLM Alignment: Effective LLM Alignment Toolkit.
  29. Autotrain-advanced
  30. Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
  31. Vision-LLM Alignemnt: This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vision models.
  32. finetune-Qwen2-VL: Quick Start for Fine-tuning or continue pre-train Qwen2-VL Model.
↥ back to top

Inference

  1. ollama: Get up and running with Llama 3, Mistral, Gemma, and other large language models.
  2. Open WebUI: User-friendly WebUI for LLMs (Formerly Ollama WebUI).
  3. Text Generation WebUI: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
  4. Xinference: A powerful and versatile library designed to serve language, speech recognition, and multimodal models.
  5. LangChain: Build context-aware reasoning applications.
  6. LlamaIndex: A data framework for your LLM applications.
  7. lobe-chat: an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers, Multi-Modals (Vision/TTS) and plugin system.
  8. TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.
  9. vllm: A high-throughput and memory-efficient inference and serving engine for LLMs.
  10. LlamaChat: Chat with your favourite LLaMA models in a native macOS app.
  11. NVIDIA ChatRTX: ChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, or other data.
  12. LM Studio: Discover, download, and run local LLMs.
  13. chat-with-mlx: Chat with your data natively on Apple Silicon using MLX Framework.
  14. LLM Pricing: Quickly Find the Perfect Large Language Models (LLM) API for Your Budget! Use Our Free Tool for Instant Access to the Latest Prices from Top Providers.
  15. Open Interpreter: An natural language interface for computers.
  16. Chat-ollama: An open source chatbot based on LLMs. It supports a wide range of language models, and knowledge base management.
  17. chat-ui: Open source codebase powering the HuggingChat app.
  18. MemGPT: Create LLM agents with long-term memory and custom tools.
  19. koboldcpp: A simple one-file way to run various GGML and GGUF models with KoboldAI's UI.
  20. LLMFarm: llama and other large language models on iOS and MacOS offline using GGML library.
  21. enchanted: Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
  22. Flowise: Drag & drop UI to build your customized LLM flow.
  23. Jan: Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM).
  24. LMDeploy: LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  25. RouteLLM: A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
  26. MInference: About To speed up Long-context LLMs' inference, appropriate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
  27. Mem0: The memory layer for Personalized AI.
  28. SGLang: SGLang is yet another fast serving framework for large language models and vision language models.
  29. AirLLM: AirLLM optimizes inference memory usage, allowing 70B large language models to run inference on a single 4GB GPU card without quantization, distillation and pruning. And you can run 405B Llama3.1 on 8GB vram now.
  30. LLMHub: LLMHub is a lightweight management platform designed to streamline the operation and interaction with various language models (LLMs).
  31. YuanChat
  32. LiteLLM: Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, Groq etc.]
  33. GuideLLM: GuideLLM is a powerful tool for evaluating and optimizing the deployment of large language models (LLMs).
  34. LLM-Engines: A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).
  35. OARC: ollama_agent_roll_cage (OARC) is a local python agent fusing ollama llm's with Coqui-TTS speech models, Keras classes, Llava vision, Whisper recognition, and more to create a unified chatbot agent for local, custom automation.
  36. g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains.
  37. MemoryScope: MemoryScope provides LLM chatbots with powerful and flexible long-term memory capabilities, offering a framework for building such abilities.
  38. OpenLLM: Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
  39. Infinity: The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense embedding, sparse embedding, tensor and full-text.
  40. optillm: an OpenAI API compatible optimized inference proxy which implements several state-of-the-art techniques that can improve the accuracy and performance of LLMs.
  41. LLaMA Box: LLM inference server implementation based on llama.cpp.
↥ back to top

Evaluation

  1. lm-evaluation-harness: A framework for few-shot evaluation of language models.
  2. opencompass: OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2, GPT-4,LLaMa2, Qwen, GLM, Claude, etc) over 100+ datasets.
  3. llm-comparator: LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed.
  4. EvalScope
  5. Weave: A lightweight toolkit for tracking and evaluating LLM applications.
  6. MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures.
  7. Evaluation guidebook: If you've ever wondered how to make sure an LLM performs well on your specific task, this guide is for you!
  8. Ollama Benchmark: LLM Benchmark for Throughput via Ollama (Local LLMs).
  9. VLMEvalKit: Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks.

LLM API 服务平台:

  1. Groq
  2. Silicon-based flow
  3. Volcanic Engine
  4. Wen Xin Qianfan
  5. DashScope
↥ back to top

Experience Usage

  1. LMSYS Chatbot Arena: Benchmarking LLMs in the Wild
  2. CompassArena Sinan Mockup Arena
  3. Langya Bang
  4. Huggingface Spaces
  5. WiseModel Spaces
  6. Poe
  7. Brother Lin’s big model wild list
  8. OpenRouter
  9. AnyChat
↥ back to top

Knowledge Base RAG

  1. AnythingLLM: The all-in-one AI app for any LLM with full RAG and AI Agent capabilities.
  2. MaxKB: A knowledge base question and answer system based on LLM large language model. Out of the box, support quick embedding into third-party business systems
  3. RAGFlow: An open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
  4. Dify: An open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
  5. FastGPT: A knowledge-based platform built on the LLM, offers out-of-the-box data processing and model invocation capabilities, allows for workflow orchestration through Flow visualization.
  6. Langchain-Chatchat: A local knowledge base question and answer based on different large language models such as Langchain and ChatGLM
  7. QAnything: Question and Answer based on anything.
  8. Quivr: A personal productivity assistant (RAG) ⚡️? Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Local & Private alternative to OpenAI GPTs & ChatGPT powered by retrieval-augmented generation.
  9. RAG-GPT: RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.
  10. Verba: Retrieval Augmented Generation (RAG) chatbot powered by Weaviate.
  11. FlashRAG: A Python Toolkit for Efficient RAG Research.
  12. GraphRAG: A modular graph-based Retrieval-Augmented Generation (RAG) system.
  13. LightRAG: LightRAG helps developers with both building and optimizing Retriever-Agent-Generator pipelines.
  14. GraphRAG-Ollama-UI: GraphRAG using Ollama with Gradio UI and Extra Features.
  15. nano-GraphRAG: A simple, easy-to-hack GraphRAG implementation.
  16. RAG Techniques: This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.
  17. ragas: Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines.
  18. kotaemon: An open-source clean & customized RAG UI for chatting with your documents. Built with both end users and developers in mind.
  19. RAGapp: The easiest way to use Agentic RAG in any enterprise.
  20. TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text.
  21. LightRAG: Simple and Fast Retrieval-Augmented Generation.
  22. TEN: the Next-Gen AI-Agent Framework, the world's first truly real-time multimodal AI agent framework.
  23. AutoRAG: RAG AutoML tool for automatically finding an optical RAG pipeline for your data.
  24. KAG: KAG is a knowledge-enhanced generation framework based on OpenSPG engine, which is used to build knowledge-enhanced rigorous decision-making and information retrieval knowledge services.
  25. Fast-GraphRAG: RAG that intelligently adapts to your use case, data, and queries.
  26. Tiny-GraphRAG
  27. DB-GPT GraphRAG: DB-GPT GraphRAG integrates both triplet-based knowledge graphs and document structure graphs while leveraging community and document retrieval mechanisms to enhance RAG capabilities, achieving comparable performance while consuming only 50% of the tokens required by Microsoft's GraphRAG. Refer to the DB-GPT Graph RAG User Manual for details.
  28. Chonkie: The no-nonsense RAG chunking library that's lightweight, lightning-fast, and ready to CHONK your texts.
↥ back to top

Agents

  1. AutoGen: AutoGen is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks. AutoGen AIStudio
  2. CrewAI: Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
  3. Coze
  4. AgentGPT: Assemble, configure, and deploy autonomous AI Agents in your browser.
  5. XAgent: An Autonomous LLM Agent for Complex Task Solving.
  6. MobileAgent: The Powerful Mobile Device Operation Assistant Family.
  7. Lagent: A lightweight framework for building LLM-based agents.
  8. Qwen-Agent: Agent framework and applications built upon Qwen2, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.
  9. LinkAI: One-stop AI intelligent building platform
  10. Baidu APPBuilder
  11. agentUniverse: agentUniverse is a LLM multi-agent framework that allows developers to easily build multi-agent applications. Further, through the community, they can exchange and share practices of patterns across different domains.
  12. LazyLLM: Development tool for building multi-agent large-scale applications with low code
  13. AgentScope: Start building LLM-empowered multi-agent applications in an easier way.
  14. MoA: Mixture of Agents (MoA) is a novel approach that leverages the collective strengths of multiple LLMs to enhance performance, achieving state-of-the-art results.
  15. Agently: AI Agent Application Development Framework.
  16. OmAgent: A multimodal agent framework for solving complex tasks.
  17. Tribe: No code tool to rapidly build and coordinate multi-agent teams.
  18. CAMEL: First LLM multi-agent framework and an open-source community dedicated to finding the scaling law of agents.
  19. PraisonAI: PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LLM systems, focusing on simplicity, customisation, and efficient human-agent collaboration.
  20. IoA: An open-source framework for collaborative AI agents, enabling diversity, distributed agents to team up and tackle complex tasks through internet-like connectivity.
  21. llama-agentic-system : Agentic components of the Llama Stack APIs.
  22. Agent Zero: Agent Zero is not a predefined agent framework. It is designed to be dynamic, organically growing, and learning as you use it.
  23. Agents: An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents.
  24. AgentScope: Start building LLM-empowered multi-agent applications in an easier way.
  25. FastAgency: The fastest way to bring multi-agent workflows to production.
  26. Swarm: Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.
  27. Agent-S: an open agent framework that uses computers like a human.
↥ back to top

Search

  1. OpenSearch GPT: SearchGPT / Perplexity clone, but personalised for you.
  2. MindSearch: An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT).
  3. nanoPerplexityAI: The simplest open-source implementation of perplexity.ai.
  4. curiosity: Try to build a Perplexity-like user experience.
↥ back to top

Books

  1. Large-scale Language Model: From Theory to Practice
  2. "Big Language Model"
  3. "Hand-On Mockup Dive into LLMs"
  4. "Hand-On AI Agent"
  5. Build a Large Language Model (From Scratch)
  6. "Multimodal Mockup"
  7. Generative AI Handbook: A Roadmap for Learning Resources
  8. Understanding Deep Learning
  9. "Illustrated book to learn about Transformers & LLMs"
  10. Building LLMs for Production: Enhancing LLM Ability and Reliability with Prompting, Fine-Tuning, and RAG
  11. "Practical Guide to Large Language Models: Application Practice and Scenario Implementation"
  12. "Hands-On Large Language Models"
  13. Natural Language Processing: Big Model Theory and Practice
  14. "Hand-On Learning Reinforcement Learning"
  15. "Introduction to LLM for Developers"
  16. "Basic Model"
↥ back to top

Course

LLM Resources Hub

  1. Stanford CS224N: Natural Language Processing with Deep Learning
  2. Ng: Generative AI for Everyone
  3. Ng: LLM series of courses
  4. ACL 2023 Tutorial: Retrieval-based Language Models and Applications
  5. llm-course: Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
  6. Microsoft: Generative AI for Beginners
  7. Microsoft: State of GPT
  8. HuggingFace NLP Course
  9. Tsinghua NLP Liu Zhiyuan team big model open class
  10. Stanford CS25: Transformers United V4
  11. Stanford CS324: Large Language Models
  12. Princeton COS 597G (Fall 2022): Understanding Large Language Models
  13. Johns Hopkins CS 601.471/671 NLP: Self-supervised Models
  14. Li Hongyi GenAI Course
  15. openai-cookbook: Examples and guidelines for using the OpenAI API.
  16. Hands on llms: Learn about LLM, LLMOps, and vector DBS for free by designing, training, and deploying a real-time financial advisor LLM system.
  17. University of Waterloo CS 886: Recent Advanceds on Foundation Models
  18. Mistral: Getting Started with Mistral
  19. Stanford CS25: Transformers United V4
  20. Coursera: Chatgpt Application Prompt Project
  21. LangGPT: Empowering everyone to become a prompt expert!
  22. mistralai-cookbook
  23. Introduction to Generative AI 2024 Spring
  24. build nanoGPT: Video+code lesson on building nanoGPT from scratch.
  25. LLM101n: Let's build a Storyteller.
  26. Knowledge Graphs for RAG
  27. LLMs From Scratch (Datawhale Version)
  28. OpenRAG
  29. The road to AGI
  30. Andrej Karpathy - Neural Networks: Zero to Hero
  31. Interactive visualization of Transformer
  32. andysingal/llm-course
  33. LM-class
  34. Google Advanced: Generative AI for Developers Learning Path
  35. Anthropics: Prompt Engineering Interactive Tutorial
  36. LLMsBook
  37. Large Language Model Agents
  38. Cohere LLM University
  39. LLMs and Transformers
  40. Smol Vision: Recipes for shrinking, optimizing, customizing cutting edge vision models.
  41. Multimodal RAG: Chat with Videos
  42. LLMs Interview Note
  43. RAG++ : From POC to production: Advanced RAG course.
  44. Weights & Biases AI Academy: Finetuning, building with LLMs, Structured outputs and more LLM courses.
  45. Prompt Engineering & AI tutorials & Resources
  46. Learn RAG From Scratch – Python AI Tutorial from a LangChain Engineer
  47. LLM Evaluation: A Complete Course
↥ back to top

Tutorial

  1. Learn big model application development
  2. AI Developer Channel
  3. B station: Wulidun Tea House
  4. B station: Cheney Muyu
  5. YTB: AI Anytime
  6. B station: Qi Nini
  7. Prompt Engineering Guide
  8. YTB: AI Super Metamorphosis
  9. B station: TechBeat artificial intelligence community
  10. B station: Huang Yihe
  11. B station: Deep learning natural language processing
  12. LLM Visualization
  13. Zhihu: Raw stone human
  14. B station: Xiao Heihei talks about AI
  15. Station B: Vehicle Engineer Facing the Wall
  16. B station: AI veteran Wenzhe
  17. Large Language Models (LLMs) with Colab notebooks
  18. YTB: IBM Technology
  19. YTB: Unify Reading Paper Group
  20. Chip Huyen
  21. How Much VRAM
  22. Blog: Science Space (Su Jianlin)
  23. YTB: Hyung Won Chung
  24. Blog: Tejaswi kashyap
  25. Blog: Xiaosheng's blog
  26. Zhihu: ybq
  27. W&B articles
  28. Huggingface Blog
  29. Blog: GbyAI
  30. Blog: mlabonne
  31. LLM-Action
  32. Blog: Lil'Log (OponAI)
↥ back to top

Paper

Note

?Huggingface Daily Papers, Cool Papers, ML Papers Explained

  1. Hermes-3-Technical-Report
  2. The Llama 3 Herd of Models
  3. Qwen Technical Report
  4. Qwen2 Technical Report
  5. Qwen2-vl Technical Report
  6. DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
  7. DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
  8. Baichuan 2: Open Large-scale Language Models
  9. DataComp-LM: In search of the next generation of training sets for language models
  10. OLMo: Accelerating the Science of Language Models
  11. MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Series
  12. Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model
  13. Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
  14. Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
  15. Jamba: A Hybrid Transformer-Mamba Language Model
  16. Textbooks Are All You Need
  17. Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models data
  18. OLMoE: Open Mixture-of-Experts Language Models
  19. Model Merging Paper
  20. Baichuan-Omni Technical Report
  21. 1.5-Pints ​​Technical Report: Pretraining in Days, Not Months – Your Language Model Thrives on Quality Data
  22. Baichuan Alignment Technical Report
  23. Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent
  24. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
  25. TÜLU 3: Pushing Frontiers in Open Language Model Post-Training
↥ back to top

Tips

  1. What We Learned from a Year of Building with LLMs (Part I)
  2. What We Learned from a Year of Building with LLMs (Part II)
  3. What We Learned from a Year of Building with LLMs (Part III): Strategy
  4. Easy to get started with the big language model (LLM)
  5. LLMs for Text Classification: A Guide to Supervised Learning
  6. Unsupervised Text Classification: Categorize Natural Language With LLMs
  7. Text Classification With LLMs: A Roundup of the Best Methods
  8. LLM Pricing
  9. Uncensor any LLM with abstraction
  10. Tiny LLM Universe
  11. Zero-Chatgpt
  12. Zero-Qwen-VL
  13. finetune-Qwen2-VL
  14. MPP-LLaVA
  15. build_MiniLLM_from_scratch
  16. Tiny LLM
  17. MiniMind: 3 hours of training a small parameter GPT with only 26M, and at least 2G graphics card is required to infer the inference training.
  18. LLM-Travel: Dedicated to in-depth understanding, discussion and implementation of various technologies, principles and applications related to large models
  19. Knowledge distillation: Teaching LLM's with synthetic data
  20. Part 1: Methods for adapting large language models
  21. Part 2: To fine-tune or not to fine-tune
  22. Part 3: How to fine-tune: Focus on effective datasets
  23. Reader-LM: Small Language Models for Cleaning and Converting HTML to Markdown
  24. LLMs application construction experience for one year
  25. LLM training-pretrain
  26. pytorch-llama: LLaMA 2 implemented from scratch in PyTorch.
  27. Preference Optimization for Vision Language Models with TRL 【support model】
  28. Fine-tuning visual language models using SFTTrainer 【docs】
  29. A Visual Guide to Mixture of Experts (MoE)
  30. Role-Playing in Large Language Models like ChatGPT
  31. Distributed Training Guide: Best practices & guides on how to write distributed pytorch training code.
  32. Chat Templates
  33. Top 20+ RAG Interview Questions
↥ back to top

If you find this project helpful to you, please quote: 

 @misc { wang2024llm ,
      title = { awesome-LLM-resourses } , 
      author = { Rongsheng Wang } ,
      year = { 2024 } ,
      publisher = { GitHub } ,
      journal = { GitHub repository } ,
      howpublished = { url{https://github.com/WangRongsheng/awesome-LLM-resourses} } ,
}
Expand
Additional Information
Related Applications
Recommended for You
Related Information All