Home>Programming related>AI Source Code
Download
awesome NLP resources

Natural language processing projects & tool libraries & resources

A collection of natural language processing projects & tool libraries & resources, divided into sub-fields and sorted out, automatically updated every week

This resource list contains 100 python natural language processing related projects & tool libraries & resources. These resources are divided into 11 different sub-sections. These projects have currently received 180K likes on github. All tool resources will automatically collect information from GitHub and the tool maintenance platform every week, and update and sort out the display. This list is completed with reference to the best-of template. Everyone is welcome to submit PRs to enrich this list.

Table of contents

  • Text classification 9 project cases
  • Sentiment Analysis 6 Project Cases
  • Sequence labeling 5 project cases
  • 8 project cases of question answering system and chat robot
  • 11 project cases of voice applications
  • 10 project cases of knowledge graph
  • Text generation 11 project cases
  • Text summaries generate 10 project cases
  • Reading Comprehension 4 Project Cases
  • Time series 10 project cases
  • Machine translation 8 project cases
  • Text retrieval and semantic matching 9 project cases

Text classification



facebookresearch-fastText

24K·Code

facebookresearch’s fastText tool library

by @facebookresearch



text_classification(brightmart)

7.4K · Code

Various Chinese text classification models implemented by brightmart

by @brightmart



facebookresearch-pytext

6.3K · Code

pytext tool library for facebookresearch

by @facebookresearch



PaddleNLP

5.2K · Code

PaddlePaddle NLP Tool Library

by @PaddlePaddle



Paddle-ERNIE

5.1K · Code

ERNIE implemented by PaddlePaddle

by @PaddlePaddle



Chinese-Text-Classification-Pytorch

3.8K · Code

Various Chinese text classification models implemented by Pytorch

by @649453932



Bert-Chinese-Text-Classification-Pytorch

2.5K · Code

Chinese text classification model based on transformer/BERT implemented in Pytorch

by @649453932



Text_Classification

1.6K · Code

kk7nc Text_Classification

by @kk7nc



NeuralNLP-NeuralClassifier(Tencent)

1.4K · Code

Tencent text classification open source project, including multiple model implementations and complete model construction process

by @Tencent


sentiment analysis



pytorch-sentiment-analysis

3.6K · Code

Sentiment analysis modeling implemented by pytorch

by @bentrevett



Aspect-Based-Sentiment-Analysis

1.6K · Code

Implementation of sentiment analysis based on graph convolutional networks with different granularities.

by @songyouwei



baidu-Senta

1.6K · Code

Baidu’s Senta sentiment analysis project

by @baidu



BDCI2019-Sentiment-classification

440 · Code

The first place solution in BDCI2019 Sentiment Analysis Competition

by @cxy229



Customer_Satisfaction_Analysis

330 · Code

Consumer Satisfaction Analysis Modeling

by @CarryChang



chinese-customer-review

34 · Code

Chinese review website review data

by @lsvih


sequence annotation



Chinese-DeepNER

700 · Code

Deep learning named entity recognition project

by @z814081807



BERT-for-Sequence-Labeling-and-Text-Classification

410 · Code

Bert-based sequence annotation and text classification

by @yuanxiaosc



sequence_tagging

390 · Code

Sequence annotation implementation

by @qiufengyuyi



Macadam

300 · Code

Macadam is a natural language processing toolkit based on Tensorflow (Keras) and bert4keras, focusing on text classification, sequence annotation and relationship extraction.

by @yongzhuo



seq2annotation

80 · Code

Implementation scheme of sequence annotation

by @howl-anderson


Q&A systems and chatbots



DeepPavlov

5.8K · Code

Deep learning end-to-end dialogue system

by @deepmipt



haystack

5.2K · Code

End-to-end deep learning question and answer retrieval system

by @deepset-ai



baidu-AnyQ

2.4K · Code

Baidu's AnyQ high-frequency question retrieval question and answer system

by @baidu



Chatbot_CN

1.1K · Code

A chatbot based on the financial-judicial field (both in the nature of chatting)

by @charlesXu86



Chinese-Chatbot-PyTorch

670 · Code

Dialogue robot implemented based on pytorch

by @Doragd



58-qa_match

310 · Code

Implementation of 58’s matching question answering system

by @wuba



pytorch-question-answering

240 · Code

Implementation of pytorch question and answer system

by @kushalj001



gpt2-bert-reddit-bot

180 · Code

Implementation of reddit question and answer robot based on gpt2 and bert

by @lots-of-things


Voice application



ASRT_SpeechRecognition

5.7K · Code

Chinese speech recognition system based on deep learning

by @nl8590687



TensorFlowTTS

2.8K · Code

Text-to-speech project implemented by tensorflow

by @TensorSpeech



NVIDIA-waveglow

2K · Code

NVIDIA’s waveglow speech synthesis project

by @NVIDIA



TransformerTTS

920 · Code

Implementation of tts text-to-speech based on transformer

by @as-ideas



noisereduce

720 · Code

Intelligent noise reduction project

by @timsainb



Speech-Transformer

690 · Code

Speech-Transformer speech recognition project

by @kaituoxu



Multilingual_Text_to_Speech

580 · Code

Multilingual text-to-speech implementation

by @Tomiinek



inaSpeechSegmenter

520 · Code

Voice intelligent segmentation project

by @ina-foss



Speech-enhancement

390 · Code

Speech enhancement project

by @vbelz



OpenTransformer

310 · Code

Transformer-based speech recognition

by @ZhengkunTian



tacotron2

100 · Code

tacotron2 speech synthesis project

by @ide8


Knowledge graph



QASystemOnMedicalKG

4.2K · Code

Medical knowledge graph construction and question and answer reasoning

by @liuhuanyong



KnowledgeGraphData

4.1K · Code

Knowledge graph data collection

by @ownthink



awesome-knowledge-graph

3.4K · Code

awesome knowledge map information

by @husthuke



Agriculture_KnowledgeGraph

3.2K · Code

Agricultural knowledge map project

by @qq547276542



KnowledgeGraphCourse

3K·Code

Southeast University Knowledge Graph Course

by @npubird



Financial-Knowledge-Graphs

1.9K · Code

Financial knowledge graph project

by @jm199504



stock-knowledge-graph

1.6K · Code

Stock Financial Knowledge Map Project

by @lemonhu



knowledge-graphs

1.3K · Code

Knowledge graph

by @shaoxiongji



NLP-Knowledge-Graph

1.2K · Code

NLP knowledge graph information

by @lihanghang



QASystemOnMedicalGraph

860 · Code

Question and answer system based on medical knowledge graph

by @zhihao-chen


text generation



GPT2-Chinese

5.2K · Code

GPT2 Chinese generation

by @Morizeyao



texar

2.3K · Code

texar NLP tool library for text generation

by @asyml



gpt2-ml

1.4K · Code

gpt2 Chinese text generation

by @imcaspar



Texygen

840 · Code

text generation

by @geek-ai



texar-pytorch

720 · Code

pytorch implementation of texar

by @asyml



transformer-xl-chinese

610 · Code

transformer-xl Chinese text generation

by @GaoPeng97



awesome-text-generation

460 · Code

awesome text generation information

by @ChenChengKuan



aichpoem

160 · Code

poetry generation

by @wangjiezju1988



CoupletAI

140 · Code

AI couplet generation

by @WiseDoge



gpt-2-poetry

84 · Code

gpt2 poetry generation

by @kylemcdonald



QueryGeneration

83 · Code

Similar question generation based on deep learning

by @YunwenTechnology


Text summary generation



awesome-text-summarization

1.2K · Code

awesome text summary generation information

by @icoxfog417



bert-extractive-summarizer

1K·Code

Extractive text summary generation based on BERT

by @dmmiller612



GPT2-NewsTitle

690 · Code

GPT2 news headlines automatically generated

by @liucongg



Text-Summarization-Papers

460 · Code

Papers related to text summarization and abstract generation

by @neulab



seq2seq-summarizer

350 · Code

seq2seq text summary generation

by @ymfa



GPT2-Summary

290 · Code

GPT2 text summary generation

by @qingkongzhiqian



Bart_T5-summarization

150 · Code

Text summary generation based on Bart-T5

by @renatoviolin



TranSummar

130 · Code

Extractive text summary generation based on transformer

by @lipiji



nnsum

100 · Code

Text summary based on deep learning

by @kedz



Neural-Abstract-Text-Summarization

100 · Code

LeafNATS text summary generation framework

by @tshi04


reading comprehension



mt-dnn

2K · Code

Text understanding based on multi-task deep learning network

by @namisan



Adversarial-Training-for-Natural-Language-Understanding

230 · Code

Text understanding implementation based on adversarial training

by @zhuchen03



microsoft-Natural-Language-Understanding

120 · Code

Text understanding based on multi-task deep learning network (Microsoft)

by @microsoft



capsule-mrc

88 · Code

Capsule-based perspective reading comprehension model

by @freefuiiismyname


time series



sktime

5.6K · Code

scikit machine learning time series forecasting

by @alan-turing-institute



neural_prophet

2.5K · Code

Prophet time series prediction based on neural network

by @ourownstory



pytorch-forecasting

2.2K · Code

pytorch timing estimation

by @jdb78



pytorch-ts

740 · Code

Time series prediction based on pytorch

by @zalandoresearch



transformer-time-series-prediction

610 · Code

Transformer-based time series prediction

by @oliverguhr



DeepLearning-For-Time-Series-Forecasting

560 · Code

Microsoft deep learning time series prediction implementation

by @Azure



sktime-dl

560 · Code

scikit deep learning time series classification and regression

by @sktime



awesome-time-series

510 · Code

awesome time series forecast data

by @cuge1995



Deep-Time-Series-Prediction

380 · Code

Deep learning time series prediction

by @EvilPsyCHo



scikit-hts

200 · Code

scikit hierarchical time series forecasting library

by @carlomazzaferro


machine translation



tensorflow-nmt

6.1K · Code

tensorflow neural network machine translation library

by @tensorflow



OpenNMT-py

5.7K · Code

OpenNMT neural network machine translation library

by @OpenNMT



facebookresearch-UnsupervisedMT

1.5K · Code

FacebookResearch’s unsupervised machine translation library

by @facebookresearch



OpenNMT-tf

1.3K · Code

OpenNMT neural network machine translation library (tensorflow version)

by @OpenNMT



Nematus

780 · Code

nematus neural network machine translation library

by @EdinburghNLP



translators

760 · Code

Machine translation library

by @UlionTse



EasyNMT

610 · Code

EasyNMT neural network machine translation library

by @UKPLab



joeynmt

560 · Code

Neural network machine translation

by @joeynmt


Text retrieval and semantic matching



MatchZoo

3.7K · Code

MatchZoo library containing multiple text matching models

by @NTMC-Community



awesome-neural-models-for-semantic-match

750 · Code

awesome neural network semantic matching information

by @NTMC-Community



text_matching

620 · Code

Text matching model implementation

by @terrifyzhao



TextMatch

580 · Code

TextMatch text matching implementation

by @zhaogaofeng611



eBay-Sequence-Semantic-Embedding

450 · Code

eBay's sequence semantic embedding tool library

by @eBay



deepmatcher

440 · Code

Deep learning text matching library

by @anhaidgroup



alibaba-simple-effective-text-matching

330 · Code

ACL2019 paper "Simple and efficient text matching" implementation

by @alibaba-edu



alibaba-simple-effective-text-matching-pytorch

270 · Code

ACL2019 paper "Simple and efficient text matching" implementation (pytorch version)

by @alibaba-edu



Semantic-Search

100 · Code

Semantic retrieval system

by @renatoviolin

Related resources

  • Python resource collection list : A weekly updated resource collection list of various application directions and topics
  • python machine learning resource collection : a collection of various python machine learning resources updated weekly
  • Jupyter and related tool resources collection : A collection of various Jupyter and related tool resources updated weekly
  • Encyclopedia of NLP projects and resources : A collection of projects and tool resources involved in various NLP sectors updated weekly
  • Collection of CV projects and resources : a weekly updated list of projects and tool resources involved in various CV sectors
Expand
Additional Information
Related Applications
Recommended for You
Related Information All