chatbot aiml webqa

Intelligent dialogue model

Overview

1. AIML artificial intelligence markup language
2. WebQA open domain question and answer
3. Deeplearning deep learning
4. Effect display

Start service

Environmental Statement

Linux/Python2.7/PyCharm

Install dependencies

 $ pip2 install jieba
$ pip2 install aiml
$ pip2 install lxml
$ pip2 install beautifulsoup4
$ pip2 install flask

Run process

Working directory: chatbot-aiml-webqa/core

 $ cd chatbot-aiml-webqa/core
$ python2 web/server.py (or $ nohub python2 web/server.py)

> ......
> * Running on http://0.0.0.0:5000/ (Press CTRL+C to quit)

CURL:
$ curl "0.0.0.0:5000/chat" -d "message=新闻"
$ curl "0.0.0.0:5000/chat" -d "message=天气"
$ curl "0.0.0.0:5000/chat" -d "message=时间"

Processing flow

Step 1: Preprocessing

1. Limit word count
2. Filter sensitive words (disgusting, political, pornographic, illegal...)

Step 2: Knowledge Base Matching (AIML)

1. Basic functions: say hello, chat...
2. Exception handling: question too long, blank question, reply not found...
3. Emotional answers: expressions, praise, ridicule...

If no answer is found, proceed to step three.

Step Three: Internet Search (WebQA)

1. News----Sina News
2. Article----One article per day
3. Jokes----Encyclopedia of Embarrassing Things
4. Time----Sogou time
5. Weather----Sogou Weather
6. Air----Sogou Air
7. Other traversal Baidu search

• Baidu Chinese
• Baidu Translate
• Baidu map
• Baidu exchange rate
• Baidu Computing
• Baidu stock
• Baidu lyrics
• Baidu latest
• Baidu Encyclopedia
• Baidu knows

If no answer can be found, proceed to step 4.

Step 4: Neural Network

The next-generation dialogue engine based on the Seq2Seq model not only trains the best answer among existing answers, but can self-create a human-like answer.
Corpus: http://61.93.89.94/Noah_NRM_Data/
There is currently no time to implement this part... Let’s use the Turing Robot API instead for the time being~~~

Learning function

Using AIML template + shelve storage

1. *wrong*
2. *wrong answer*
3. ...

 ME > 世界上最漂亮的人是谁
AI > 灰姑娘
ME > 你说错了
AI > 那你教我吧
ME > 白雪公主
AI > 我学会啦，下次你就可以问我"世界上最漂亮的人是谁"......
ME > 世界上最漂亮的人是谁
AI > 白雪公主

Reference link

1. https://github.com/SnakeHacker/QA-Snake
2. https://github.com/ictar/XIXI
3. https://github.com/fwwdn/sensitive-stop-words