2
$\begingroup$

I don't know anything about neural networks, but I got the information that making a chatbot with a neural network is very good. Is this really true?

What do I need to know in order to build a chat bot using neural networks?

I have understood a little about text preprocessing (such as tokenization, stemming, stop word lists, named entity recognition), but when I want to try classification using the neural network I am confused.

$\endgroup$
9
  • $\begingroup$ There is too much to learn to write in an answer. Instead I suggest you take a course on neural networks that includes some language processing. This one springs to mind (although it doesn't do chatbots): coursera.org/learn/nlp-sequence-models and also sentdex builds a chatbot in Python in this series of tutorials: youtube.com/… However, you will probably want to start with something more basic otherwise you may not understand what it is you are making $\endgroup$ – Neil Slater Mar 16 '19 at 10:21
  • $\begingroup$ I believe neural networks are not a good approach to creating chatbots; conversational structure is far to complex to be learned by a NN. The best results at present (production standard) are not using NNs. It is much better to use a rule-based approach and pattern matching. I suggest to have a look at the ELIZA system, which provides a good starting point, despite being very old. $\endgroup$ – Oliver Mason Mar 16 '19 at 14:15
  • $\begingroup$ @OliverMason: My understanding is that modern chatbots in production environments for business use are using NN language models for POS tagging, or for predicting intent from user input, but not for modelling the conversation. Whilst chatbots have been built using seq2seq NN models, these are more for research and entertainment. OP doesn't say whether they want an entertaining chatbot or something practical to help run some process (like a support channel) $\endgroup$ – Neil Slater Mar 16 '19 at 17:59
  • $\begingroup$ @NeilSlater heyy can you give input on what should I learn? just the point like i must learn sequence-models or something $\endgroup$ – Faris Dewantoro Mar 17 '19 at 4:31
  • $\begingroup$ @NeilSlater is NN always a hidden layer for classification ? and what is sequence models $\endgroup$ – Faris Dewantoro Mar 17 '19 at 4:32