Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

Questions tagged [natural-language-processing]

For questions related to natural language processing, which concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
0
votes
4answers
744 views

Google Translate: Different translations for the same text

I don't understand why Google Translate translates the same text in different ways. Here is the Wikipedia page of the 1973 film "Enter the Dragon". You can see that its traditional Chinese title is: ...
12
votes
3answers
15k views

Sentence similarity in Python

I am working on a problem where I need to determine whether two sentences are similar or not. I implemented a solution using BM25 algorithm and wordnet synsets for determining syntactic & ...
4
votes
1answer
418 views

How could you generate sentences from lists of facts

Lets pretend we had a list of facts (similar to prolog tuples) that define some knowledge about some entities. e.g. doing(clean, data) done(collect, data) todo(train, model) todo(write, paper) What ...
1
vote
0answers
111 views

Natural language processing with a continuous dependent variable

I have a large number of observations. Each observation contains: dependent variable: a scores ranging from 0 - 100 independent variable: a large article I want to know which words or phrases ...
4
votes
2answers
2k views

Has Capsule Networks or similar systems been used for NLP?

Capsule Networks seem to be a good solution for problems, which make up hierarchical complexity ( ( (eyes, nose, ears -> face); (fingers, nails, palm -> hand) ) -> human). NLP domain is a very clear ...
2
votes
0answers
34 views

What is the “question” when using Dynamic Memory Networks to do part-of-speech tagging and sentiment analysis?

In the paper Ask Me Anything: Dynamic Memory Networks for Natural Language Processing the authors described a Dynamic Memory Network in the context of question answering. Then, they also tested the ...
0
votes
2answers
103 views

Could we code in Natural language once we pass the Turing test?

Technically speaking, could we code in natural language once we pass the Turing test? Would passing the Turing test at least simplify programming languages' syntax?
3
votes
1answer
93 views

Is it possible to verify SOP of call center conversation using AI?

As we know in call centers there are certain SOP(standard operating procedure), for example few are below, Agent greeted customer Agent verified the validity of customer before providing sensitive ...
2
votes
1answer
36 views

Has there been “prescriptive” attempts at language-learning/comprehension in AI?

Is there examples of AI systems being taught grammatical rules, or have such rules built-in to them, in order to recognize commands and the like in natural language? For example, is there a program, ...
3
votes
0answers
118 views

Training RNN's on text: Can you use an ASCII encoding just as well as a one-hot character encoding?

I've mostly seen (e.g. in http://karpathy.github.io/2015/05/21/rnn-effectiveness/) that when training RNN's on text for something like language modeling, the text is usually featurized character-by-...
0
votes
2answers
328 views

Build Conversational AI

I'm looking to build a conversational AI. The goal is to create an AI that is your friend (as opposed to personal assistants that are meant for carrying out commands like "send a text, play that song.....
8
votes
1answer
8k views

Are the dialogs at Sophia's (the robot) appearings scripted?

I talk about the robot from: Hanson Robotics, which was granted the right to citizenship from Saudi Arabia. I have found the following articles: Your new friend is a humanoid robot source: ...
1
vote
2answers
57 views

Consiousness and Language

It appears to me that the thoughts in our heads or at least mine are a result of the language they know. I do not have any thought that is not a consequence of the information that is contained within ...
1
vote
0answers
35 views

Any software to guess idea flow (basic ideas/statements and their derivations) throughout text?

Is there any existing software which analyzes idea flow in the text (or between different texts, e.g scientific articles) and for example visualizes it with some graph?
4
votes
1answer
3k views

Automatic story generator

How can l leverage Artificial Intelligence and Virtual Reality to create Intelligent Automatic Story Generation? My idea is to come up with a system that is empowering the user’s imagination to ...
-2
votes
1answer
42 views

Over-exposure of certain items in content based recommendation engine

I'm working on a content based recommendation engine for ebooks. I create document vectors with 300 features for every ebook using a word2vec model trained on google news and determine recommendations ...
6
votes
4answers
3k views

Is there any open source counterpart to the IBM Watson?

I am looking for something similar to IBM Watson but open source.
6
votes
2answers
405 views

How to determine if an Amazon review is likely to be fake using text classification

I'm currently in the research stage of building a web app in ASP.NET where the user can input a URL to an Amazon product, then the app would determine how likely its reviews are to be genuine. I need ...
6
votes
1answer
145 views

Are there any projects that can measure the concept similarity between texts?

Are there any algorithms or software libraries that can be used to detect the similarity of concepts in text, regardless of articulation, grammar, synonyms, etc.? For example, these phrases: ...
3
votes
1answer
693 views

Automatic punctuation

I am building a system that should take text without punctuation and automatically add punctuation. I found some papers about automatic punctuation, but they are mostly about spoken language ...
3
votes
1answer
105 views

What is USV In NLP?

3 SVD Based Methods For this class of methods to find word embeddings (otherwise known as word vectors), we first loop over a massive data set and accumulate word co-occurrence counts in some form of ...
1
vote
0answers
80 views

Problem with the PLN classifier

I'm developing a chatbot, and to get the answer I'm using the Naive Bayes classifier by sorting the questions and answers. For those who want to see the whole project code and more definitions follow ...
2
votes
0answers
69 views

Advanced NLG - robot journalist

I want to produce a bot in Python that automatically generates short football summaries from Whoscored data. For my first stage I generate the articles with different sentence templates and lots of ...
5
votes
3answers
280 views

Which AI branch should I follow for Natural Language Processing problem?

I'm doing some testings on NLP and I was thinking to write a code that works like this. Subject -> User input -> Output Dog ownership -> I own a dog -> Yes Dog ownership -> My dog is called Joe -> ...
3
votes
1answer
370 views

Identify “actionable” intents in email messages

I am trying to build a model which would take an email message (in English, extracted subject, and body of the email) and identify if it has a question, request or a proposal. Basically, I would like ...
2
votes
1answer
304 views

Tagging parts of speech when proper noun is a composite

By means of parts of speech tagging, words of a given sentence can be assumed to be noun/verb etc, but if the sentence is for ...
4
votes
1answer
236 views

Unsupervised alien natural language learning

While conducting research, I recently stumbled upon the deep learning and natural language processing concepts. In this question they say that the ‘grammar induction’ is a ‘supervised learning’ mode. ...
2
votes
2answers
238 views

How to generate question answer data set like babi from books

I wanted to train a chat bot for answering questions from books. I am trying to use Dynamic Memory Networks to do so. How can I generate a data set like facebook did in case of babi tasks so that it ...
7
votes
1answer
730 views

Why is perplexity a good evaluation metric for chatbots?

Some papers say that BLEU is not a appropriate evaluating method for chatbot, instead they use perplexity to estimate chatbot. First of all, what is perplexity? How to calculate it? And why is ...
6
votes
4answers
277 views

Is language understanding possible without qualia?

I feel that many words if not all of them have a direct mapping to some kind of inner subjective experience, to a physical object, mental feeling, process or some other kind of abstract thing. Given ...
3
votes
0answers
370 views

RL to generate sentences

I want to develop a system to generate grammatically correct sentences. The input would be some words. The output would be a grammatically correct human-like sentence. Eg: Input: capital, Paris, ...
2
votes
2answers
194 views

Natural Language Generation

I have a group of structures in a program that are very specific on their meaning, eg. this is a piece of code ...
10
votes
1answer
259 views

Has anyone attempted to train an AI to learn all languages?

It seems that most projects attempt to teach the AI to learn individual, specific languages. It occurs to me that there are relations in written and spoken words and phrases across languages - most ...
5
votes
1answer
145 views

Recommendations for research: Influential NLP projects of the last 5 years

I'm looking at the history of NLP (and by extension, machine learning) and starting in the 1950s with the Georgetown–IBM experiment. Are there any particular studies nor projects done with Natural ...
9
votes
2answers
400 views

Is there any modern NLP implementation similar to Winograd SHRDLU?

I have came across the Winograd SHRDLU program and I found it very interesting and aspiring. What is the consensus regarding it? Are there any similar attempts? I'm reading the book of Terry ...
13
votes
1answer
810 views

I wonder what roles the knowledge base play now and will play in the future?

Nowadays Artificial Intelligence seems almost equal to machine learning, especially deep learning. Some have said that deep learning will replace human experts, traditionally very important for ...
5
votes
1answer
501 views

How do I use a taxonomy and the Support Vector Machine for question classification in Natural Language Processing?

I am going to develop an open-domain Natural Language Question Answering (NL QA) system, and will use the Support Vector Machine (SVM) as the machine-learning (ML) algorithm for question ...
7
votes
3answers
81 views

Is there a central focus on the communication methods between AI and humans?

AI is developing at a rapid pace and is becoming very sophisticated. One aspect will include the methods of interaction between AI and humans. Currently the interaction is an elementary interaction ...
10
votes
1answer
346 views

AI that can generate programs

I have been looking into Viv an artificial intelligent agent in development. Based on what I understand, this AI can generate new code and execute it based on a query from the user. What I am curious ...
5
votes
1answer
1k views

Which parsing algorithm can I use for NLP question answering system?

I am currently working on my last project before graduating. For this project, I have to develop a Natural Language Question Answering System. Now, I have read quite some research papers regarding ...
5
votes
2answers
339 views

How can I convert an input Natural Language QA to a MDX q

I am researching Natural Language Processing (NLP) to develop a NL Question Answering system. The answering part is already done. So processing the question remains, along with the questions regarding ...
3
votes
1answer
143 views

How do English language robots work?

By English language robots I mean something like this: http://www.tolearnenglish.com/free/celebs/audreyg.php I don't know what they called exactly, but interested to know how they work and how can I ...
6
votes
2answers
291 views

Has any schema-agnostic database engine been implemented?

Has any schema-agnostic database engine been implemented?
4
votes
1answer
178 views

Could AI be used to generate questions from a database input?

I confront to the next scenario: Let's say I have stored data about football matches between different teams: lineups, scorers, yellow cards, and many other events. I need to generate everyday ...
4
votes
1answer
56 views

Lets suppose that we have an AI that can interpret requests

In this case, the request is a thing which we asked AI to do, not necessarily using commands. Nowadays, we have our personal AI in our devices: Siri by Apple, Cortana by Microsoft, and so on. For ...
2
votes
1answer
186 views

Using YodaQA with a non-Wikipedia source

Has anyone used YodaQA for natural language processing? How easy is it to link to a document database other than Wikipedia? We're thinking we can create a bot to use AI to analyze our developer and ...
3
votes
1answer
88 views

How can I generate What, why, who types of questions from “Gap-fill-in” type of questions?

I was wondering if in any way it is possible to generate W questions based on gap-fill-in type questions (e.g "______ is a process in which plants generate energy." ---> "What is the process in ...
4
votes
2answers
298 views

What kind of Algorithm is used is StackGAN to process realistic Images

How does StackGAN processes such a realistic image just from collecting details in the text? What kind of algorithm is used behind it? Anyone have any idea? Please Share.
2
votes
0answers
102 views

Conversational agent,query [closed]

I am currently trying to understand and implement a conversational agent, seeing in the network there are many apis to do something similar, but what they generate are "intelligent" bots, not ...