Questions tagged [natural-language-processing]

For questions related to natural language processing, which is concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
3
votes
1answer
856 views

How can I implement an AI system that learns to recognise a context-free grammar?

Suppose I have context-free grammar (CFG) $L$ that pumps out words in that language. I want a machine learning system that can detect if a word $w$ came from $L$ or not. It has access to a stream from ...
7
votes
2answers
437 views

How to determine if an Amazon review is likely to be fake using text classification

I'm currently in the research stage of building a web app in ASP.NET where the user can input a URL to an Amazon product, then the app would determine how likely its reviews are to be genuine. I need ...
7
votes
1answer
150 views

Are there any projects that can measure the concept similarity between texts?

Are there any algorithms or software libraries that can be used to detect the similarity of concepts in text, regardless of articulation, grammar, synonyms, etc.? For example, these phrases: ...
3
votes
1answer
733 views

Automatic punctuation

I am building a system that should take text without punctuation and automatically add punctuation. I found some papers about automatic punctuation, but they are mostly about spoken language ...
3
votes
1answer
124 views

What is USV In NLP?

3 SVD Based Methods For this class of methods to find word embeddings (otherwise known as word vectors), we first loop over a massive data set and accumulate word co-occurrence counts in some form of ...
1
vote
0answers
80 views

Problem with the PLN classifier

I'm developing a chatbot, and to get the answer I'm using the Naive Bayes classifier by sorting the questions and answers. For those who want to see the whole project code and more definitions follow ...
2
votes
0answers
71 views

Advanced NLG - robot journalist

I want to produce a bot in Python that automatically generates short football summaries from Whoscored data. For my first stage I generate the articles with different sentence templates and lots of ...
5
votes
3answers
282 views

Which AI branch should I follow for Natural Language Processing problem?

I'm doing some testings on NLP and I was thinking to write a code that works like this. Subject -> User input -> Output Dog ownership -> I own a dog -> Yes Dog ownership -> My dog is called Joe -> ...
4
votes
1answer
420 views

Identify “actionable” intents in email messages

I am trying to build a model which would take an email message (in English, extracted subject, and body of the email) and identify if it has a question, request or a proposal. Basically, I would like ...
2
votes
1answer
327 views

Tagging parts of speech when proper noun is a composite

By means of parts of speech tagging, words of a given sentence can be assumed to be noun/verb etc, but if the sentence is for ...
5
votes
1answer
243 views

Unsupervised alien natural language learning

While conducting research, I recently stumbled upon the deep learning and natural language processing concepts. In this question they say that the ‘grammar induction’ is a ‘supervised learning’ mode. ...
2
votes
2answers
258 views

How to generate question answer data set like babi from books

I wanted to train a chat bot for answering questions from books. I am trying to use Dynamic Memory Networks to do so. How can I generate a data set like facebook did in case of babi tasks so that it ...
8
votes
1answer
767 views

Why is perplexity a good evaluation metric for chatbots?

Some papers say that BLEU is not a appropriate evaluating method for chatbot, instead they use perplexity to estimate chatbot. First of all, what is perplexity? How to calculate it? And why is ...
7
votes
4answers
289 views

Is language understanding possible without qualia?

I feel that many words if not all of them have a direct mapping to some kind of inner subjective experience, to a physical object, mental feeling, process or some other kind of abstract thing. Given ...
3
votes
0answers
376 views

RL to generate sentences

I want to develop a system to generate grammatically correct sentences. The input would be some words. The output would be a grammatically correct human-like sentence. Eg: Input: capital, Paris, ...
3
votes
2answers
200 views

Natural Language Generation

I have a group of structures in a program that are very specific on their meaning, eg. this is a piece of code ...
10
votes
1answer
259 views

Has anyone attempted to train an AI to learn all languages?

It seems that most projects attempt to teach the AI to learn individual, specific languages. It occurs to me that there are relations in written and spoken words and phrases across languages - most ...
6
votes
1answer
146 views

Recommendations for research: Influential NLP projects of the last 5 years

I'm looking at the history of NLP (and by extension, machine learning) and starting in the 1950s with the Georgetown–IBM experiment. Are there any particular studies nor projects done with Natural ...
9
votes
2answers
438 views

Is there any modern NLP implementation similar to Winograd SHRDLU?

I have came across the Winograd SHRDLU program and I found it very interesting and aspiring. What is the consensus regarding it? Are there any similar attempts? I'm reading the book of Terry ...
13
votes
1answer
891 views

I wonder what roles the knowledge base play now and will play in the future?

Nowadays Artificial Intelligence seems almost equal to machine learning, especially deep learning. Some have said that deep learning will replace human experts, traditionally very important for ...
5
votes
1answer
519 views

How do I use a taxonomy and the Support Vector Machine for question classification in Natural Language Processing?

I am going to develop an open-domain Natural Language Question Answering (NL QA) system, and will use the Support Vector Machine (SVM) as the machine-learning (ML) algorithm for question ...
7
votes
3answers
83 views

Is there a central focus on the communication methods between AI and humans?

AI is developing at a rapid pace and is becoming very sophisticated. One aspect will include the methods of interaction between AI and humans. Currently the interaction is an elementary interaction ...
10
votes
1answer
348 views

AI that can generate programs

I have been looking into Viv an artificial intelligent agent in development. Based on what I understand, this AI can generate new code and execute it based on a query from the user. What I am curious ...
5
votes
1answer
1k views

Which parsing algorithm can I use for NLP question answering system?

I am currently working on my last project before graduating. For this project, I have to develop a Natural Language Question Answering System. Now, I have read quite some research papers regarding ...
6
votes
2answers
361 views

How can I convert an input Natural Language QA to a MDX q

I am researching Natural Language Processing (NLP) to develop a NL Question Answering system. The answering part is already done. So processing the question remains, along with the questions regarding ...
3
votes
1answer
147 views

How do English language robots work?

By English language robots I mean something like this: http://www.tolearnenglish.com/free/celebs/audreyg.php I don't know what they called exactly, but interested to know how they work and how can I ...
6
votes
2answers
305 views

Has any schema-agnostic database engine been implemented?

Has any schema-agnostic database engine been implemented?
4
votes
1answer
201 views

Could AI be used to generate questions from a database input?

I confront to the next scenario: Let's say I have stored data about football matches between different teams: lineups, scorers, yellow cards, and many other events. I need to generate everyday ...
4
votes
1answer
56 views

Lets suppose that we have an AI that can interpret requests

In this case, the request is a thing which we asked AI to do, not necessarily using commands. Nowadays, we have our personal AI in our devices: Siri by Apple, Cortana by Microsoft, and so on. For ...
3
votes
1answer
196 views

Using YodaQA with a non-Wikipedia source

Has anyone used YodaQA for natural language processing? How easy is it to link to a document database other than Wikipedia? We're thinking we can create a bot to use AI to analyze our developer and ...
4
votes
1answer
90 views

How can I generate What, why, who types of questions from “Gap-fill-in” type of questions?

I was wondering if in any way it is possible to generate W questions based on gap-fill-in type questions (e.g "______ is a process in which plants generate energy." ---> "What is the process in ...
4
votes
2answers
307 views

What kind of Algorithm is used is StackGAN to process realistic Images

How does StackGAN processes such a realistic image just from collecting details in the text? What kind of algorithm is used behind it? Anyone have any idea? Please Share.
2
votes
0answers
102 views

Conversational agent,query [closed]

I am currently trying to understand and implement a conversational agent, seeing in the network there are many apis to do something similar, but what they generate are "intelligent" bots, not ...
2
votes
1answer
1k views

Making a simple ai like Jarvis

So I am looking to make an AI like jarvis. A perfect real life example of this type of system is the simple AI that Mark Zuckerberg has recently built. Here is a description on how his AI works. From ...
4
votes
1answer
115 views

Can I categorise the user input which I get as free text?

I am working on a project, wherein I take input from the user as free text and try to relate the text to what the user might mean. I have tried Stanford NLP which tokenizes the text into tokens, but I ...
0
votes
1answer
165 views

Which are the good tools, similar to ChatScript, for building chat/sms based bots? [closed]

https://github.com/bwilcox-1234/ChatScript I gave AIML a brief look, but it seems to be in a nascent stage!
10
votes
4answers
723 views

Can the English language ever be generalized using a set of grammar rules?

In programming languages, there is a set of grammar rules which govern the construction of valid statements and expressions. These rules help in parsing the programs written by the user. Can there ...
3
votes
1answer
118 views

What is the most effective way to build a classifier?

At the moment, I am working on a project which requires me to build a naive Bayes classifier. Right now, I have a form online asking for people to submit a sentence and the subject of the sentence, in ...
4
votes
2answers
128 views

Is there a service that can search for answers to general questions?

I was looking for an API service where I can ask it a general question (for example, when was Einstein born?) and retrieve an answer from the web. Is there any available service to do that? Have ...
1
vote
2answers
532 views

Is it ethical to create a chatbot to answer questions on Stack Overflow? [closed]

I was wondering if I should do this, because 2 out of 5 questions on Stack Overflow don't ever get answered, or if they do get (an) answer (s), most of the time they're not helpful. So I was thinking ...
2
votes
3answers
121 views

Building Profile Based Off Speech Patterns

Has there been research done regarding processing speech then building a "speaker profile" based off the processed speech? Things like matching the voice with a speaker profile and matching speech ...
49
votes
3answers
31k views

How can neural networks deal with varying input sizes?

As far as I can tell, neural networks have a fixed number of neurons in the input layer. If neural networks are used in a context like NLP, sentences or blocks of text of varying sizes are fed to a ...
11
votes
3answers
408 views

How would an AI learn language?

I was think about AIs and how they would work, when I realised that I couldn't think of a way that an AI could be taught language. A child tends to learn language through associations of language and ...
11
votes
2answers
366 views

Is anybody still using Conceptual Dependency Theory?

Roger Schank did some interesting work on language processing with Conceptual Dependency (CD) in the 1970s. He then moved somewhat out of the field, being in Education these days. There were some ...
9
votes
1answer
617 views

Can an AI make a constructed (natural) language?

"An artificial or constructed language (sometimes called a conlang) is a language that has been created by a person or small group, instead of being formed naturally as part of a culture." (Source: ...
11
votes
5answers
391 views

Have any AI systems yet been developed that can knowingly lie to / deceive a human?

AI systems today are very capable machines, and recently the area of Natural Language Processing and Response has been exploding with innovation, as well as the fundamental algorithmic structure of AI ...
2
votes
1answer
86 views

Using feature learning for a medical text classification problem [closed]

I'm currently working with the CHILDES corpus trying to create a classifier that distinguishes children whom suffer from specific language impairment (SLI) from those who are typically developing (TD)....
5
votes
1answer
444 views

How does Wit.ai convert sentences into structured data?

The Wit.ai is a Siri-like voice interface which can can parse messages and predict the actions to perform. Here is the demo site powered by Wit.ai. How does it understand the spoken sentences and ...
7
votes
1answer
147 views

What is predicate argument recognition?

There is a study about The Necessity of Parsing for Predicate Argument Recognition, however I couldn't find much information about 'Predicate Argument Recognition' which could explain it. What is it ...