Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

Questions tagged [natural-language-processing]

For questions related to natural language processing, which concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
41
votes
3answers
27k views

How can neural networks deal with varying input sizes?

As far as I can tell, neural networks have a fixed number of neurons in the input layer. If neural networks are used in a context like NLP, sentences or blocks of text of varying sizes are fed to a ...
27
votes
9answers
6k views

What is the actual quality of machine translations?

Till today I - as an AI layman - am confused by the promised and achieved improvements of automated translation. My impression is: there is still a very, very far way to go. Or are there other ...
23
votes
4answers
1k views

Are Siri and Cortana AI programs?

Siri and Cortana communicate pretty much like humans. Unlike Google now which mainly gives us search results when asked some questions (not setting alarms or reminders), Siri and Cortana provide us ...
17
votes
2answers
276 views

What research has been done in the domain of “Identifying sarcasm in text”?

Identifying sarcasm is considered as one of the most difficult open-ended problems in the domain of ML and NLP. So, was there any considerable research done in that front? If yes, then what is the ...
13
votes
1answer
810 views

I wonder what roles the knowledge base play now and will play in the future?

Nowadays Artificial Intelligence seems almost equal to machine learning, especially deep learning. Some have said that deep learning will replace human experts, traditionally very important for ...
12
votes
3answers
15k views

Sentence similarity in Python

I am working on a problem where I need to determine whether two sentences are similar or not. I implemented a solution using BM25 algorithm and wordnet synsets for determining syntactic & ...
11
votes
3answers
401 views

How would an AI learn language?

I was think about AIs and how they would work, when I realised that I couldn't think of a way that an AI could be taught language. A child tends to learn language through associations of language and ...
11
votes
5answers
383 views

Have any AI systems yet been developed that can knowingly lie to / deceive a human?

AI systems today are very capable machines, and recently the area of Natural Language Processing and Response has been exploding with innovation, as well as the fundamental algorithmic structure of AI ...
11
votes
3answers
889 views

What topologies are largely unexplored in machine learning?

Geometry and AI Matrices, cubes, layers, stacks, and hierarchies are what we could accurately call topologies. Consider topology in this context the higher level geometrical design of a learning ...
10
votes
1answer
259 views

Has anyone attempted to train an AI to learn all languages?

It seems that most projects attempt to teach the AI to learn individual, specific languages. It occurs to me that there are relations in written and spoken words and phrases across languages - most ...
10
votes
1answer
346 views

AI that can generate programs

I have been looking into Viv an artificial intelligent agent in development. Based on what I understand, this AI can generate new code and execute it based on a query from the user. What I am curious ...
10
votes
2answers
321 views

Is anybody still using Conceptual Dependency Theory?

Roger Schank did some interesting work on language processing with Conceptual Dependency (CD) in the 1970s. He then moved somewhat out of the field, being in Education these days. There were some ...
9
votes
4answers
704 views

Can the English language ever be generalized using a set of grammar rules?

In programming languages, there is a set of grammar rules which govern the construction of valid statements and expressions. These rules help in parsing the programs written by the user. Can there ...
9
votes
3answers
688 views

Specific requirements of the Turing Test

What are the specific requirements of the Turing Test? What requirements if any must the evaluator fulfill in order to be qualified to give the test? Must there always be two participants in the ...
9
votes
1answer
557 views

Can an AI make a constructed (natural) language?

"An artificial or constructed language (sometimes called a conlang) is a language that has been created by a person or small group, instead of being formed naturally as part of a culture." (Source: ...
9
votes
2answers
400 views

Is there any modern NLP implementation similar to Winograd SHRDLU?

I have came across the Winograd SHRDLU program and I found it very interesting and aspiring. What is the consensus regarding it? Are there any similar attempts? I'm reading the book of Terry ...
8
votes
3answers
6k views

Can BERT be used for sentence generating tasks?

I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words. ...
8
votes
1answer
8k views

Are the dialogs at Sophia's (the robot) appearings scripted?

I talk about the robot from: Hanson Robotics, which was granted the right to citizenship from Saudi Arabia. I have found the following articles: Your new friend is a humanoid robot source: ...
8
votes
1answer
113 views

What artificial intelligence strategies are useful for summarization?

If I have a paragraph I want to summarize, for example: Ponzo and Fila went to the mall during the day. They walked for a long while, stopping at shops. They went to many shops. At first, they didn'...
7
votes
3answers
81 views

Is there a central focus on the communication methods between AI and humans?

AI is developing at a rapid pace and is becoming very sophisticated. One aspect will include the methods of interaction between AI and humans. Currently the interaction is an elementary interaction ...
7
votes
1answer
129 views

What is predicate argument recognition?

There is a study about The Necessity of Parsing for Predicate Argument Recognition, however I couldn't find much information about 'Predicate Argument Recognition' which could explain it. What is it ...
7
votes
1answer
730 views

Why is perplexity a good evaluation metric for chatbots?

Some papers say that BLEU is not a appropriate evaluating method for chatbot, instead they use perplexity to estimate chatbot. First of all, what is perplexity? How to calculate it? And why is ...
7
votes
1answer
448 views

Loss function for Hierarchical Multi-label classification

I am looking to try different loss functions for a hierarchical multi-label classification problem. So far, I have been training different models or submodels like multilayer perceptron ( MLP )branch ...
6
votes
4answers
3k views

Is there any open source counterpart to the IBM Watson?

I am looking for something similar to IBM Watson but open source.
6
votes
4answers
277 views

Is language understanding possible without qualia?

I feel that many words if not all of them have a direct mapping to some kind of inner subjective experience, to a physical object, mental feeling, process or some other kind of abstract thing. Given ...
6
votes
2answers
138 views

What was the first machine that was able to carry on a conversation?

What was the first AI that was able to carry on a conversation, with real responses, such as in the famous 'I am not a robot. I am a unicorn' case? A 'real response' constitutes a sort-of ...
6
votes
2answers
203 views

How would an AI learn idiomatic phrases in a natural language?

After an AI goes through the process described in How would an AI learn language?, an AI knows the grammar of a language through the process of grammar induction. They can speak the language, but they ...
6
votes
2answers
405 views

How to determine if an Amazon review is likely to be fake using text classification

I'm currently in the research stage of building a web app in ASP.NET where the user can input a URL to an Amazon product, then the app would determine how likely its reviews are to be genuine. I need ...
6
votes
1answer
145 views

Are there any projects that can measure the concept similarity between texts?

Are there any algorithms or software libraries that can be used to detect the similarity of concepts in text, regardless of articulation, grammar, synonyms, etc.? For example, these phrases: ...
6
votes
1answer
101 views

Can you teach an AI through sentences?

If you taught an AI to understand sentences through usual neural network techniques. Then could you being to teach it things with sentences such as "ants are small", "the sky is blue". i.e. if you ...
6
votes
2answers
291 views

Has any schema-agnostic database engine been implemented?

Has any schema-agnostic database engine been implemented?
6
votes
2answers
257 views

How do we know if GPT-2 is a better language model?

You may have heard of GPT2, a new language model. It has recently attracted attention from the general public as the foundation that published the paper, OpenAI, ironically refused to share the whole ...
5
votes
2answers
339 views

How can I convert an input Natural Language QA to a MDX q

I am researching Natural Language Processing (NLP) to develop a NL Question Answering system. The answering part is already done. So processing the question remains, along with the questions regarding ...
5
votes
3answers
280 views

Which AI branch should I follow for Natural Language Processing problem?

I'm doing some testings on NLP and I was thinking to write a code that works like this. Subject -> User input -> Output Dog ownership -> I own a dog -> Yes Dog ownership -> My dog is called Joe -> ...
5
votes
1answer
501 views

How do I use a taxonomy and the Support Vector Machine for question classification in Natural Language Processing?

I am going to develop an open-domain Natural Language Question Answering (NL QA) system, and will use the Support Vector Machine (SVM) as the machine-learning (ML) algorithm for question ...
5
votes
1answer
295 views

What algorithms does stackoverflow use for classifying duplicate questions?

Can I get details about the algorithms used for classifying questions in stackoverflow ("Questions that may already have your answer"). Most of the suggestions I get are nowhere related to the ...
5
votes
1answer
430 views

How does Wit.ai convert sentences into structured data?

The Wit.ai is a Siri-like voice interface which can can parse messages and predict the actions to perform. Here is the demo site powered by Wit.ai. How does it understand the spoken sentences and ...
5
votes
2answers
121 views

Are there any results on how difficult certain languages are to learn for chatbots?

Has there any research been done on how difficult certain languages are to learn for chatbots? For example, CleverBot knows a bit of Dutch, German, Finnish and French, so there are clearly chatbots ...
5
votes
2answers
2k views

How to resolve lexical ambiguity in natural language processing?

I'm interested in implementing a program for natural language processing (aka ELIZA). Assuming that I'm already storing semantic-lexical connections between the words and its strength. What are the ...
5
votes
4answers
521 views

Is 'job title classification' rather a problem of NLP or machine learning?

first of all I want to specify the data available and what needs to be achieved: I have a huge amount of vacancies (in the millions). The information about the job title and the job description of ...
5
votes
1answer
128 views

Methods to tell if a question can be answered from a paragraph

I'm working on a project related to machine Q&A, using the SQuAD dataset. I've implemented a neural-net solution for finding answers in the provided context paragraph, but the system (obviously) ...
5
votes
1answer
145 views

Recommendations for research: Influential NLP projects of the last 5 years

I'm looking at the history of NLP (and by extension, machine learning) and starting in the 1950s with the Georgetown–IBM experiment. Are there any particular studies nor projects done with Natural ...
5
votes
1answer
1k views

Which parsing algorithm can I use for NLP question answering system?

I am currently working on my last project before graduating. For this project, I have to develop a Natural Language Question Answering System. Now, I have read quite some research papers regarding ...
4
votes
4answers
480 views

Can Machine Learning be applied to decipher the script of lost ancient languages?

Can Machine Learning be applied to decipher the script of lost ancient languages? (Languages that many years ago were being used, but currently are not used in the human societies and have been ...
4
votes
3answers
213 views

Has an AI ever solved a detective mystery?

In detective novels, the point is often that the reader gets enough information to solve the crime themselves. This "puzzle" aspect of detective novels is part of the attraction. Often the difficulty ...
4
votes
3answers
134 views

Sentiment Analysis

Can we define the feeling of the human through conversations with an AI? Something like a "confessional," disregarding human possibilities to lie. Below, I have the categories joyful, sadness, anger, ...
4
votes
1answer
448 views

What are the main AI technologies behind the Watson platform?

What AI techniques does IBM use for its Watson platform (specifically, its natural language processing part)?
4
votes
4answers
146 views

Asking about the combination of NLP and ML

I am new to this community, I just have a question : is doing a M.S. in the combination of Natural Language Processing and Machine Learning worth it? What are the opportunities that can be opened by ...
4
votes
2answers
2k views

Has Capsule Networks or similar systems been used for NLP?

Capsule Networks seem to be a good solution for problems, which make up hierarchical complexity ( ( (eyes, nose, ears -> face); (fingers, nails, palm -> hand) ) -> human). NLP domain is a very clear ...
4
votes
1answer
178 views

Could AI be used to generate questions from a database input?

I confront to the next scenario: Let's say I have stored data about football matches between different teams: lineups, scorers, yellow cards, and many other events. I need to generate everyday ...