People who code: we want your input. Take the Survey

Questions tagged [natural-language-processing]

For questions related to natural language processing (NLP), which is concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
69
votes
3answers
49k views

How can neural networks deal with varying input sizes?

As far as I can tell, neural networks have a fixed number of neurons in the input layer. If neural networks are used in a context like NLP, sentences or blocks of text of varying sizes are fed to a ...
29
votes
3answers
20k views

Why does the transformer do better than RNN and LSTM in long-range context dependencies?

I am reading the article How Transformers Work where the author writes Another problem with RNNs, and LSTMs, is that it’s hard to parallelize the work for processing sentences, since you have to ...
28
votes
9answers
6k views

What is the actual quality of machine translations?

As an AI layman, till today I am confused by the promised and achieved improvements of automated translation. My impression is: there is still a very, very far way to go. Or are there other ...
19
votes
4answers
23k views

Can BERT be used for sentence generating tasks?

I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words. ...
17
votes
2answers
321 views

What research has been done in the domain of “Identifying sarcasm in text”?

Identifying sarcasm is considered as one of the most difficult open-ended problems in the domain of ML and NLP. So, was there any considerable research done in that front? If yes, then what is the ...
14
votes
3answers
671 views

How would an AI learn language?

I was think about AIs and how they would work, when I realised that I couldn't think of a way that an AI could be taught language. A child tends to learn language through associations of language and ...
14
votes
3answers
2k views

What roles knowledge bases play now and will play in the future?

Nowadays, artificial intelligence seems almost equal to machine learning, especially deep learning. Some have said that deep learning will replace human experts, traditionally very important for ...
12
votes
5answers
434 views

Have any AI systems yet been developed that can knowingly lie to / deceive a human?

AI systems today are very capable machines, and recently the area of Natural Language Processing and Response has been exploding with innovation, as well as the fundamental algorithmic structure of AI ...
12
votes
3answers
17k views

How do I compute the structural similarity between sentences?

I am working on a problem where I need to determine whether two sentences are similar or not. I implemented a solution using BM25 algorithm and wordnet synsets for determining syntactic & ...
12
votes
0answers
418 views

How can Viv generate new code based on some user's query?

I have been looking into Viv, an artificial intelligent agent in development. Here is a demonstration of Viv (by Dag Kittlaus). Based on what I understand, this AI can generate new code and execute it ...
11
votes
3answers
2k views

What are the specific requirements of the Turing test?

What are the specific requirements of the Turing test? What requirements if any must the evaluator fulfill in order to be qualified to give the test? Must there always be two participants in the ...
11
votes
1answer
959 views

Can an AI make a constructed (natural) language?

"An artificial or constructed language (sometimes called a conlang) is a language that has been created by a person or small group, instead of being formed naturally as part of a culture." (Source: ...
11
votes
2answers
531 views

Is anybody still using Conceptual Dependency Theory?

Roger Schank did some interesting work on language processing with Conceptual Dependency (CD) in the 1970s. He then moved somewhat out of the field, being in Education these days. There were some ...
10
votes
4answers
806 views

Can the English language ever be generalized using a set of grammar rules?

In programming languages, there is a set of grammar rules which govern the construction of valid statements and expressions. These rules help in parsing the programs written by the user. Can there ...
10
votes
1answer
10k views

Are the dialogs at Sophia's (the robot) appearings scripted?

I talk about the robot from: Hanson Robotics, which was granted the right to citizenship from Saudi Arabia. I have found the following articles: Your new friend is a humanoid robot Source: ...
10
votes
3answers
539 views

Is there an AI model for generating sarcastic sentences?

I am currently working on an Android AI app. I am aware of AI models to generate random sentences. However, is there an AI model for generating sarcastic sentences?
10
votes
4answers
4k views

Is there any open source counterpart to the IBM Watson?

I am looking for something similar to IBM Watson but open source.
10
votes
1answer
2k views

How can Transformers handle arbitrary length input?

The transformer, introduced in the paper Attention Is All You Need, is a popular new neural network architecture that is commonly viewed as an alternative to recurrent neural networks, like LSTMs and ...
10
votes
1answer
281 views

Has anyone attempted to train an AI to learn all languages?

It seems that most projects attempt to teach the AI to learn individual, specific languages. It occurs to me that there are relations in written and spoken words and phrases across languages - most ...
8
votes
1answer
158 views

Are there any projects that can measure the concept similarity between texts?

Are there any algorithms or software libraries that can be used to detect the similarity of concepts in text, regardless of articulation, grammar, synonyms, etc.? For example, these phrases: Outside, ...
8
votes
1answer
150 views

What artificial intelligence strategies are useful for summarization?

If I have a paragraph I want to summarize, for example: Ponzo and Fila went to the mall during the day. They walked for a long while, stopping at shops. They went to many shops. At first, they didn'...
8
votes
2answers
422 views

How can I translate a natural language question to an MDX query?

I am researching Natural Language Processing (NLP) to develop an NL Question Answering system. The answering part is already done. So processing the question remains, along with the questions ...
8
votes
2answers
908 views

What are the current big challenges in natural language processing and understanding?

I'm doing a paper for a class on the topic of big problems that are still prevalent in AI, specifically in the area of natural language processing and understanding. From what I understand, the areas: ...
8
votes
1answer
219 views

What are the most recent and influential breakthroughs in NLP?

I'm looking at the history of NLP, starting in the 1950s, with the Georgetown–IBM experiment. What are examples of the most recent (e.g. in the last 5-10 years) and influential breakthroughs in ...
8
votes
2answers
1k views

Why is the perplexity a good evaluation metric for chatbots?

A few papers I have come across say that BLEU is not an appropriate evaluation metric for chatbots, so they use the perplexity. First of all, what is perplexity? How to calculate it? And why is ...
7
votes
2answers
597 views

How would an AI learn idiomatic phrases in a natural language?

After an AI goes through the process described in How would an AI learn language?, an AI knows the grammar of a language through the process of grammar induction. They can speak the language, but they ...
7
votes
1answer
736 views

What is the intuition behind the dot product attention?

I am watching Attention all you need, In that what is the intuition behind the dot product attention? $$A(q,K, V) = \sum_i\frac{e^{q.k_i}}{\sum_j e^{q.k_j}} v_i$$ becomes: $$A(Q,K, V) = softmax(QK^...
7
votes
4answers
330 views

Is language understanding possible without qualia?

I feel that many words if not all of them have a direct mapping to some kind of inner subjective experience, to a physical object, mental feeling, process or some other kind of abstract thing. Given ...
7
votes
2answers
3k views

What are the main differences between skip-gram and continuous bag of words?

The skip-gram and continuous bag of words (CBOW) are two different types of word2vec model. What are the main differences between them? What are the pros and cons of both methods?
7
votes
2answers
525 views

How to determine if an Amazon review is likely to be fake using text classification

I'm currently in the research stage of building a web app in ASP.NET where the user can input a URL to an Amazon product, then the app would determine how likely its reviews are to be genuine. I need ...
7
votes
3answers
88 views

Is there a central focus on the communication methods between AI and humans?

AI is developing at a rapid pace and is becoming very sophisticated. One aspect will include the methods of interaction between AI and humans. Currently the interaction is an elementary interaction ...
7
votes
1answer
2k views

How to recognise metaphors in texts using NLP/NLU?

What are the current NLP/NLU techniques that can extract metaphors from texts? For example His words cut deeper than a knife. Or a simpler form like: Life is a journey that must be travelled no ...
7
votes
3answers
2k views

Have capsule neural networks been used to NLP problems?

The capsule neural network seems to be a good solution for problems that involve hierarchies. For example, a face is composed of eyes, a nose and ears; a hand is made of fingers, nails, and a palm; ...
7
votes
1answer
234 views

What is predicate argument recognition?

There is a study about The Necessity of Parsing for Predicate Argument Recognition, however I couldn't find much information about 'Predicate Argument Recognition' which could explain it. What is it ...
7
votes
1answer
543 views

How do we know if GPT-2 is a better language model?

You may have heard of GPT2, a new language model. It has recently attracted attention from the general public as the foundation that published the paper, OpenAI, ironically refused to share the whole ...
7
votes
2answers
143 views

Can we teach an artificial intelligence through sentences?

Could we teach an AI with sentences such as "ants are small" and "the sky is blue"? Is there any research work that attempts to do this?
7
votes
1answer
1k views

Loss functions for Hierarchical Multi-label classification?

I am looking to try different loss functions for a hierarchical multi-label classification problem. So far, I have been training different models or submodels like multilayer perceptron ( MLP )branch ...
7
votes
1answer
1k views

Which parsing algorithm can I use for NLP question answering system?

I am currently working on my last project before graduating. For this project, I have to develop a Natural Language Question Answering System. Now, I have read quite some research papers regarding ...
7
votes
2answers
146 views

Why are documents kept separated when training a text classifier?

Most of the literature considers text classification as the classification of documents. When using the bag-of-words and Bayesian classification, they usually use the statistic TF-IDF, where TF ...
6
votes
1answer
2k views

What language is the GPT-3 engine written in?

I know that the API is python based, but what's the gpt-3 engine written in mostly? C? C++? I'm having some trouble finding this info.
6
votes
2answers
168 views

What was the first machine that was able to carry on a conversation?

What was the first AI that was able to carry on a conversation, with real responses, such as in the famous 'I am not a robot. I am a unicorn' case? A 'real response' constitutes a sort-of ...
6
votes
1answer
1k views

Did Turing foresee the required capabilities to pass the Turing test?

In Section 1.1 of Artificial Intelligence: A Modern Approach, it is stated that a computer which passes the Turing Test would need 4 capabilities, and that these 4 capabilities comprise most of the ...
6
votes
1answer
302 views

Is Sanskrit still relevant for NLP/AI?

I came across a news article from 2018 where the president of India was saying that Sanskrit is the best language for ML/AI. I have no idea regarding his qualification on either AI or Sanskrit to say ...
6
votes
1answer
901 views

How to use BERT as a multi-purpose conversational AI?

I'm looking to make an NLP model that can achieve a dual purpose. One purpose is that it can hold interesting conversations (conversational AI), and another being that it can do intent classification ...
6
votes
2answers
3k views

How to resolve lexical ambiguity in natural language processing?

I'm interested in implementing a program for natural language processing (aka ELIZA). Assuming that I'm already storing semantic-lexical connections between the words and its strength. What are the ...
6
votes
4answers
2k views

Is 'job title classification' rather a problem of NLP or machine learning?

first of all I want to specify the data available and what needs to be achieved: I have a huge amount of vacancies (in the millions). The information about the job title and the job description of ...
6
votes
2answers
369 views

Has any schema-agnostic database engine been implemented?

Has any schema-agnostic database engine been implemented?
5
votes
4answers
998 views

Can Machine Learning be applied to decipher the script of lost ancient languages?

Can Machine Learning be applied to decipher the script of lost ancient languages (namely, languages that were being used many years ago, but currently are not used in human societies and have been ...
5
votes
3answers
425 views

What is the purpose of Decoder mask (triangular mask) in Transformer?

I'm trying to implement transformer model using this tutorial. In the decoder block of the Transformer model, a mask is passed to "pad and mask future tokens in the input received by the decoder&...
5
votes
4answers
228 views

Is doing a master's in natural language processing combined with machine learning worth it? [closed]

Is doing a master's in natural language processing combined with machine learning worth it? What are the opportunities that can be opened by having such a master's?

1
2 3 4 5
11