Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [natural-language-processing]

Natural language processing is the computer representation and manipulation of human languages that developed in social (rather than mathematical or other) contexts. Use the natural-language tag for questions not primarily about processing, and use the language-processing tags for questions that are about the processing of languages that are not naturally formed.

0
votes
0answers
8 views

Technical Document Summarization Free Datasets

I want to summarize technical or scientific documents such as IEEE journals using natural language processing. Is there any available free dataset for my problem, wherein a journal or technical paper ...
1
vote
0answers
11 views

BERT - What are the segment and position embeddings used in here?

They only reference in the paper that the position embeddings are learned, which is different from what was done in ELMo. Please redirect me to another StackExchange forum if this one is not ...
0
votes
1answer
28 views

What's the commercial usage of “image captioning”?

If "image captioning" is utilized to make a commercial product, what application fields will need this technique? And what is the level of required performance can this technique be usable? Thanks.
1
vote
0answers
14 views

Smielapp design feasible now?

Consider a SmielApp1, pronounced smile-app. It's a proposed app for Android, iOS, LINUX, and other phone, tablet, laptop, and desktop environments.2 The system requirements are a microphone, a speaker,...
3
votes
1answer
14 views

Natural language recommendation system: to pre-classify inputs or not?

Does it help to "pre-classify" natural language inputs using labeled input fields? E.g., "Who," "What," "Where," "When," "Why," "How," and "How much?" Or is a single, monolithic, free-form, long-text ...
2
votes
2answers
40 views

Asking about the combination of NLP and ML

I am new to this community, I just have a question : is doing a M.S. in the combination of Natural Language Processing and Machine Learning worth it? What are the opportunities that can be opened by ...
0
votes
0answers
12 views

Pretrained word embeddings vs pretrained model weights

I'm trying to understand the relationship between pretrained word vectors and pretrained weights when using pretrained word vectors in another neural network. Are the vectors themselves the weights ...
3
votes
2answers
69 views

How to recognise metaphors in NLP?

Is there software available which can extract metaphors from texts? eg: His words cut deeper than a knife. Or a simpler form like : eg: Life is a journey that must be travelled no matter how bad ...
0
votes
0answers
9 views

What is the best technique\algorithm to identify and remove a chunk of audio (private data) by using AI

perhaps my question is to vague. I would like to ask your advice on how to solve this problem. A call center company, from time to time records some calls their agents are doing, for quality ...
-1
votes
1answer
36 views

What is the easiest way to model dialogue?

I am looking for some non-ML methods. I am looking for a way of two chat bots communicating to each other on specific topic. I could not find online any resources that do this without using ML. The ...
1
vote
1answer
29 views

Handling emotion in informal text (Hi vs HIIIIII!!!!)?

This is a question related to Neural network to detect "spam"?. I'm wondering how it would be possible to handle the emotion conveyed in text. In informal writing, especially among a ...
0
votes
0answers
17 views

Document Understanding using Deep Learning

I want to attempt the below problem, i think it is kind of a research problem.So I do not expect any ready made answers, I want to know possible approaches and pointers. Problem: I have two ...
0
votes
1answer
15 views

LSTM language model not working

I am trying to use a Keras LSTM neural network for character level language modelling. As the input, I give it the last 50 characters and it has to output the next one. It has 3 layers of 400 neurons ...
0
votes
0answers
18 views

Are GRU-like optimizations and bidirectionality developed for recursive networks?

There are several features which appear in existing algorithms that, for language processing and action scene recognition, might ideally be integrated into one algorithm. Recursive model to enable ...
0
votes
0answers
17 views

Understanding this NLIDB solution

I am going through this Natural Language Interface for Databases along with its paper. I am trying to test it as in getting the intermediate processing steps as clear as Figure 1 in the document (...
0
votes
1answer
25 views

What AI designs are suited for producing title replacements?

Problem: "For a given news article, generate another title for the article if the article is to be published under a different Publication." Which algorithm will be well suited for this? Should I use ...
0
votes
0answers
10 views

Is Fuzzy control equal to grounded motion primitives?

In the literature, many papers are written about Fuzzy control systems. Usually they are based on diagrams which shows the relationship between input signal and control signal. The interesting aspect ...
1
vote
2answers
24 views

Is there bidirection sequence-to-sequence neural machine translation?

I have heard about bidirectional RNN LSTM units (endcoders-decoders), but my question is - is there bidirectional neural machine translation, that uses A->B weights for the translation in the opposite ...
0
votes
1answer
20 views

Grouping products and naming groups

I'm working on a home tool that will help create a shopping list from a list of recipes chosen for a coming week. This boils down to: Extracting ingredients and their quantities from recipes. ...
2
votes
2answers
29 views

In speech recognition, what kind of signal is used?

Speech is a major primary mechanism of communication between humans. With respect to artificial intelligence, which signal is used to identify the sequence of words in speech?
2
votes
2answers
91 views

Can Machine Learning be applied to decipher the script of lost ancient languages?

Can Machine Learning be applied to decipher the script of lost ancient languages? (Languages that many years ago were being used, but currently are not used in the human societies and have been ...
1
vote
1answer
15 views

How can I evaluate the performance of a system that generates text?

I am preparing to perform research comparing the performance of two different systems that probabilistically generate the next word of an input sentence. For example, given the word 'the', a system ...
0
votes
0answers
5 views

Which Domain specific language are available for Mocap?

Motion capture (Mocap) is about recording human motions in 3d space. In most cases, a marker based tracking is used, but some newer development goes into markerless capture. The result of the mocap ...
0
votes
2answers
37 views

Content analysis tools

We want to figure out the connection between people, based on their speech. Assume, that a conversation is a poetry with lines belongs to characters. There are a lot of poetries and the lines are ...
1
vote
0answers
13 views

Intelligent Text Combination

Let's say we have 2 blocks of text, where there are some similarities as in 2 interpretations of the same story. Is there any solution that would recognize these consistencies and ultimately be able ...
3
votes
1answer
37 views

Does an advanced Dialogue state tracking eliminate the need of intent classifier and slot filling models in dialogue systems/ chatbots?

I am learning to create a dialogue system. The various parts of such a system are Intent classifier, slot filling, Dialogue state tracking (DST), dialogue policy optimization and NLG. While reading ...
3
votes
1answer
46 views

Neural network architecture for comparison

When someone wants to compare 2 inputs, the most widespread idea is to use a Siamese architecture. Siamese architecture is a very high level idea, and can be customized based on the problem we are ...
0
votes
1answer
180 views

Can BERT be used for sentence generating tasks?

I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words. ...
0
votes
0answers
13 views

Task and motion planning with domain specific languages

In a paper published 6 years ago a novel domain specific language (DSL) for character animation was presented. High-level action commands are described in the XML format for authoring a virtual human. ...
3
votes
1answer
94 views

How to model a plumber dispatcher with Artificial Intelligence?

The domain of emergency call for clogged pipelines has to do with taking a call and managing the reaction of plumber departments. It is mostly a group oriented communication situation between the ...
2
votes
2answers
27 views

How to know which kind of adverb in NLP Parts of Speech (POS) tagging?

There are 4 kinds of adverbs : Adverbs of Manner. For example, slowly, quietly Adverbs of Place. For example, there, far Adverbs of Frequency. For example, everyday, often Adverbs of Time. For ...
1
vote
2answers
33 views

Possible to translate generic English-language document into higher-order logic?

(Un-original) idea: Wouldn't it be cool if we could fact-check using an algorithm that could understand a whole bunch of documents (e.g. scientific papers) as higher-order logic? Question: What ...
0
votes
0answers
18 views

Datastructure for grounded grammar induction

Grammatical induction is the art of learning a grammar from training data. We have a domain-specific-language for example a Python dialect and should create for that dialect a grammar which is able to ...
1
vote
0answers
15 views

Learning Tree Paths when Given Vectors

The problem statement: Mapping from a vector space representation onto a tree structure. Possible solution: Given a word vector as input, produce a path in the tree from the root down to the node ...
1
vote
0answers
22 views

Multi-channel CNNs and channels

In language models, CNNs can extract different n-gram features from the input. From my current understanding, these models are called "multi-channel CNNs". I'm referring to these materials: https://...
1
vote
1answer
23 views

Searching for dataset in specifix context for NLP, sentiment analysis

I would like to create an NPC engine for games which are in a fantasy context like Lord of the Rings, Warcraft, Skyrim, Dragon Age etc. This engine should be able to determine the polarity of the ...
0
votes
0answers
24 views

Usefulness of Data augmentation for non-overfitting network [NLP]

(Maybe related : Usefulness of Dropout for non-overfitting network) My neural network does not overfit. Using Data augmentation in a non-overfitting network can increase its accuracy ? Note : I'm ...
1
vote
0answers
22 views

How to understand marginal loglikelihood objective function as loss function (explanation of an article)?

I am reading article https://allenai.org/paper-appendix/emnlp2017-wt/ http://ai2-website.s3.amazonaws.com/publications/wikitables.pdf about training neural network and the loss function is mentioned ...
1
vote
0answers
25 views

Semantics of natural language — is AI capable hardware and software now developed enough to realize it?

The need for semantic cognition in relation to natural language in computers is ever appearing in real problems in the field of AI. We can note a substantial increase in related posted in ...
2
votes
1answer
48 views

How to find the category of a technical text on a surface-semantic-level

There are some predefined categories( Overview, Data Architecture,Technical Details, Applications etc). The requirement is to classify the input text of paragraphs into their resp. category. I cant ...
1
vote
1answer
64 views

Question in NLP

I'm working on a project,whereby; one of the actors is "Teacher" and it's role will be, insert the course name, outcomes of skills, then insert the question, student degree and automatically will be ...
1
vote
0answers
24 views

Preset Intent list

I'm trying to build a chat analysis that could identify the intent of check price. Has any kind of preset intent list to train my chatbot already been done ? Data: A data set for "check price" ...
1
vote
1answer
39 views

Looking for NLP technique and drawing a blank

Within a piece of text, I'm trying to detect who did what to whom. For instance, in the following sentences: CV hit IV. CV was hit by IV. I'd like to know who hit whom. I can't remember what ...
1
vote
1answer
44 views

Calculation of GPU memory consumption on softmax layer doesn't match with the empirical result

I'm training a language model with 5000 vocabularies using a single M60 GPU (w/ actually usable memory about 7.5G). The number ...
1
vote
1answer
95 views

How to make a chatbot with NLP and Neural

I would like to have a chat to talk on a personal plan enough to pass the Turing test. I got to study some natural language processing (NLP) but some that usually hide a lot of mechanical, so I think ...
2
votes
1answer
76 views

How to build a commercial image captioning system?

Image Captioning is a hot research topic in the AI community. There are considerable image captioning models for research usage such as NIC, Neural Talk 2 etc. But can these research models be used ...
3
votes
1answer
66 views

How to parse conjunctions in Natural Language Processing in Python

Is there an accepted way in NLP to parse conjunctions (and/or) in a sentence? By following the example below; how would I parse, ...
2
votes
2answers
90 views

How does the 'Lorum ispum' generator work?

In the domain of natural language processing, a textgenerator is able to produce pseudo random output. The most famous one is SCIgen which was used to generate fake-science papers. The inner working ...
3
votes
2answers
90 views

Where can I find pre-trained language models in English and German?

Where can I find (more) pre-trained language models? I am especially interested in neural network based models for English and German. And I specifically mean language model in its standard sense. I ...