Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [natural-language-processing]

Natural language processing is the computer representation and manipulation of human languages that developed in social (rather than mathematical or other) contexts. Use the natural-language tag for questions not primarily about processing, and use the language-processing tags for questions that are ...

1
vote
0answers
20 views

How to model a plumber dispatcher with Artificial Intelligence?

The domain of emergency call for clogged pipelines has to do with taking a call and managing the reaction of plumber departments. It is mostly a group oriented communication situation between the ...
1
vote
2answers
17 views

How to know which kind of adverb in NLP Parts of Speech (POS) tagging?

There are 4 kinds of adverbs : Adverbs of Manner. For example, slowly, quietly Adverbs of Place. For example, there, far Adverbs of Frequency. For example, everyday, often Adverbs of Time. For ...
1
vote
2answers
30 views

Possible to translate generic English-language document into higher-order logic?

(Un-original) idea: Wouldn't it be cool if we could fact-check using an algorithm that could understand a whole bunch of documents (e.g. scientific papers) as higher-order logic? Question: What ...
0
votes
0answers
13 views

Datastructure for grounded grammar induction

Grammatical induction is the art of learning a grammar from training data. We have a domain-specific-language for example a Python dialect and should create for that dialect a grammar which is able to ...
1
vote
0answers
10 views

Learning Tree Paths when Given Vectors

The problem statement: Mapping from a vector space representation onto a tree structure. Possible solution: Given a word vector as input, produce a path in the tree from the root down to the node ...
1
vote
0answers
16 views

Multi-channel CNNs and channels

In language models, CNNs can extract different n-gram features from the input. From my current understanding, these models are called "multi-channel CNNs". I'm referring to these materials: https://...
1
vote
1answer
19 views

Searching for dataset in specifix context for NLP, sentiment analysis

I would like to create an NPC engine for games which are in a fantasy context like Lord of the Rings, Warcraft, Skyrim, Dragon Age etc. This engine should be able to determine the polarity of the ...
-1
votes
0answers
14 views

Which pretrained embeddings version to choose ?

I want to use pretrained embeddings. Let's say FastText. But from the website, there is several versions available : Pre-trained word vectors learned on different sources can be downloaded below: ...
0
votes
0answers
19 views

Usefulness of Data augmentation for non-overfitting network [NLP]

(Maybe related : Usefulness of Dropout for non-overfitting network) My neural network does not overfit. Using Data augmentation in a non-overfitting network can increase its accuracy ? Note : I'm ...
1
vote
0answers
18 views

How to understand marginal loglikelihood objective function as loss function (explanation of an article)?

I am reading article https://allenai.org/paper-appendix/emnlp2017-wt/ http://ai2-website.s3.amazonaws.com/publications/wikitables.pdf about training neural network and the loss function is mentioned ...
1
vote
0answers
19 views

Semantics of natural language — is AI capable hardware and software now developed enough to realize it?

The need for semantic cognition in relation to natural language in computers is ever appearing in real problems in the field of AI. We can note a substantial increase in related posted in ...
2
votes
1answer
38 views

How to find the category of a technical text on a surface-semantic-level

There are some predefined categories( Overview, Data Architecture,Technical Details, Applications etc). The requirement is to classify the input text of paragraphs into their resp. category. I cant ...
1
vote
1answer
55 views

Question in NLP

I'm working on a project,whereby; one of the actors is "Teacher" and it's role will be, insert the course name, outcomes of skills, then insert the question, student degree and automatically will be ...
1
vote
0answers
21 views

Preset Intent list

I'm trying to build a chat analysis that could identify the intent of check price. Has any kind of preset intent list to train my chatbot already been done ? Data: A data set for "check price" ...
0
votes
0answers
45 views

Extract particular pattern from the given text/paragraph using machine or deep learning

If there is given a one paragraph as a input and it extract a string from the paragraph,within a predefined range (i.e. a string that starts with three letters that a always fixed and ends with five ...
1
vote
1answer
35 views

Looking for NLP technique and drawing a blank

Within a piece of text, I'm trying to detect who did what to whom. For instance, in the following sentences: CV hit IV. CV was hit by IV. I'd like to know who hit whom. I can't remember what ...
1
vote
1answer
42 views

Calculation of GPU memory consumption on softmax layer doesn't match with the empirical result

I'm training a language model with 5000 vocabularies using a single M60 GPU (w/ actually usable memory about 7.5G). The number ...
1
vote
1answer
66 views

How to make a chatbot with NLP and Neural

I would like to have a chat to talk on a personal plan enough to pass the Turing test. I got to study some natural language processing (NLP) but some that usually hide a lot of mechanical, so I think ...
2
votes
1answer
55 views

How to build a commercial image captioning system?

Image Captioning is a hot research topic in the AI community. There are considerable image captioning models for research usage such as NIC, Neural Talk 2 etc. But can these research models be used ...
3
votes
1answer
33 views

How to parse conjunctions in Natural Language Processing in Python

Is there an accepted way in NLP to parse conjunctions (and/or) in a sentence? Disclaimer: I'm not sure if this is technically a computer science or AI problem. For the below example, how would I ...
2
votes
2answers
84 views

How does the 'Lorum ispum' generator work?

In the domain of natural language processing, a textgenerator is able to produce pseudo random output. The most famous one is SCIgen which was used to generate fake-science papers. The inner working ...
3
votes
2answers
72 views

Where can I find pre-trained language models in English and German?

Where can I find (more) pre-trained language models? I am especially interested in neural network based models for English and German. And I specifically mean language model in its standard sense. I ...
1
vote
0answers
25 views

Can semantic paraphrasing be used for a workflow management system?

The term paraphrasing is used for converting input text into output text with small modifications on the semantic level. Paraphrasing is used by managers to distribute work items to employees. It is a ...
3
votes
2answers
71 views

Software that understands hometask in mathematics with the hometask being a text

What software can understand the following task: "A big cat needs 4 days to catch all the mice and a small cat needs 12 days. How many days need the both if they catch mice together?"?
1
vote
0answers
17 views

Sequence to sequence machine learning / NMT - converting numbers into words

I want to do some sequence to sequence modelling on source data that looks like this: /-0.013428/-0.124969/-0.13435/0.008087/-0.269241/-0.36849/ with target data ...
3
votes
2answers
76 views

How can I train model to extract custom entities from text?

I have a 100-150 words text and I want to extract particular information like location, product type, dates, specifications and price. Suppose if I arrange a training data which has a text as input ...
6
votes
1answer
88 views

Can you teach an AI through sentences?

If you taught an AI to understand sentences through usual neural network techniques. Then could you being to teach it things with sentences such as "ants are small", "the sky is blue". i.e. if you ...
4
votes
1answer
75 views

Loss function for Hierarchical Multi-label classification

I am looking to try different loss functions for a hierarchical multi-label classification problem. So far, I have been training different models or submodels like multilayer perceptron ( MLP )branch ...
2
votes
1answer
29 views

Recognising common short forms of appliances used daily

I'm working on a chatbot for homes and would need to understand the appliance the user is talking about. Suppose the command is: Turn on the air conditioner. and another variant could be Turn on the ...
0
votes
0answers
35 views

NLP for semantic retrieval

I want to use NLP for semantic retrieval. I am new to this field. Can anyone suggest toolkit or tutorial to learn and implement NLP from scratch.
1
vote
0answers
57 views

Sentence classification and named identity detection with automatic retraining

I am learning AI and trying out my first real life AI application. What I am trying to do is taking as an input various sentences, and then classifying the sentences into one of X number of categories ...
4
votes
1answer
61 views

Is 'job title classification' rather a problem of NLP or machine learning?

first of all I want to specify the data available and what needs to be achieved: I have a huge amount of vacancies (in the millions). The information about the job title and the job description of ...
1
vote
0answers
22 views

Would Capsule Neworks and Topic Modeling used together make sense?

This is actually something I have been researching a bit on my own. Most movie scripts can be structurally analysed by using writing theory such as Dramatica. Dramatica is based upon hierarchy of ...
2
votes
0answers
32 views

Extracting referenced documents

I'm looking to write an AI that will be able to extract in text references from standards documents to assist human research. My use case is extracting the identifying numbers, for example, "AR 25-2",...
2
votes
1answer
119 views

Can AI solve jumbled words?

My question is that is there any general idea on how humans solve jumbled words? I know many people will say we match it against a commonly used words checklist mentally, but it is kind of vague. Is ...
1
vote
1answer
48 views

What are the internal concepts incorporated in IBM's Watson platform?

IBM's Watson acts as a template for developing chat-bots with ease (without coding), but what are the methodologies and concepts that have been used to build it?
5
votes
1answer
81 views

What algorithms does stackoverflow use for classifying duplicate questions?

Can I get details about the algorithms used for classifying questions in stackoverflow ("Questions that may already have your answer"). Most of the suggestions I get are nowhere related to the ...
2
votes
2answers
76 views

Question classification according to chapters

I have a corpus, say an instruction manual. The text in this manual is grouped into chapters and each chapter is split up into sections. For example, Chapter 1/Section 1, Chapter 1/Section 2 and so on....
2
votes
4answers
438 views

Is there something like OpenCV for voice recognition & NLP?

As you know OpenCV is a big great open-source library for image recognition and machine vision(and may further purposes like computer graphics, etc). Is there similar library in sound field(Voice ...
2
votes
1answer
50 views

Implementing AI/ML in customer service

I am working on a task where I am required to automate the customer service request channel. The process is quite typical. A customer queries about a product via email, the person on the front channel ...
3
votes
1answer
51 views

What existing tools are out there for creating chatbots from a plain text corpus and without having question, answer pairs?

I know some people will try to crucify me for asking such question here, since it's too generic, but ill give it a shot. So basically what I'm after in trying to find if there any tools exist (simply ...
2
votes
2answers
166 views

What is the most effective way to learn natural language processing online?

There are many books, courses, etc. out there, but not sure which path to take. So what would be the most effective way (shortest) to learn natural language processing online? p.s. I mean learning ...
2
votes
1answer
78 views

How can I build an AI with NLP that reads and understands documents?

I have to read a lot of papers, and I thought that I can use an A.I. to read them and summarize them. Maybe find one that can understand what the papers are talking about it seems a lot to ask. I ...
1
vote
1answer
33 views

Are there any references of nlp/text mining techniques for Identifying the theme of News headlines

I am looking to extract the central theme of news headline using NLP/ Text-mining, any references in this direction is of great help. For example: Inputs: BRIEF-Dynasil Corporation Of America ...
0
votes
1answer
281 views

How can I create my own Google duplex?

I am trying to create my own variant of Google duplex however, it won't make calls but just have a real time conversation. My question is, where and how to start? How do I train my model with real ...
1
vote
1answer
47 views

Recommended Modelling Technique for Influencer Marketing Scenario

I have an approximately 90,000 row dataset that has information of social media profiles which has columns for biography, follower count, language spoken, name, username and the label (to identify ...
1
vote
0answers
30 views

Number of utterances

Currently I am working with two large speech databases and I was asked to build one subset from each one in order to get two representative subsets with the same number of utterances. My question is: ...
2
votes
1answer
29 views

Do individual dimensions in vector space have meaning?

Word2vec assigns an N-dimensional vector (a dimensional reduction, really) to given words. It turns out that, at least with a number of canonical examples, vector arithmetic seems to work intuitively. ...
0
votes
0answers
115 views

Optimizing the number of embedding dimensions for word2vec

The choice of the number of embedding dimensions (N) seems to generally be determined empirically (i.e. trial-and-error) for a given corpus and use case. Typical ranges used seem to be anywhere from ...
5
votes
3answers
91 views

Sentiment Analysis

Can we define the feeling of the human through conversations with an AI? Something like a "confessional," disregarding human possibilities to lie. Below, I have the categories joyful, sadness, anger, ...