Questions tagged [natural-language-processing]

For questions related to natural language processing, which is concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
3
votes
1answer
94 views

Neural network architecture for comparison

When someone wants to compare 2 inputs, the most widespread idea is to use a Siamese architecture. Siamese architecture is a very high level idea, and can be customized based on the problem we are ...
9
votes
3answers
7k views

Can BERT be used for sentence generating tasks?

I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words. ...
3
votes
1answer
114 views

How to model a plumber dispatcher with Artificial Intelligence?

The domain of emergency call for clogged pipelines has to do with taking a call and managing the reaction of plumber departments. It is mostly a group oriented communication situation between the ...
2
votes
2answers
76 views

How to know which kind of adverb in NLP Parts of Speech (POS) tagging?

There are 4 kinds of adverbs : Adverbs of Manner. For example, slowly, quietly Adverbs of Place. For example, there, far Adverbs of Frequency. For example, everyday, often Adverbs of Time. For ...
1
vote
2answers
40 views

Possible to translate generic English-language document into higher-order logic?

(Un-original) idea: Wouldn't it be cool if we could fact-check using an algorithm that could understand a whole bunch of documents (e.g. scientific papers) as higher-order logic? Question: What ...
1
vote
0answers
38 views

How could I learn tree paths given word embeddings?

I need to map from a vector space representation onto a tree structure. A possible solution: given a word vector as input, produce a path in the tree from the root down to the node that most closely ...
1
vote
0answers
76 views

Multi-channel CNNs and channels

In language models, CNNs can extract different n-gram features from the input. From my current understanding, these models are called "multi-channel CNNs". I'm referring to these materials: https://...
1
vote
1answer
36 views

Searching for dataset in specifix context for NLP, sentiment analysis

I would like to create an NPC engine for games which are in a fantasy context like Lord of the Rings, Warcraft, Skyrim, Dragon Age etc. This engine should be able to determine the polarity of the ...
3
votes
1answer
89 views

Which model should I use to determine the similarity between predefined sentences and new sentences?

The Levenshtein algorithm and some ratio and proportion may handle this use case. Based on the pre-defined sequence of statements, such as "I have a dog", "I own a car" and many more, I must ...
1
vote
0answers
41 views

How to understand marginal loglikelihood objective function as loss function (explanation of an article)?

I am reading article https://allenai.org/paper-appendix/emnlp2017-wt/ http://ai2-website.s3.amazonaws.com/publications/wikitables.pdf about training neural network and the loss function is mentioned ...
2
votes
1answer
92 views

How to find the category of a technical text on a surface-semantic-level

There are some predefined categories( Overview, Data Architecture,Technical Details, Applications etc). The requirement is to classify the input text of paragraphs into their resp. category. I cant ...
1
vote
1answer
121 views

Question in NLP

I'm working on a project,whereby; one of the actors is "Teacher" and it's role will be, insert the course name, outcomes of skills, then insert the question, student degree and automatically will be ...
1
vote
0answers
35 views

Preset Intent list

I'm trying to build a chat analysis that could identify the intent of check price. Has any kind of preset intent list to train my chatbot already been done ? Data: A data set for "check price" ...
1
vote
0answers
29 views

Pre priming a network for white space

When a human looks at a page. He notices the sets of letters are grouped together separated by white space. If the white space was replaced by another character say z, it would be harder to ...
1
vote
1answer
57 views

Looking for NLP technique and drawing a blank

Within a piece of text, I'm trying to detect who did what to whom. For instance, in the following sentences: CV hit IV. CV was hit by IV. I'd like to know who hit whom. I can't remember what ...
1
vote
1answer
69 views

Calculation of GPU memory consumption on softmax layer doesn't match with the empirical result

I'm training a language model with 5000 vocabularies using a single M60 GPU (w/ actually usable memory about 7.5G). The number ...
1
vote
1answer
270 views

How to make a chatbot with NLP and Neural

I would like to have a chat to talk on a personal plan enough to pass the Turing test. I got to study some natural language processing (NLP) but some that usually hide a lot of mechanical, so I think ...
2
votes
1answer
88 views

How to build a commercial image captioning system?

Image Captioning is a hot research topic in the AI community. There are considerable image captioning models for research usage such as NIC, Neural Talk 2 etc. But can these research models be used ...
3
votes
1answer
347 views

How to parse conjunctions in Natural Language Processing in Python

Is there an accepted way in NLP to parse conjunctions (and/or) in a sentence? By following the example below; how would I parse, ...
2
votes
2answers
126 views

How does the 'Lorum ispum' generator work?

In the domain of natural language processing, a textgenerator is able to produce pseudo random output. The most famous one is SCIgen which was used to generate fake-science papers. The inner working ...
4
votes
2answers
372 views

Where can I find pre-trained language models in English and German?

Where can I find (more) pre-trained language models? I am especially interested in neural network-based models for English and German. I am aware only of Language Model on One Billion Word Benchmark ...
1
vote
0answers
96 views

Can semantic paraphrasing be used for a workflow management system?

The term paraphrasing is used for converting input text into output text with small modifications on the semantic level. Paraphrasing is used by managers to distribute work items to employees. It is a ...
3
votes
2answers
127 views

Software that understands hometask in mathematics with the hometask being a text

What software can understand the following task: "A big cat needs 4 days to catch all the mice and a small cat needs 12 days. How many days need the both if they catch mice together?"?
1
vote
0answers
26 views

Sequence to sequence machine learning / NMT - converting numbers into words

I want to do some sequence to sequence modelling on source data that looks like this: /-0.013428/-0.124969/-0.13435/0.008087/-0.269241/-0.36849/ with target data ...
4
votes
2answers
130 views

How can I train model to extract custom entities from text?

I have a 100-150 words text and I want to extract particular information like location, product type, dates, specifications and price. Suppose if I arrange a training data which has a text as input ...
6
votes
1answer
103 views

Can you teach an AI through sentences?

If you taught an AI to understand sentences through usual neural network techniques. Then could you being to teach it things with sentences such as "ants are small", "the sky is blue". i.e. if you ...
7
votes
1answer
541 views

Loss function for Hierarchical Multi-label classification

I am looking to try different loss functions for a hierarchical multi-label classification problem. So far, I have been training different models or submodels like multilayer perceptron ( MLP )branch ...
1
vote
0answers
78 views

How can I create a chatbot application where the user can create its own bot?

I am trying to create a chatbot application where the user can create its own bot, like Botengine. After going through google, I saw I need some NLP API to process the user's query. As per wit.ai ...
4
votes
3answers
145 views

Does an AI exist that can write software based on a formal specification?

Does an AI (or software) exist that can automatically write software based on a formal specification of the software?
2
votes
1answer
44 views

Recognising common short forms of appliances used daily

I'm working on a chatbot for homes and would need to understand the appliance the user is talking about. Suppose the command is: Turn on the air conditioner. and another variant could be Turn on the ...
1
vote
0answers
63 views

Sentence classification and named identity detection with automatic retraining

I am learning AI and trying out my first real life AI application. What I am trying to do is taking as an input various sentences, and then classifying the sentences into one of X number of categories ...
5
votes
4answers
606 views

Is 'job title classification' rather a problem of NLP or machine learning?

first of all I want to specify the data available and what needs to be achieved: I have a huge amount of vacancies (in the millions). The information about the job title and the job description of ...
1
vote
0answers
60 views

Would Capsule Neworks and Topic Modeling used together make sense?

This is actually something I have been researching a bit on my own. Most movie scripts can be structurally analysed by using writing theory such as Dramatica. Dramatica is based upon hierarchy of ...
2
votes
0answers
36 views

Extracting referenced documents

I'm looking to write an AI that will be able to extract in text references from standards documents to assist human research. My use case is extracting the identifying numbers, for example, "AR 25-2",...
11
votes
3answers
960 views

What topologies are largely unexplored in machine learning?

Geometry and AI Matrices, cubes, layers, stacks, and hierarchies are what we could accurately call topologies. Consider topology in this context the higher level geometrical design of a learning ...
2
votes
1answer
537 views

Can AI solve jumbled words?

My question is that is there any general idea on how humans solve jumbled words? I know many people will say we match it against a commonly used words checklist mentally, but it is kind of vague. Is ...
2
votes
1answer
86 views

What are the internal concepts incorporated in IBM's Watson platform? [duplicate]

IBM's Watson acts as a template for developing chat-bots with ease (without coding), but what are the methodologies and concepts that have been used to build it?
5
votes
1answer
312 views

What algorithms does stackoverflow use for classifying duplicate questions?

Can I get details about the algorithms used for classifying questions in stackoverflow ("Questions that may already have your answer"). Most of the suggestions I get are nowhere related to the ...
2
votes
2answers
137 views

Question classification according to chapters

I have a corpus, say an instruction manual. The text in this manual is grouped into chapters and each chapter is split up into sections. For example, Chapter 1/Section 1, Chapter 1/Section 2 and so on....
3
votes
4answers
2k views

Is there something like OpenCV for voice recognition & NLP?

As you know OpenCV is a big great open-source library for image recognition and machine vision(and may further purposes like computer graphics, etc). Is there similar library in sound field(Voice ...
2
votes
1answer
69 views

Implementing AI/ML in customer service

I am working on a task where I am required to automate the customer service request channel. The process is quite typical. A customer queries about a product via email, the person on the front channel ...
3
votes
1answer
75 views

What existing tools are out there for creating chatbots from a plain text corpus and without having question, answer pairs?

I know some people will try to crucify me for asking such question here, since it's too generic, but ill give it a shot. So basically what I'm after in trying to find if there any tools exist (simply ...
3
votes
2answers
106 views

How should the output layer of an LSTM be when the output are word embeddings?

I'm having trouble grasping how to output word embeddings from an LSTM model. I'm seeing many examples using a softmax activation function on the output, but for that I would need to output one hot ...
3
votes
3answers
450 views

What is the most effective way to learn natural language processing online?

There are many books, courses, etc. out there, but not sure which path to take. So what would be the most effective way (shortest) to learn natural language processing online? p.s. I mean learning ...
2
votes
1answer
113 views

How can I build an AI with NLP that reads and understands documents?

I have to read a lot of papers, and I thought that I can use an A.I. to read them and summarize them. Maybe find one that can understand what the papers are talking about it seems a lot to ask. I ...
1
vote
1answer
65 views

Are there any references of nlp/text mining techniques for Identifying the theme of News headlines

I am looking to extract the central theme of news headline using NLP/ Text-mining, any references in this direction is of great help. For example: Inputs: BRIEF-Dynasil Corporation Of America ...
0
votes
1answer
494 views

How can I create my own Google duplex?

I am trying to create my own variant of Google duplex however, it won't make calls but just have a real time conversation. My question is, where and how to start? How do I train my model with real ...
1
vote
1answer
51 views

Recommended Modelling Technique for Influencer Marketing Scenario

I have an approximately 90,000 row dataset that has information of social media profiles which has columns for biography, follower count, language spoken, name, username and the label (to identify ...
1
vote
0answers
43 views

Number of utterances

Currently I am working with two large speech databases and I was asked to build one subset from each one in order to get two representative subsets with the same number of utterances. My question is: ...
4
votes
1answer
44 views

Do individual dimensions in vector space have meaning?

Word2vec assigns an N-dimensional vector to given words (which can be considered a form of dimensionality reduction). It turns out that, at least with a number of canonical examples, vector ...