Questions tagged [natural-language-processing]

For questions related to natural language processing, which concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

Filter by
Sorted by
Tagged with
1
vote
0answers
96 views

Can semantic paraphrasing be used for a workflow management system?

The term paraphrasing is used for converting input text into output text with small modifications on the semantic level. Paraphrasing is used by managers to distribute work items to employees. It is a ...
3
votes
2answers
125 views

Software that understands hometask in mathematics with the hometask being a text

What software can understand the following task: "A big cat needs 4 days to catch all the mice and a small cat needs 12 days. How many days need the both if they catch mice together?"?
1
vote
0answers
26 views

Sequence to sequence machine learning / NMT - converting numbers into words

I want to do some sequence to sequence modelling on source data that looks like this: /-0.013428/-0.124969/-0.13435/0.008087/-0.269241/-0.36849/ with target data ...
4
votes
2answers
118 views

How can I train model to extract custom entities from text?

I have a 100-150 words text and I want to extract particular information like location, product type, dates, specifications and price. Suppose if I arrange a training data which has a text as input ...
6
votes
1answer
101 views

Can you teach an AI through sentences?

If you taught an AI to understand sentences through usual neural network techniques. Then could you being to teach it things with sentences such as "ants are small", "the sky is blue". i.e. if you ...
7
votes
1answer
439 views

Loss function for Hierarchical Multi-label classification

I am looking to try different loss functions for a hierarchical multi-label classification problem. So far, I have been training different models or submodels like multilayer perceptron ( MLP )branch ...
2
votes
1answer
44 views

Recognising common short forms of appliances used daily

I'm working on a chatbot for homes and would need to understand the appliance the user is talking about. Suppose the command is: Turn on the air conditioner. and another variant could be Turn on the ...
1
vote
0answers
63 views

Sentence classification and named identity detection with automatic retraining

I am learning AI and trying out my first real life AI application. What I am trying to do is taking as an input various sentences, and then classifying the sentences into one of X number of categories ...
5
votes
4answers
512 views

Is 'job title classification' rather a problem of NLP or machine learning?

first of all I want to specify the data available and what needs to be achieved: I have a huge amount of vacancies (in the millions). The information about the job title and the job description of ...
1
vote
0answers
57 views

Would Capsule Neworks and Topic Modeling used together make sense?

This is actually something I have been researching a bit on my own. Most movie scripts can be structurally analysed by using writing theory such as Dramatica. Dramatica is based upon hierarchy of ...
2
votes
0answers
36 views

Extracting referenced documents

I'm looking to write an AI that will be able to extract in text references from standards documents to assist human research. My use case is extracting the identifying numbers, for example, "AR 25-2",...
11
votes
3answers
865 views

What topologies are largely unexplored in machine learning?

Geometry and AI Matrices, cubes, layers, stacks, and hierarchies are what we could accurately call topologies. Consider topology in this context the higher level geometrical design of a learning ...
2
votes
1answer
438 views

Can AI solve jumbled words?

My question is that is there any general idea on how humans solve jumbled words? I know many people will say we match it against a commonly used words checklist mentally, but it is kind of vague. Is ...
2
votes
1answer
83 views

What are the internal concepts incorporated in IBM's Watson platform? [duplicate]

IBM's Watson acts as a template for developing chat-bots with ease (without coding), but what are the methodologies and concepts that have been used to build it?
5
votes
1answer
293 views

What algorithms does stackoverflow use for classifying duplicate questions?

Can I get details about the algorithms used for classifying questions in stackoverflow ("Questions that may already have your answer"). Most of the suggestions I get are nowhere related to the ...
2
votes
2answers
123 views

Question classification according to chapters

I have a corpus, say an instruction manual. The text in this manual is grouped into chapters and each chapter is split up into sections. For example, Chapter 1/Section 1, Chapter 1/Section 2 and so on....
3
votes
4answers
2k views

Is there something like OpenCV for voice recognition & NLP?

As you know OpenCV is a big great open-source library for image recognition and machine vision(and may further purposes like computer graphics, etc). Is there similar library in sound field(Voice ...
2
votes
1answer
69 views

Implementing AI/ML in customer service

I am working on a task where I am required to automate the customer service request channel. The process is quite typical. A customer queries about a product via email, the person on the front channel ...
3
votes
1answer
71 views

What existing tools are out there for creating chatbots from a plain text corpus and without having question, answer pairs?

I know some people will try to crucify me for asking such question here, since it's too generic, but ill give it a shot. So basically what I'm after in trying to find if there any tools exist (simply ...
3
votes
2answers
104 views

How should the output layer of an LSTM be when the output are word embeddings?

I'm having trouble grasping how to output word embeddings from an LSTM model. I'm seeing many examples using a softmax activation function on the output, but for that I would need to output one hot ...
3
votes
3answers
430 views

What is the most effective way to learn natural language processing online?

There are many books, courses, etc. out there, but not sure which path to take. So what would be the most effective way (shortest) to learn natural language processing online? p.s. I mean learning ...
2
votes
1answer
111 views

How can I build an AI with NLP that reads and understands documents?

I have to read a lot of papers, and I thought that I can use an A.I. to read them and summarize them. Maybe find one that can understand what the papers are talking about it seems a lot to ask. I ...
1
vote
1answer
58 views

Are there any references of nlp/text mining techniques for Identifying the theme of News headlines

I am looking to extract the central theme of news headline using NLP/ Text-mining, any references in this direction is of great help. For example: Inputs: BRIEF-Dynasil Corporation Of America ...
0
votes
1answer
485 views

How can I create my own Google duplex?

I am trying to create my own variant of Google duplex however, it won't make calls but just have a real time conversation. My question is, where and how to start? How do I train my model with real ...
1
vote
1answer
51 views

Recommended Modelling Technique for Influencer Marketing Scenario

I have an approximately 90,000 row dataset that has information of social media profiles which has columns for biography, follower count, language spoken, name, username and the label (to identify ...
1
vote
0answers
36 views

Number of utterances

Currently I am working with two large speech databases and I was asked to build one subset from each one in order to get two representative subsets with the same number of utterances. My question is: ...
4
votes
1answer
44 views

Do individual dimensions in vector space have meaning?

Word2vec assigns an N-dimensional vector to given words (which can be considered a form of dimensionality reduction). It turns out that, at least with a number of canonical examples, vector ...
-2
votes
1answer
106 views

I need a word database… Any qualities I should look for?

I need a word database to train from. I found a word2vec JS word vector database, but I need a method to teach it which words go in which patterns. Please note that I am not asking to have you ...
4
votes
3answers
133 views

Sentiment Analysis

Can we define the feeling of the human through conversations with an AI? Something like a "confessional," disregarding human possibilities to lie. Below, I have the categories joyful, sadness, anger, ...
1
vote
0answers
24 views

Commercial API Q: is there an api for converting vision tags into a caption?

There are many machine learning api for scanning images but they just return a bunch of tags. https://azure.microsoft.com/en-gb/services/cognitive-services/computer-vision/ ...
3
votes
1answer
50 views

What are development tests used for?

This is a theoretical question. I am newbie to artificial intelligence and machine learning, and the more I read the more I like this. So far, I have been reading about evaluation of language models (...
2
votes
0answers
82 views

NLP proved against US legal texts

I'm new to AI development and am looking for a quality algorithm (potentially nlp?) implementation proved against US legal texts. Obviously some training would need to be done, but I've found little ...
3
votes
1answer
858 views

Seq2Seq dialogs predicts only most common words like `you` after couple of epoches

I'm training Seq2Seq model on OpenSubtitles dialogs - Cornell-Movie-Dialogs-Corpus. My work based on the following papers (but currently I'm not implemented Attention yet): Sequence to Sequence ...
2
votes
2answers
234 views

Two chatbots - One teaches another

I am seeking the information for this kind of chatbot architecture : There are two chatbots. One plays the role of teacher, and another is a student who is learning. The goal is to test the student's ...
0
votes
2answers
70 views

What is easier or more efficient to summarize voice or text? [DP/RN]

If possible consider the relationship between implementation difficulty and accuracy in voice examples or simply chat conversations. And currently, what are the directions on algorithms like Deep ...
2
votes
2answers
61 views

Intuition on how word embeddings bring information to a network

How is it that word embedding layer (say word2vec) brings more insights to the network compared to a simple one hot encoded layer? I understand how word embedding carry some semantic meaning, but it ...
3
votes
2answers
66 views

Represent sense/meaning of sentences mathematically

I am absolutely new in AI area. I would like to know how to mathematically/logically represent the sense of sentences like: ...
1
vote
0answers
249 views

Analogies and similarity

The more I think about machine learning the more I realize the importance of finding similarities by using analogies as a way of learning. If I want to categorize words into hierarchical tree this ...
5
votes
1answer
128 views

Methods to tell if a question can be answered from a paragraph

I'm working on a project related to machine Q&A, using the SQuAD dataset. I've implemented a neural-net solution for finding answers in the provided context paragraph, but the system (obviously) ...
1
vote
2answers
216 views

How to find the subject in a text?

I often develop bots and I need to understand what some people are saying. Examples: - I want an apple - I want an a p p l e How do I find the object (apple)? I honestly don't know where to start ...
1
vote
1answer
70 views

How is the word embedding represented in the paper “Recurrent neural network based language model”?

I'm reading "Recurrent neural network based language model" of Mikolov et al. (2010). Although the article is straight forward, I'm not sure how word embedding $w(t)$ is obtained: The reason I wonder ...
1
vote
2answers
87 views

Existing programs that find out words with same meanings

I'm wondering if these 2 specific programs already exist and if not how hard would it be to write them: A program that would figure out (by only "reading" large amounts of texts in human language 1 ...
2
votes
3answers
754 views

How could a chat bot learn synonyms?

I have started to make a chatbot. It has a list of greetings that it understands and responds to with its own list of greetings. How could a bot learn a new greeting or a synonym for a word it ...
2
votes
1answer
181 views

How can I improve this word-prediction AI?

I'm relatively new to AI, and I've tried to create one that "speaks". Here's how it works: 1. Get training data e.g 'Jim ran to the shop to buy candy' 2. The data gets split into overlapping 'chains' ...
3
votes
2answers
94 views

Figure out the meaning of words

Imagine two languages that have only these words: Man = 1, deer = 2, eat = 3, grass = 4 And you would form all sentences possible from these words: ...
0
votes
4answers
727 views

Google Translate: Different translations for the same text

I don't understand why Google Translate translates the same text in different ways. Here is the Wikipedia page of the 1973 film "Enter the Dragon". You can see that its traditional Chinese title is: ...
12
votes
3answers
15k views

Sentence similarity in Python

I am working on a problem where I need to determine whether two sentences are similar or not. I implemented a solution using BM25 algorithm and wordnet synsets for determining syntactic & ...
4
votes
1answer
417 views

How could you generate sentences from lists of facts

Lets pretend we had a list of facts (similar to prolog tuples) that define some knowledge about some entities. e.g. doing(clean, data) done(collect, data) todo(train, model) todo(write, paper) What ...
1
vote
0answers
109 views

Natural language processing with a continuous dependent variable

I have a large number of observations. Each observation contains: dependent variable: a scores ranging from 0 - 100 independent variable: a large article I want to know which words or phrases ...
4
votes
2answers
2k views

Has Capsule Networks or similar systems been used for NLP?

Capsule Networks seem to be a good solution for problems, which make up hierarchical complexity ( ( (eyes, nose, ears -> face); (fingers, nails, palm -> hand) ) -> human). NLP domain is a very clear ...