Questions tagged [natural-language-processing]

For questions related to natural language processing (NLP), which is concerned with the interactions between computers and human (or natural) languages, in particular how to create programs that process and analyze large amounts of natural language data.

245 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
1
vote
1answer
51 views

CAPTCHA based on text comprehension and random tokens

I developed a novel type of CAPTCHA based on text comprehension and random tokens. Given a task Pick the first pair of adjacent letters and a random token ...
1
vote
0answers
32 views

What does the outputlayer of BERT for masked language modelling look like?

In the tutorial BERT – State of the Art Language Model for NLP the masked language modeling pre-training steps are described as follows: In technical terms, the prediction of the output words ...
1
vote
0answers
26 views

How to scrape product data on supplier websites?

I'm currently trying to build a semantic scraper that can extract product information from different company websites of suppliers in the packaging industry (with as little manual customization per ...
1
vote
0answers
16 views

Is there any neural network model that can perform multiple NLP steps at once?

I realize most NLP algorithms have multiple steps. (e.g. OCR/speech rec > syntax > semantics > response logic > semantic output > natural language output) Is there any NN model that can ...
1
vote
0answers
23 views

What is the best approach for sentiment analysis when the text is very brief?

I'm working on a project to do sentiment analysis but my data is not long and properly formatted text. It's more likely to be very short sentences, e.g. tweets (in full tweet lingo), quick reviews of ...
1
vote
0answers
23 views

Building a resume recommendation for a job post?

There are few challenges I am facing when building a resume recommendation for a particular job positing. Let's say we convert the resume into a vector on n-dimensions and job description also as an n-...
1
vote
0answers
16 views

Chatbot with Context Management and Awareness

I am currently implementing a closed-domain FAQ chatbot using https://www.sbert.net/index.html as my main model for answering questions from the users. I wish to extend the functionality of the ...
1
vote
0answers
4 views

POS Tag Frequency and Language Translation

When we translate a text from one language to another, how does the frequency of various POS tags change? So let's say we have a text in English with 10% nouns, 20% adjectives, 15% adverbs, 25% verbs, ...
1
vote
0answers
13 views

Best strategy for Classification of Science Subjects. Phy, Chem , Maths and Bio? BERT, Transformers, Attention+SLTM, Self-Attention+LSTM?

I am working on a project where I have to first classify the Subjects of the given question and then the respective Chapter and then the sub-topic. In a nutshell, I have to predict the Subject, Grade ...
1
vote
0answers
17 views

Bechmark models for Text Classification / Sentiment Classification

I am currently working on a novel application in NLP where I try to classify empathic and non-empathic texts. I would like to compare the performance of my model to some benchmark models. As I am ...
1
vote
0answers
42 views

Determining if an entity in free text is 'present' or 'absent'; what is this called in NLP?

I'm processing a semi-structured scientific document and trying to extract some specific concepts. I've actually made quite good progress without machine-learning so far, but I got to a block of true ...
1
vote
0answers
77 views

How are weight matrices in attention trained?

I have been looking into transformers lately and been reading tons of tutorials. All of them address the intuition behind attention, which I understand, but they treat training the weight matrices for ...
1
vote
0answers
25 views

What are some good models to use for spelling corrections?

I used OCR to extract text from an image, but there are some spelling mistakes in it : The text is as follows : ...
1
vote
0answers
32 views

What are some programming related topics that can be solved using NLP?

I've been working on the Punctuation Restoration Problem for my Master's Thesis, however, me being primarily a programmer at heart, I wish I could use some of my NLP skills to solve issues related to ...
1
vote
0answers
92 views

How homographs is an NLP task can be treated?

A homograph - is a word that shares the same written form as another word but has a different meaning. They can be even different parts of speech. For example: close(verb) - close(adverb) lead(verb)...
1
vote
0answers
26 views

What are the best techniques to perform text simplification?

I'm evaluating the state of the art techniques to translate legal text to simple text, what are the best approaches for a non-English language (Portuguese)?
1
vote
0answers
51 views

Embedding Layer into Convolution Layer

I'm looking to encode PDF documents for deep learning such that an image representation of the PDF refers to word embeddings instead of graphic data So I've indexed a relatively small vocabulary (88 ...
1
vote
0answers
61 views

Is there an optimal way to split the text into small parts when working with co-reference resolution?

I am working with co-reference resolution in a large text. Is there an optimal way to split the text into small parts? Or the best correct procedure is to use the entire text? Just for reference, I am ...
1
vote
1answer
112 views

How can I identify bigrams and trigrams that represent concepts?

I have many text documents and I want to identify concepts in these documents in an unsupervised manner. One of my problems is that the concepts can be bigrams, trigrams, or even longer. So, for ...
1
vote
0answers
24 views

What is the score used to visualize attention in this paper?

I'm reading this paper Global-Locally Self-Attentive Dialogue State Tracker and follow through the implementation published in GLAD. I was wondering if someone can clarify what variable or score is ...
1
vote
0answers
18 views

How to autocorelate multiple variants of same text into one?

I want to improve quality of translations for open-source projects in Ukrainian language. We have multiple translations from different authors. We can also translate messages using machine ...
1
vote
0answers
29 views

Low accuracy during training for text summarization

I am trying to implement an extractive text summarization model. I am using keras and tensorflow. I have used bert sentence embeddings and the embeddings are fed into an LSTM layer and then to a Dense ...
1
vote
0answers
34 views

Two questions about the architecture of Google Bert model (in particular about parameters)

I'm looking for someone who can help me clarify a few details regarding the architecture of Bert model. Those details are necessary for me to come with a full understanding of Bert model, so your help ...
1
vote
0answers
97 views

Transformer encoding for regression

I have a string of characters encoding a molecule. I want to regress some properties of those molecules. I tried using an LSTM that encodes all one hot encdoed characters, and then I take the last ...
1
vote
0answers
88 views

Sentence Segmentation for "Bullets & Numbering"

I am trying to input text into my word processor to be split into sentences first and then into words. An example paragraph: ...
1
vote
0answers
34 views

Which NLP model to use to handle long context?

I'm trying to process product data for an e-commerce platform. The goal is to understand products' size. Just to show you some examples on how messy product dimension description is: ...
1
vote
0answers
39 views

Designing a chatbot personal project with zero coding experience, using an existing platform

My girlfriend has a masters degree in linguistics and would like to create an AI chatbot personal project to show potential employers her linguistics skills since she is struggling to find a job. ...
1
vote
0answers
46 views

Creating Text Features using word2vec

My task is to classify some texts. I have used word2vec to represent text words and I pass them to an LSTM as input. Taking into account that texts do not contain the same number of words, is it a ...
1
vote
0answers
16 views

What are the best datasets available for music information retrieval?

I am interested in doing some work in classification problems in music information retrieval. I know that there are some formats of datasets (such as MIDI, Spectrogram, Piano-roll, MusicXML, etc.) for ...
1
vote
0answers
24 views

Building a spell check model

I have customer review texts. The data consists of the the raw and manually corrected texts of the reviews. I have aligned these pairs by using similarity algorithms and matched the words on them. ...
1
vote
0answers
27 views

Are there any good resources (preferably books) about techniques used for entity extraction?

Given some natural language sentences like I would like to talk to Mr. Smith I would like to extract entities, like the person "Smith". I know that frameworks, which are capable of doing ...
1
vote
0answers
27 views

How well can NLP techniques recognize connotations in natural languages?

What is the state of the art with respect to recognizing connotations in natural languages? For instance: Trump is a better president than Obama. [Praising] Trump is the worst president ...
1
vote
0answers
18 views

What challenges are there in cross-lingual entity linking?

I am reading the paper entitled Improving Candidate Generation for Low resource Cross-Lingual Entity Linking. Cross-lingual entity linking (XEL) is the task of finding referents in a target language ...
1
vote
0answers
35 views

What are examples of tutorials and blogs for beginners to master the cross-lingual information retrieval?

Currently, I am following the Dan Jurofsky NLP Tutorial and CS 224 Stanford 2019. Can you list tutorials and blogs for beginners to master the cross-lingual information retrieval?
1
vote
0answers
19 views

What are the current research trends in recognizing narrative similarity?

I am currently working on a term paper on the topic of Narrative Similarity, based on Loizos Michael's work "Similarity of Narratives". I am trying to find the latest trends within this field of study ...
1
vote
0answers
145 views

Building a template based NLG system to generate a report from data

I am a newbie to NLP and NLG. I am tasked to develop a system to generate a report based on a given data table. The structure of the report and the flow is predefined. I have researched on several ...
1
vote
0answers
26 views

What algorithm to use for finding artists/bands in text and differentiating between artists that share the same name

Here's the data I have: Text from articles from various music blogs & music news sites (title, summary, full content, and sometimes tags). I used a couple different NLP/NER tools (nltk, ...
1
vote
0answers
55 views

Use cases for AI inside the software company

This question is a bit philosophic and is about making new use cases for software companies. Let me describe what exist for now, why it is not enough, and what is needed. I know that there are a lot ...
1
vote
0answers
95 views

Is it possible to do token classification using a model such as GPT-2?

I am trying to use PyTorch's transformers as a part of a research project to do sentiment analysis of several types of review data (laptop and restaurant). To do this, my team is taking a token-...
1
vote
0answers
62 views

Simple sequential model with LSTM which doesn't converge

I'm actually trying to create a sequential neural network in order to translate a "human" sentence in a "machine" sentence understandable by an algorithm. Like It didn't work, I've try to create a NN ...
1
vote
1answer
60 views

How to produce documents like factset blackline?

Factset blackline reports essentially can compare two 10-Q SEC filings and show you the difference between the two documents. It highlights added items in green and removed items in red + ...
1
vote
0answers
18 views

Creating a noising model for NLP that models human noising

I'm trying to create a noising model that accurately reflects how people would noise name data. I was thinking of randomly switching out characters and creating a probability over which character gets ...
1
vote
0answers
64 views

How would an AI learn the concept of the words "repeat twice"?

In a hypothetical conversation: Person A - "Repeat the word 'cat' twice". Person B - "cat cat". I'm thinking about how a human or AI can learn the concept of "...
1
vote
0answers
29 views

Methods for automated insertion of emojis into text?

I want to build a deep learning algorithm that places emojis in a extended tracts of text. The intent is to choose emojis related to the meaning of the text. Where should I start? I've read that ...
1
vote
1answer
70 views

Deep audio fingerprinting for word search

Simply speaking, I'm trying to somehow search an audio clip for a list of words, and if found, I mark the time stamps. My use-case is profanity check with a list of pre-defined profane words. Is ...
1
vote
0answers
41 views

Finetuning GPT-2 twice for particular style of writing on a particular topic

Sorry if this is a stupid question. I'm just starting out in ML and am working with gpt-2 for text generation. My situation is that I have to generate text in a particular field for eg. family ...
1
vote
0answers
24 views

Why hasn't deep learning been used for word level alignment?

I've been exploring word-level alignments tools such as MGIZA and it seems to me that there hasn't been any new tool for this problem. Are neural networks not suitable to solve this problem or simply ...
1
vote
0answers
9 views

How can we use Dependency Parsers for Negation detection

I am building a negation detection system. How to use dependency parsers for the same. I am using SPACY for dependency parser
1
vote
0answers
23 views

Language Model from missing data

I want to learn how a set of operations (my vocabulary) are composed in a dataset of algorithms (corpus). The algorithms are a sequence of higher level operations which have varying low-level ...
1
vote
0answers
29 views

Conversational AI

I'm wondering if anyone knows about any projects that break down conversations for an AI. I'll explain what I mean - I've seen a lot of hardcoded responses, but nothing that allows an AI to break a ...