Questions tagged [vector-semantics]

Vector semantics is the standard way to represent word meaning in NLP, helping us model many of the aspects of word meaning.

Filter by
Sorted by
Tagged with
3 votes
1 answer
245 views

Match two paragraphs of text

I'm building a friend finder app and I need to match people based on a paragraph of text. Here is an example of what I mean: Person A: I love walking and going to the beach, I also love reading and ...
Dom's user avatar
  • 31
0 votes
2 answers
499 views

Why shouldn't the attention matrices $W^Q$, $W^K$, $W^V$ be the same?

My question is why the attention head matrices $W^Q$, $W^K$, $W^V$ should not be the same $W = W^Q =W^K= W^V$. In my understanding of transformer-based language models one attention head is ...
Hans-Peter Stricker's user avatar
3 votes
0 answers
405 views

How to work with multiple embeddings?

This is a conceptual gap that I have concerning embeddings, and would really appreciate some help closing it. I understand when you embed a corpus for, let's say, a question-and-answer task you can ...
Ian Murray's user avatar
0 votes
0 answers
73 views

Word Embeddings but for Logical reasoning in custom knowledge GPT-3.5 bot

So I have created a chatbot using GPT-3.5 turbo. I have a vector database that holds vector embeddings of brands, ratings, commission percentages, outlets, tags, etc. Here's how the system is designed....
Shahrukh Khan's user avatar
0 votes
0 answers
40 views

What is all necessary types of data for a bidirectional RNN to learn embeddings?

Bidirectional RNNs are used for generating the semantic vectors of the text at the sentence level and word level. In order to train a CNN for the classification tasks, images, and labels/outputs are ...
hanugm's user avatar
  • 3,840
0 votes
1 answer
45 views

Is there any difference between the phrases "text representation" and "text feature representation"?

Text representation, in simple words, is representing text in sensible numeric form. You can read in detail from the following paragraph Text representation is one of the fundamental problems in text ...
hanugm's user avatar
  • 3,840
0 votes
2 answers
413 views

Book(s) for text embedding

Text here refers to either character or word or sentence. Is there any recent textbook that encompasses from classical methods to the modern techniques for embedding texts? If a single textbook is ...
hanugm's user avatar
  • 3,840