Questions tagged [vector-semantics]
Vector semantics is the standard way to represent word meaning in NLP, helping us model many of the aspects of word meaning.
9
questions
0
votes
1
answer
19
views
Find keywords in a list that related with specified topic
Given list of keywords:
gyat
fee
skibidi
expenditure
payment
yapping
How to retrieve keywords that related with a topic, let's say ...
2
votes
3
answers
356
views
How is it possible that RAG embeddings implemented with a different embedding model than the pre-trained LLM can work?
I have read and seen that you can use a different embeddings model for RAG embedding vectors than was used to train the original RAG.
I can't get my head around how that can work!
How is it possible ...
- 123
0
votes
1
answer
47
views
How to create 1 embedding for text + image
I'm using Ollama to run llm's. I can create embeddings for text and images, which I store in ChromaDB. The goal of all this, is to find content which best fits a question, so I can create a good ...
3
votes
1
answer
458
views
Match two paragraphs of text
I'm building a friend finder app and I need to match people based on a paragraph of text. Here is an example of what I mean:
Person A:
I love walking and going to the beach, I also love reading and ...
- 31
0
votes
2
answers
759
views
Why shouldn't the attention matrices $W^Q$, $W^K$, $W^V$ be the same?
My question is why the attention head matrices $W^Q$, $W^K$, $W^V$ should not be the same $W = W^Q =W^K= W^V$. In my understanding of transformer-based language models one attention head is ...
3
votes
0
answers
550
views
How to work with multiple embeddings?
This is a conceptual gap that I have concerning embeddings, and would really appreciate some help closing it.
I understand when you embed a corpus for, let's say, a question-and-answer task you can ...
- 31
0
votes
0
answers
41
views
What is all necessary types of data for a bidirectional RNN to learn embeddings?
Bidirectional RNNs are used for generating the semantic vectors of the text at the sentence level and word level.
In order to train a CNN for the classification tasks, images, and labels/outputs are ...
- 3,950
0
votes
1
answer
47
views
Is there any difference between the phrases "text representation" and "text feature representation"?
Text representation, in simple words, is representing text in sensible numeric form. You can read in detail from the following paragraph
Text representation is one of the fundamental problems in text ...
- 3,950
0
votes
2
answers
470
views
Book(s) for text embedding
Text here refers to either character or word or sentence.
Is there any recent textbook that encompasses from classical methods to the modern techniques for embedding texts?
If a single textbook is ...
- 3,950