Skip to main content

Questions tagged [information-retrieval]

For questions related to information retrieval (IR) in the context of artificial intelligence.

Filter by
Sorted by
Tagged with
2 votes
1 answer
71 views

Why fine tuning does not work as well as RAG?

I cannot find a definite answer to this question. Suppose I want to build a QA (question answering) system on a set of personal documents. It looks that RAG (retrieval augmented generation) is the way ...
Thomas's user avatar
  • 193
0 votes
1 answer
175 views

What is the difference between RAG-Sequence Model and RAG-Token Model?

When I start to learn about RAG, I can't understand the difference between the RAG-Sequence Model and RAG-Token Model. First of all, I see that for RAG-Sequence Model we use just one document to ...
LAILA EL OUEDEGHYRY's user avatar
1 vote
0 answers
20 views

RAG can be done using langchain, Now CohereForAI's Command R +, provides similar functionality, how it is is better than langchain's implementation? [closed]

How langchain's RAG implementation is different from the CohereforAI(Command R+) RAG functionality and what edge does it provide over the langchain RAG implementation. I tried both of them, But I am ...
Andhoju Karthikeya's user avatar
0 votes
1 answer
80 views

LLMs as "fuzzy JPEGs"

We should conceptualize LLMs as very quirky and very experimental if advanced information retrieval systems (fuzzy JPEGs) according to point 7 in the screenshot below (grabbed from pmarca's Twitter ...
thanks_in_advance's user avatar
0 votes
0 answers
18 views

What is the current literature on "appending" an entire LLM model as part of the knowledge another LLM can use?

I've been studying retrieval augmented generation and vector databases recently. In a nutshell, vector based retrieval works by first dividing up input data(whether it's a string, image, etc) into ...
rasputin's user avatar
1 vote
0 answers
48 views

Why are Mistral LLMs branded as enabling RAG-QA (Retrieval-Augmented Generation for Question Answering)?

I read on https://mistral.ai/news/mistral-large/: Mistral Small benefits from the same innovation as Mistral Large regarding RAG-enablement and function calling. What do they mean by RAG-enablement? ...
Franck Dernoncourt's user avatar
0 votes
0 answers
46 views

Where I can find SOTA models of information retrieval?

Can someone tell me where I can find SOTA models of information retrieval? My task is to rank documents by given query by semantic search of embedding. I know that models like ColBERT, SPLADE solve ...
prostak's user avatar
  • 113
0 votes
0 answers
121 views

Specifying multiple sources of RAG in different formats

I am considering whether to do RAG or Fine tuning for LLM to answer questions for clients in a small business The small business is a car rental company that gets new clients call up about certain ...
dowjones123's user avatar
0 votes
0 answers
30 views

What options do I have when performing RAG on similarly phrased chunks?

I'm building a RAG pipeline to extract real estate phrases from excel documents. These phrases are short (2-5 words) and are often phrased differently. I've manually added in different phrases to each ...
codeananda's user avatar
1 vote
0 answers
300 views

Can I use Generative AI to reliably extract data (vs. Extractive AI)?

It seems that nowadays lots of people building tools to extract data from different sources (e.g. PDF reports) with the help of models like GPT-4, LLama or Falcon. I was wondering, if this really ...
T-Dog's user avatar
  • 11
0 votes
1 answer
46 views

Can I use Sentence-Bert to embed event triples?

I extracted event triples from sentences using OpenIE. Can I concatenate the components in the event triple to make it a sentence and use Sentence-Bert to embed the event? It seems no one has done ...
user900476's user avatar
0 votes
0 answers
117 views

Hierarchical Navigable Small World Graphs : Expected Number of Steps in a Layer

Paper: Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs In the Search Complexity section, the author estimates that the expected number of steps ...
p1p13 's user avatar
1 vote
2 answers
208 views

What is meant by a "relevant document" in NLP?

In natural language processing, I came across the concept of "relevant document" several times. And several analytical formulas, such as precision, recall are based on the relevant documents....
hanugm's user avatar
  • 3,890
0 votes
0 answers
21 views

Is there a survey that describes the most effective approaches for an answer retrieval problem?

I have a dataset that contains pairs of a question and an answer. My problem is to train a model that can search for the right answer from the pool of my answers given the newly input question, so ...
Việt Nguyễn's user avatar
1 vote
0 answers
41 views

What are examples of tutorials and blogs for beginners to master the cross-lingual information retrieval?

Currently, I am following the Dan Jurofsky NLP Tutorial and CS 224 Stanford 2019. Can you list tutorials and blogs for beginners to master the cross-lingual information retrieval?
DRV's user avatar
  • 1,703