GritLM/GritLM-7B
> GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.
Overview
Benchmarks
NFCorpus
Biomedical literature search from NutritionFacts.org
Corpus: 3,593 Queries: 323
Quality
ndcg at 10 0.3972
map at 10 0.1531
mrr at 10 0.6139
Performance L4 b1 c16
Corpus 1.7K tok/s
Corpus p50 2.7s
Query 312 tok/s
Query p50 206.2ms
NanoFiQA2018Retrieval
Smaller subset of the FiQA financial QA dataset
Quality
ndcg at 10 0.6289
map at 10 0.5506
mrr at 10 0.6275
Performance L4 b1 c16
Corpus 1.1K tok/s
Corpus p50 1.6s
Query 556 tok/s
Query p50 196.8ms