jinaai/jina-colbert-v2 (Score)
Benchmarks
CQADupstackPhysicsRetrieval
Performance L4-SPOT b1 c16
Corpus TPS 3.3K
Corpus p50 325.6ms
Query TPS 163
Query p50 490.5ms
Performance L4 b1 c16
Corpus TPS 22.9K
Corpus p50 83.9ms
Query TPS 2.9K
Query p50 59.2ms
CosQA
Performance L4-SPOT b1 c16
Corpus TPS 798
Corpus p50 555.8ms
Query TPS 127
Query p50 364.0ms
Performance L4 b1 c16
Corpus TPS 13.4K
Corpus p50 65.7ms
Query TPS 1.6K
Query p50 60.4ms
FiQA2018
Performance L4-SPOT b1 c16
Corpus TPS 1.7K
Corpus p50 656.4ms
Query TPS 218
Query p50 412.6ms
Performance L4 b1 c16
Corpus TPS 25.8K
Corpus p50 95.6ms
Query TPS 3.0K
Query p50 60.7ms
LegalBenchConsumerContractsQA
Performance L4-SPOT b1 c16
Corpus TPS 5.8K
Corpus p50 568.2ms
Query TPS 216
Query p50 517.1ms
Performance L4 b1 c16
Corpus TPS 27.5K
Corpus p50 274.0ms
Query TPS 3.1K
Query p50 74.2ms
NFCorpus
Performance L4-SPOT b1 c16
Corpus TPS 3.0K
Corpus p50 622.8ms
Query TPS 77
Query p50 440.1ms
Performance L4 b1 c16
Corpus TPS 30.3K
Corpus p50 156.2ms
Query TPS 1.2K
Query p50 63.6ms
SCIDOCS
Performance L4-SPOT b1 c16
Corpus TPS 2.8K
Corpus p50 521.5ms
Query TPS 165
Query p50 520.0ms
Performance L4 b1 c16
Corpus TPS 26.7K
Corpus p50 108.8ms
Query TPS 2.7K
Query p50 62.0ms
SciFact
Performance L4-SPOT b1 c16
Corpus TPS 4.6K
Corpus p50 397.7ms
Query TPS 269
Query p50 436.5ms
Performance L4 b1 c16
Corpus TPS 29.3K
Corpus p50 145.2ms
Query TPS 3.9K
Query p50 65.2ms
StackOverflowQA
Performance L4-SPOT b1 c16
Corpus TPS 3.4K
Corpus p50 554.5ms
Query TPS 3.9K
Query p50 505.2ms
Performance L4 b1 c16
Corpus TPS 19.2K
Corpus p50 162.2ms
Query TPS 40.0K
Query p50 88.2ms