mixedbread-ai/mxbai-rerank-base-v2 (Score)
Benchmarks
CQADupstackPhysicsRetrieval
Performance L4 b1 c16
Query TPS 4.1K
Query p50 593.2ms
CosQA
Performance L4 b1 c16
Query TPS 2.1K
Query p50 444.7ms
LegalBenchConsumerContractsQA
Performance L4 b1 c16
Query TPS 14.6K
Query p50 450.9ms
SCIDOCS
Performance L4 b1 c16
Query TPS 7.0K
Query p50 457.1ms
StackOverflowQA
Performance L4 b1 c16
Query TPS 11.4K
Query p50 534.8ms