Indexer Comparison

Indexer Comparison #

Tiny Index #

Tests were performed against Jina 2.1.2.

indexed_docs100100100
embedding_size128128128
docs_per_request111
num_requests100100100
dam_indexFalseTrueTrue
warmup_embeddingsFalseFalseTrue
index time in ms4610
search time in ms464574554
index memory1.3 MB1.4 MB1.3 MB
search memory15.3 KB50.8 KB97.3 KB
p90 in ms455
p99 in ms566
RPS215.31173.99180.37
Documents per second215.31173.99180.37

Small Index #

Tests were performed against Jina 2.1.2.

indexed_docs100001000010000
embedding_size128128128
docs_per_request111
num_requests100100100
dam_indexFalseTrueTrue
warmup_embeddingsFalseFalseTrue
index time in ms412526669
search time in ms471212581051
index memory1.3 MB1.8 MB1.3 MB
search memory1.1 MB3.5 MB4.0 MB
p90 in ms471010
p99 in ms481312
RPS21.2279.4795.10
Documents per second21.2279.4795.10

Medium Index #

Tests were performed against Jina 2.1.2.

indexed_docs100000100000100000
embedding_size128128128
docs_per_request111
num_requests100100100
dam_indexFalseTrueTrue
warmup_embeddingsFalseFalseTrue
index time in ms436954416861
search time in ms27651102505103
index memory1.3 MB1.8 MB1.3 MB
search memory13.4 MB37.5 MB38.0 MB
p90 in ms2818551
p99 in ms28311455
RPS3.629.7619.59
Documents per second3.629.7619.59

Batch Requesting #

Tests were performed against Jina 2.1.2.

indexed_docs100000100000100000
embedding_size128128128
docs_per_request323232
num_requests100100100
dam_indexFalseTrueTrue
warmup_embeddingsFalseFalseTrue
index time in ms435054366920
search time in ms406052817624183
index memory1.3 MB1.9 MB1.4 MB
search memory13.4 MB37.5 MB38.0 MB
p90 in ms412269245
p99 in ms414288247
RPS2.463.554.14
Documents per second78.81113.57132.32

Big Embeddings #

Tests were performed against Jina 2.1.2.

indexed_docs100000100000100000
embedding_size512512512
docs_per_request111
num_requests100100100
dam_indexFalseTrueTrue
warmup_embeddingsFalseFalseTrue
index time in ms5331655711407
search time in ms694543217822219
index memory1.3 MB1.8 MB1.3 MB
search memory13.4 MB37.5 MB38.0 MB
p90 in ms698242241
p99 in ms701295249
RPS1.443.114.50
Documents per second1.443.114.50