Indexer Comparison #
Tiny Index #
Tests were performed against Jina 2.1.2.
| indexed_docs | 100 | 100 | 100 |
|---|---|---|---|
| embedding_size | 128 | 128 | 128 |
| docs_per_request | 1 | 1 | 1 |
| num_requests | 100 | 100 | 100 |
| dam_index | False | True | True |
| warmup_embeddings | False | False | True |
| index time in ms | 4 | 6 | 10 |
| search time in ms | 464 | 574 | 554 |
| index memory | 1.3 MB | 1.4 MB | 1.3 MB |
| search memory | 15.3 KB | 50.8 KB | 97.3 KB |
| p90 in ms | 4 | 5 | 5 |
| p99 in ms | 5 | 6 | 6 |
| RPS | 215.31 | 173.99 | 180.37 |
| Documents per second | 215.31 | 173.99 | 180.37 |
Small Index #
Tests were performed against Jina 2.1.2.
| indexed_docs | 10000 | 10000 | 10000 |
|---|---|---|---|
| embedding_size | 128 | 128 | 128 |
| docs_per_request | 1 | 1 | 1 |
| num_requests | 100 | 100 | 100 |
| dam_index | False | True | True |
| warmup_embeddings | False | False | True |
| index time in ms | 412 | 526 | 669 |
| search time in ms | 4712 | 1258 | 1051 |
| index memory | 1.3 MB | 1.8 MB | 1.3 MB |
| search memory | 1.1 MB | 3.5 MB | 4.0 MB |
| p90 in ms | 47 | 10 | 10 |
| p99 in ms | 48 | 13 | 12 |
| RPS | 21.22 | 79.47 | 95.10 |
| Documents per second | 21.22 | 79.47 | 95.10 |
Medium Index #
Tests were performed against Jina 2.1.2.
| indexed_docs | 100000 | 100000 | 100000 |
|---|---|---|---|
| embedding_size | 128 | 128 | 128 |
| docs_per_request | 1 | 1 | 1 |
| num_requests | 100 | 100 | 100 |
| dam_index | False | True | True |
| warmup_embeddings | False | False | True |
| index time in ms | 4369 | 5441 | 6861 |
| search time in ms | 27651 | 10250 | 5103 |
| index memory | 1.3 MB | 1.8 MB | 1.3 MB |
| search memory | 13.4 MB | 37.5 MB | 38.0 MB |
| p90 in ms | 281 | 85 | 51 |
| p99 in ms | 283 | 114 | 55 |
| RPS | 3.62 | 9.76 | 19.59 |
| Documents per second | 3.62 | 9.76 | 19.59 |
Batch Requesting #
Tests were performed against Jina 2.1.2.
| indexed_docs | 100000 | 100000 | 100000 |
|---|---|---|---|
| embedding_size | 128 | 128 | 128 |
| docs_per_request | 32 | 32 | 32 |
| num_requests | 100 | 100 | 100 |
| dam_index | False | True | True |
| warmup_embeddings | False | False | True |
| index time in ms | 4350 | 5436 | 6920 |
| search time in ms | 40605 | 28176 | 24183 |
| index memory | 1.3 MB | 1.9 MB | 1.4 MB |
| search memory | 13.4 MB | 37.5 MB | 38.0 MB |
| p90 in ms | 412 | 269 | 245 |
| p99 in ms | 414 | 288 | 247 |
| RPS | 2.46 | 3.55 | 4.14 |
| Documents per second | 78.81 | 113.57 | 132.32 |
Big Embeddings #
Tests were performed against Jina 2.1.2.
| indexed_docs | 100000 | 100000 | 100000 |
|---|---|---|---|
| embedding_size | 512 | 512 | 512 |
| docs_per_request | 1 | 1 | 1 |
| num_requests | 100 | 100 | 100 |
| dam_index | False | True | True |
| warmup_embeddings | False | False | True |
| index time in ms | 5331 | 6557 | 11407 |
| search time in ms | 69454 | 32178 | 22219 |
| index memory | 1.3 MB | 1.8 MB | 1.3 MB |
| search memory | 13.4 MB | 37.5 MB | 38.0 MB |
| p90 in ms | 698 | 242 | 241 |
| p99 in ms | 701 | 295 | 249 |
| RPS | 1.44 | 3.11 | 4.50 |
| Documents per second | 1.44 | 3.11 | 4.50 |