copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 369.93
Index size:  466244.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0258351590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2554222680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.4900000000, query time of that 2.4221164600, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0273344280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2701372730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.8400000000, query time of that 2.6823809420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0332115460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.3302555340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.1700000000, query time of that 3.3546174150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 77.23000000000002
Index size:  202260.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115738490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0566673470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1883.56 < 1901.23
  -> Decision False in time 0.1100000000, query time of that 0.1088980170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0068058970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0672474500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2346.38 < 2379.47
  -> Decision False in time 0.0100000000, query time of that 0.0063690600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1885.56 < 1885.87
  -> Decision False in time 0.0200000000, query time of that 0.0066738290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1820.83 < 2280.87
  -> Decision False in time 0.1800000000, query time of that 0.0201244140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2024.66 < 2095.36
  -> Decision False in time 0.0200000000, query time of that 0.0068678310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 369.28999999999996
Index size:  257312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0146183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0035105950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0264063810, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1426.49 < 1517.8
  -> Decision False in time 0.2300000000, query time of that 0.2084417120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028764830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0312794620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
974.429 < 983.668
  -> Decision False in time 0.0500000000, query time of that 0.0204716470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1718.65 < 1732.35
  -> Decision False in time 0.0300000000, query time of that 0.0029042950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1515.46 < 1521.37
  -> Decision False in time 0.0600000000, query time of that 0.0033117160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1154.54 < 1163.69
  -> Decision False in time 0.0200000000, query time of that 0.0032340320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 389.8799999999999
Index size:  257676.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0266924960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2352914500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.4100000000, query time of that 2.3620559830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0246891720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2730112820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7400000000, query time of that 2.5894572120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0268986960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.2805824840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7600000000, query time of that 2.8088265740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 111.80999999999995
Index size:  190828.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074494530, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0630375200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1764.46 < 1827.89
  -> Decision False in time 0.0900000000, query time of that 0.0898822280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0069244880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0753154630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1674.82 < 1699.03
  -> Decision False in time 0.3600000000, query time of that 0.3269374850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0072650160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1750.16 < 1812.65
  -> Decision False in time 0.5000000000, query time of that 0.0482765580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1595.42 < 1603.61
  -> Decision False in time 3.6700000000, query time of that 0.3267165090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 390.1399999999999
Index size:  243248.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0146329440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1352744660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3700000000, query time of that 1.3187475170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0156292940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1572085160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.5197058720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0157445210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1505615980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3300000000, query time of that 1.6217897560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 389.73
Index size:  207940.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0261981580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2178807180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1700000000, query time of that 2.1139452810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226228500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2243199770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4300000000, query time of that 2.2839590480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0247067820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.2889378930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9000000000, query time of that 2.8248329090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 77.5
Index size:  188624.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0509600000
  Testing...
|S| = 20
|T| = 283
Reject!
1979.29 < 2217.89
  -> Decision False in time 0.0000000000, query time of that 0.0042720340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2179.28 < 2282.85
  -> Decision False in time 0.0100000000, query time of that 0.0075721280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1298.42 < 1606.65
  -> Decision False in time 0.0300000000, query time of that 0.0246421470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0036179520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1950.18 < 1961.27
  -> Decision False in time 0.0100000000, query time of that 0.0037257130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1807.8 < 1822.68
  -> Decision False in time 0.0200000000, query time of that 0.0069692740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1529.56 < 1610.61
  -> Decision False in time 0.0800000000, query time of that 0.0039714830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1981 < 2037.39
  -> Decision False in time 0.0100000000, query time of that 0.0038060020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1311.73 < 1386.78
  -> Decision False in time 0.0100000000, query time of that 0.0033484520, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 112.2199999999998
Index size:  148912.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0115125060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0995977630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9724862960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1360.35 < 1376.51
  -> Decision False in time 0.0200000000, query time of that 0.0101183850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1081340460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1675.49 < 1686.03
  -> Decision False in time 1.1800000000, query time of that 1.0564095490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0108092060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1098522230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1074.15 < 1224.15
  -> Decision False in time 0.7200000000, query time of that 0.1011183030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 147.51999999999998
Index size:  193892.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079825950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0702001440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7600000000, query time of that 0.7030257080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080805860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1089.98 < 1101.04
  -> Decision False in time 0.0300000000, query time of that 0.0273911230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1170.43 < 1232.49
  -> Decision False in time 0.4500000000, query time of that 0.4213037790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0075429130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0785275320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1028.88 < 1087.83
  -> Decision False in time 1.0000000000, query time of that 0.0995728620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 146.75000000000045
Index size:  191728.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0037486590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0284436870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1774.35 < 1779.44
  -> Decision False in time 0.0300000000, query time of that 0.0190210980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030664180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1172.46 < 1194.02
  -> Decision False in time 0.0200000000, query time of that 0.0101440070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1401.68 < 1460.08
  -> Decision False in time 0.0500000000, query time of that 0.0245835530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0033717980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1169.48 < 1172.08
  -> Decision False in time 0.1100000000, query time of that 0.0071727460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1314.76 < 1330.27
  -> Decision False in time 0.0200000000, query time of that 0.0036553190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 390.47999999999956
Index size:  259392.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0105011180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0917254900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.8990002650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0098251870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1010193660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2200000000, query time of that 1.0436113320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0105205880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1046327210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1165.73 < 1257.39
  -> Decision False in time 1.7900000000, query time of that 0.2311089950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 111.83999999999924
Index size:  190836.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0188116667
  Testing...
|S| = 20
|T| = 283
Reject!
1496.39 < 1550
  -> Decision False in time 0.0000000000, query time of that 0.0037352070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0273443340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1667.94 < 1989.41
  -> Decision False in time 0.0300000000, query time of that 0.0273291430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030360500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1344.27 < 1373.08
  -> Decision False in time 0.0600000000, query time of that 0.0272780260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1764.12 < 1961.75
  -> Decision False in time 0.0600000000, query time of that 0.0253213600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1391.77 < 1478.04
  -> Decision False in time 0.0700000000, query time of that 0.0030641380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1532.8 < 1555.69
  -> Decision False in time 0.0200000000, query time of that 0.0034030810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1394.96 < 1414.36
  -> Decision False in time 0.4200000000, query time of that 0.0189591510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 77.0600000000004
Index size:  180420.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0245600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059986410, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0478421380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1757.08 < 1955.4
  -> Decision False in time 0.0200000000, query time of that 0.0194306210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0053997920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1733.99 < 1779.25
  -> Decision False in time 0.0100000000, query time of that 0.0056515430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1594.44 < 1681.92
  -> Decision False in time 0.0000000000, query time of that 0.0058785270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1709.4 < 1802.08
  -> Decision False in time 0.0100000000, query time of that 0.0060398000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1311.82 < 1340.35
  -> Decision False in time 0.1300000000, query time of that 0.0114576210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1656.84 < 1702.67
  -> Decision False in time 0.0000000000, query time of that 0.0053519450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 389.3299999999999
Index size:  256420.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0225381180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1947255510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.0100000000, query time of that 1.9605156320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0221216790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2164671650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3200000000, query time of that 2.1299750920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0205771230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2246207870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7700000000, query time of that 2.3152917840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 77.30999999999949
Index size:  189248.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0348600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0051208640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1438.03 < 1744.84
  -> Decision False in time 0.0400000000, query time of that 0.0281760780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2272.63 < 2298.28
  -> Decision False in time 0.0100000000, query time of that 0.0070742410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1923.63 < 1948.05
  -> Decision False in time 0.0000000000, query time of that 0.0033347530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2348.46 < 2454.85
  -> Decision False in time 0.0500000000, query time of that 0.0253335930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1471.77 < 1588.69
  -> Decision False in time 0.0100000000, query time of that 0.0042572030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0047243850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1145.68 < 1147.29
  -> Decision False in time 0.0700000000, query time of that 0.0050481370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1729.8 < 1735.38
  -> Decision False in time 0.0300000000, query time of that 0.0051012700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 388.6400000000003
Index size:  211584.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0126977420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1217890400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2600000000, query time of that 1.2210122400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0140175560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1367206770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5200000000, query time of that 1.3711276830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0144058350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1369470480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0500000000, query time of that 1.3819531930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 146.71000000000004
Index size:  191480.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0770850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028070700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1447.12 < 1465.58
  -> Decision False in time 0.0200000000, query time of that 0.0182415050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2031.77 < 2184.24
  -> Decision False in time 0.0100000000, query time of that 0.0076075480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0020796060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2013.57 < 2125.84
  -> Decision False in time 0.0100000000, query time of that 0.0024409130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1666.23 < 1675.34
  -> Decision False in time 0.0000000000, query time of that 0.0022929050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1381.81 < 1411.92
  -> Decision False in time 0.0100000000, query time of that 0.0022704450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1826.63 < 1828.42
  -> Decision False in time 0.0000000000, query time of that 0.0022656920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
986.653 < 1013.06
  -> Decision False in time 0.0100000000, query time of that 0.0021751770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 145.97000000000025
Index size:  180480.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0013533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0087281630, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0778178550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7579785330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086001320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0860950990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.8787801910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0081134530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0873347860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1772.57 < 1794.44
  -> Decision False in time 1.3900000000, query time of that 0.1448565020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 145.47000000000025
Index size:  190504.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0265733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031882710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1554.35 < 1575.32
  -> Decision False in time 0.0100000000, query time of that 0.0125505890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1565.1 < 1567.18
  -> Decision False in time 0.0100000000, query time of that 0.0044565340, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025498340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1036.99 < 1115.73
  -> Decision False in time 0.0000000000, query time of that 0.0029804060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1639.42 < 1640.85
  -> Decision False in time 0.0100000000, query time of that 0.0056453110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1940.93 < 1946.31
  -> Decision False in time 0.0100000000, query time of that 0.0029308910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1643.03 < 1709.31
  -> Decision False in time 0.0200000000, query time of that 0.0026958050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
961.697 < 1009.22
  -> Decision False in time 0.0100000000, query time of that 0.0029593180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 147.07999999999993
Index size:  187688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0088016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0040662380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0331916960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1835.14 < 1838.49
  -> Decision False in time 0.3100000000, query time of that 0.2757230870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036404310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1292.7 < 1369.77
  -> Decision False in time 0.0200000000, query time of that 0.0081645650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1725.34 < 1754.83
  -> Decision False in time 0.0300000000, query time of that 0.0194050520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0035725810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1493.05 < 1502.97
  -> Decision False in time 0.0300000000, query time of that 0.0041841210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1544.47 < 1633.57
  -> Decision False in time 0.1200000000, query time of that 0.0079553250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 391.03999999999996
Index size:  253368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066536860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0614255610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6400000000, query time of that 0.5914709740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0068448200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0668344540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.6647376000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0071586950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0685773500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7300000000, query time of that 0.6676818600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 370.5799999999999
Index size:  207588.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0046817820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0355433350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2317.55 < 2387.5
  -> Decision False in time 0.1900000000, query time of that 0.1718381550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0037684620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0406934350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1847.37 < 1861.91
  -> Decision False in time 0.4900000000, query time of that 0.2608531660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0041963210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1701.8 < 1713.75
  -> Decision False in time 0.0600000000, query time of that 0.0042854010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1751.53 < 1755.85
  -> Decision False in time 0.6400000000, query time of that 0.0344763400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 370.8199999999997
Index size:  243032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089330940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0795325160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7844266540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0089283910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0885799380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1300000000, query time of that 0.8956613970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0094786230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0877107580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1908.64 < 1925.02
  -> Decision False in time 6.2100000000, query time of that 0.6434348840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 112.52999999999884
Index size:  199748.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0095333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0044522250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0331199540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2280.47 < 2319.34
  -> Decision False in time 0.1700000000, query time of that 0.1567232050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036213230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2004.22 < 2025.45
  -> Decision False in time 0.0400000000, query time of that 0.0206971870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1594.48 < 1612.93
  -> Decision False in time 0.0100000000, query time of that 0.0038306790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1608.96 < 1652.81
  -> Decision False in time 0.0100000000, query time of that 0.0037328480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1617.45 < 1633.94
  -> Decision False in time 0.3000000000, query time of that 0.0159754430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1449 < 1509.01
  -> Decision False in time 0.1900000000, query time of that 0.0117714590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 147.26000000000022
Index size:  193888.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4495333333
  Testing...
|S| = 20
|T| = 283
Reject!
2026.26 < 2265.15
  -> Decision False in time 0.0100000000, query time of that 0.0022361240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2088.28 < 2354.17
  -> Decision False in time 0.0000000000, query time of that 0.0053348250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1520.53 < 1857.33
  -> Decision False in time 0.0100000000, query time of that 0.0054184360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1802.21 < 1837.21
  -> Decision False in time 0.0000000000, query time of that 0.0014330580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1045.77 < 1315.43
  -> Decision False in time 0.0000000000, query time of that 0.0013791570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2197.92 < 2205.09
  -> Decision False in time 0.0100000000, query time of that 0.0013758930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2008.87 < 2138.36
  -> Decision False in time 0.0000000000, query time of that 0.0014197160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1402.89 < 1461.29
  -> Decision False in time 0.0000000000, query time of that 0.0013871660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1204.11 < 1240.48
  -> Decision False in time 0.0000000000, query time of that 0.0015631230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 77.45999999999913
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1520083333
  Testing...
|S| = 20
|T| = 283
Reject!
2205.57 < 2353.88
  -> Decision False in time 0.0000000000, query time of that 0.0031520050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2577.44 < 2578.78
  -> Decision False in time 0.0100000000, query time of that 0.0054659390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2507.96 < 2518.59
  -> Decision False in time 0.0000000000, query time of that 0.0056102880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1649.62 < 1706.09
  -> Decision False in time 0.0100000000, query time of that 0.0021755730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1391.82 < 1434.96
  -> Decision False in time 0.0000000000, query time of that 0.0021048710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1857.6 < 1954.75
  -> Decision False in time 0.0000000000, query time of that 0.0025533880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1999.76 < 2101.72
  -> Decision False in time 0.0100000000, query time of that 0.0024458150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1893.64 < 1895.85
  -> Decision False in time 0.0000000000, query time of that 0.0022787700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1511.73 < 1616.34
  -> Decision False in time 0.0000000000, query time of that 0.0024575770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 368.77000000000044
Index size:  250020.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062867360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0514024030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5107821230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056957620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0577934330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.5790823030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061064570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1512.99 < 1514.51
  -> Decision False in time 0.2900000000, query time of that 0.0241258840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7500000000, query time of that 0.5797485400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 369.8700000000008
Index size:  252496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0176944360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1883967120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8600000000, query time of that 1.8097081860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0201661080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1900335240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1100000000, query time of that 1.9356858130, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0227750920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1200000000, query time of that 0.2528440050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1800000000, query time of that 2.1251190210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 145.46999999999935
Index size:  200908.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0040816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047507180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0403005650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4107363470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044343760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1409.32 < 1441.77
  -> Decision False in time 0.0100000000, query time of that 0.0056385490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1812.36 < 1959.17
  -> Decision False in time 0.0800000000, query time of that 0.0466828960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0047037130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1831.81 < 1839.57
  -> Decision False in time 0.1500000000, query time of that 0.0095837360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1683.65 < 1686.33
  -> Decision False in time 0.1400000000, query time of that 0.0097236430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 111.77000000000044
Index size:  176908.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5726933333
  Testing...
|S| = 20
|T| = 283
Reject!
1562.47 < 1678.42
  -> Decision False in time 0.0100000000, query time of that 0.0021265380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
490.466 < 513.102
  -> Decision False in time 0.0000000000, query time of that 0.0017590030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1505.29 < 1810.52
  -> Decision False in time 0.0000000000, query time of that 0.0013226720, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1619.96 < 2051.91
  -> Decision False in time 0.0000000000, query time of that 0.0012065230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1225.82 < 1342.3
  -> Decision False in time 0.0000000000, query time of that 0.0013214920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1905.99 < 1923.86
  -> Decision False in time 0.0100000000, query time of that 0.0011731230, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1771.54 < 1777.48
  -> Decision False in time 0.0000000000, query time of that 0.0013637310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2147.77 < 2266.69
  -> Decision False in time 0.0000000000, query time of that 0.0012993290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1703.62 < 2376.6
  -> Decision False in time 0.0000000000, query time of that 0.0012956830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 111.70000000000073
Index size:  186612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1227350000
  Testing...
|S| = 20
|T| = 283
Reject!
1724.14 < 1773.18
  -> Decision False in time 0.0000000000, query time of that 0.0024666190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1878.13 < 2264.72
  -> Decision False in time 0.0200000000, query time of that 0.0112723430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1831.43 < 2526.44
  -> Decision False in time 0.0000000000, query time of that 0.0062461040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1464.47 < 1488.74
  -> Decision False in time 0.0100000000, query time of that 0.0017887210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1325.63 < 1375.92
  -> Decision False in time 0.0000000000, query time of that 0.0018474970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2108.63 < 2307.44
  -> Decision False in time 0.0100000000, query time of that 0.0039759000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1093.04 < 1097.64
  -> Decision False in time 0.0100000000, query time of that 0.0018679870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1436.9 < 1698.57
  -> Decision False in time 0.0000000000, query time of that 0.0018573030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1763.31 < 1815.67
  -> Decision False in time 0.0000000000, query time of that 0.0018392360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 390.64999999999964
Index size:  257756.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0112806060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1102872680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0900000000, query time of that 1.0394541120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0118697190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1211631810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.1924552730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0126178570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1204477890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8500000000, query time of that 1.1875240420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 77.10000000000036
Index size:  187376.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5964850000
  Testing...
|S| = 20
|T| = 283
Reject!
2243.43 < 2347.36
  -> Decision False in time 0.0100000000, query time of that 0.0015322280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1846.29 < 1891.46
  -> Decision False in time 0.0000000000, query time of that 0.0010221970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2746.63 < 2884.09
  -> Decision False in time 0.0000000000, query time of that 0.0008875690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2039.34 < 2084
  -> Decision False in time 0.0100000000, query time of that 0.0008506290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
723.423 < 741.226
  -> Decision False in time 0.0000000000, query time of that 0.0008431180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2210.09 < 2249.34
  -> Decision False in time 0.0100000000, query time of that 0.0008773320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2085.17 < 2104.17
  -> Decision False in time 0.0000000000, query time of that 0.0009152660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1366.09 < 1377.37
  -> Decision False in time 0.0100000000, query time of that 0.0008210730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1659.07 < 1665.73
  -> Decision False in time 0.0000000000, query time of that 0.0007959070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 389.6200000000008
Index size:  204984.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0276698570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2602928880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7100000000, query time of that 2.6533575180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0292240420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2847959540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.0500000000, query time of that 2.9308327120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0357867160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.3603859010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5200000000, query time of that 4.1172731250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 367.97000000000116
Index size:  217684.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0830133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030066540, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0209277610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2197.81 < 2274.65
  -> Decision False in time 0.0200000000, query time of that 0.0148440220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
400.172 < 418.562
  -> Decision False in time 0.0000000000, query time of that 0.0019650490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1392.91 < 1468.02
  -> Decision False in time 0.0100000000, query time of that 0.0023551360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1324.46 < 1376.65
  -> Decision False in time 0.0100000000, query time of that 0.0022333000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1013.89 < 1023.42
  -> Decision False in time 0.0100000000, query time of that 0.0024041150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1297.64 < 1323.49
  -> Decision False in time 0.0400000000, query time of that 0.0025606170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1275.79 < 1326.14
  -> Decision False in time 0.0100000000, query time of that 0.0027267900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 146.40999999999985
Index size:  202656.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063416020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0496382810, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5200000000, query time of that 0.4814066780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0055743120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0560678080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1705.76 < 1735.58
  -> Decision False in time 0.1000000000, query time of that 0.0701960380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056827440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1150.59 < 1165.55
  -> Decision False in time 0.5100000000, query time of that 0.0370870890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1215.78 < 1294.04
  -> Decision False in time 0.1800000000, query time of that 0.0170366180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 388.7399999999998
Index size:  255160.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0087418730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0783844210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7572324150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080734620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0823625530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.8702056540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0098870520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0879888760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 0.8511150530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 110.94999999999891
Index size:  191252.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0090133870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0790681960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.7927916610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0084417740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0903551790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1305.59 < 1447.85
  -> Decision False in time 0.7900000000, query time of that 0.7401230180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0088991480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
929.034 < 1085.26
  -> Decision False in time 0.1800000000, query time of that 0.0274594830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1470.21 < 1525.56
  -> Decision False in time 0.1400000000, query time of that 0.0179407730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 390.89000000000124
Index size:  256928.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0165348890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1596371030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6100000000, query time of that 1.5645051140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0158420180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1665870590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8700000000, query time of that 1.7541599230, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0166214090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.2149982490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2100000000, query time of that 1.8426313700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 146.57999999999993
Index size:  192340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127108890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1054949290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0900000000, query time of that 1.0360371230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112367220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1194980010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.1680943300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0133763590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1144305630, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1473.06 < 1476.19
  -> Decision False in time 2.1700000000, query time of that 0.3003004800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 77.26000000000022
Index size:  167916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3982983333
  Testing...
|S| = 20
|T| = 283
Reject!
1971.11 < 1971.55
  -> Decision False in time 0.0000000000, query time of that 0.0023886880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2004.15 < 2028.6
  -> Decision False in time 0.0100000000, query time of that 0.0016804450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1935.88 < 1946.56
  -> Decision False in time 0.0000000000, query time of that 0.0013322510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2230.66 < 2240.69
  -> Decision False in time 0.0000000000, query time of that 0.0014256550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1953.14 < 2056.5
  -> Decision False in time 0.0000000000, query time of that 0.0015207890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1534.21 < 1763.36
  -> Decision False in time 0.0000000000, query time of that 0.0013708610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1602.51 < 1948.39
  -> Decision False in time 0.0100000000, query time of that 0.0013975340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1787.41 < 2147.45
  -> Decision False in time 0.0000000000, query time of that 0.0014206820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1971.53 < 2241.38
  -> Decision False in time 0.0000000000, query time of that 0.0014996950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 111.67000000000007
Index size:  183120.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0538716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031909700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2226.34 < 2229.19
  -> Decision False in time 0.0200000000, query time of that 0.0143705680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2336.34 < 2374.71
  -> Decision False in time 0.0100000000, query time of that 0.0056755040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1068.8 < 1069.26
  -> Decision False in time 0.0000000000, query time of that 0.0020196170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1197.16 < 1207.36
  -> Decision False in time 0.0200000000, query time of that 0.0070083570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1795.63 < 1827.03
  -> Decision False in time 0.0000000000, query time of that 0.0023490510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1938.8 < 1964.31
  -> Decision False in time 0.0100000000, query time of that 0.0025412670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1154.26 < 1176.15
  -> Decision False in time 0.0600000000, query time of that 0.0023797040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1815.68 < 1820.95
  -> Decision False in time 0.0400000000, query time of that 0.0026368730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 390.9899999999998
Index size:  262204.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0166265750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1464014810, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4600000000, query time of that 1.4117412390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0156881540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1628032560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7500000000, query time of that 1.6059387560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0152597430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1690508600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 1.6985734110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 112.23999999999978
Index size:  191744.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065081750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0532171160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5900000000, query time of that 0.5476281620, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0060188820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1517.78 < 1524.28
  -> Decision False in time 0.0300000000, query time of that 0.0241681140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1428.75 < 1532.72
  -> Decision False in time 0.5100000000, query time of that 0.3950280140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0066429110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1079.78 < 1190.59
  -> Decision False in time 0.0100000000, query time of that 0.0064077490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1620.9 < 1642.78
  -> Decision False in time 0.7900000000, query time of that 0.0602449840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 146.47999999999956
Index size:  185076.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2079000000
  Testing...
|S| = 20
|T| = 283
Reject!
1774.13 < 1783.41
  -> Decision False in time 0.0000000000, query time of that 0.0023406390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1251.88 < 1297.18
  -> Decision False in time 0.0100000000, query time of that 0.0041390500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2298.86 < 2334.67
  -> Decision False in time 0.0100000000, query time of that 0.0061737510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1325.84 < 1357.78
  -> Decision False in time 0.0000000000, query time of that 0.0017081790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1746.44 < 1852.66
  -> Decision False in time 0.0000000000, query time of that 0.0017860340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1179.82 < 1288.52
  -> Decision False in time 0.0000000000, query time of that 0.0017145510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1170.73 < 1193.9
  -> Decision False in time 0.0000000000, query time of that 0.0017468900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1899.56 < 1927.94
  -> Decision False in time 0.0000000000, query time of that 0.0017016420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1864.48 < 1925.43
  -> Decision False in time 0.0100000000, query time of that 0.0017246130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 390.4100000000017
Index size:  259532.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0431063420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4496150530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.5000000000, query time of that 4.4373539570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0454648430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4928355560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.9800000000, query time of that 4.8403005080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0578768170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1100000000, query time of that 0.6591631140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.8900000000, query time of that 6.8037751850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 370.0099999999984
Index size:  195360.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0122928280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1225581270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.2284004770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0141842870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1421287800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5800000000, query time of that 1.4005862040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0154103750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1508987350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9400000000, query time of that 1.4471683250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 77.81999999999971
Index size:  196136.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8091433333
  Testing...
|S| = 20
|T| = 283
Reject!
1713.36 < 1784.14
  -> Decision False in time 0.0100000000, query time of that 0.0011151800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1903.35 < 2082.7
  -> Decision False in time 0.0100000000, query time of that 0.0006917040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1951.88 < 2102.98
  -> Decision False in time 0.0000000000, query time of that 0.0006329440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2382.9 < 2385.87
  -> Decision False in time 0.0100000000, query time of that 0.0006789810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1679.5 < 1901.99
  -> Decision False in time 0.0000000000, query time of that 0.0005822900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2081.97 < 2128.32
  -> Decision False in time 0.0000000000, query time of that 0.0005805250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2103.12 < 2244.56
  -> Decision False in time 0.0100000000, query time of that 0.0005547200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2100.14 < 2251.92
  -> Decision False in time 0.0000000000, query time of that 0.0006412020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1485.68 < 1566.52
  -> Decision False in time 0.0100000000, query time of that 0.0005519080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 389.60999999999694
Index size:  251688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0174852090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1600420110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7600000000, query time of that 1.7137108570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0200077890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1991274900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0600000000, query time of that 1.9180648260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0217297450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.2145083460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3300000000, query time of that 2.1362379020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 112.45999999999913
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2858666667
  Testing...
|S| = 20
|T| = 283
Reject!
2644.86 < 2661.7
  -> Decision False in time 0.0000000000, query time of that 0.0018032320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2107.89 < 2287.34
  -> Decision False in time 0.0100000000, query time of that 0.0023234440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2212.67 < 2289.8
  -> Decision False in time 0.0100000000, query time of that 0.0012760710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1458.23 < 1496.56
  -> Decision False in time 0.0000000000, query time of that 0.0013238210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1774.38 < 1838.54
  -> Decision False in time 0.0100000000, query time of that 0.0013185540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2219.11 < 2401.04
  -> Decision False in time 0.0100000000, query time of that 0.0014058770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1527.45 < 1886.49
  -> Decision False in time 0.0000000000, query time of that 0.0015254270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1435.8 < 1505.25
  -> Decision False in time 0.0100000000, query time of that 0.0013993740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1634.33 < 1790.06
  -> Decision False in time 0.0100000000, query time of that 0.0015201080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 371.27000000000044
Index size:  236632.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0369682800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3900000000, query time of that 0.3733945250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.8400000000, query time of that 3.7887309620, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0433199610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4153574340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.4800000000, query time of that 4.2910795590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0490923880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.5681904460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.7600000000, query time of that 5.6881019620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 368.5600000000013
Index size:  252144.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059701800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0447566190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4285251010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049065330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0492357530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1715.85 < 1742.79
  -> Decision False in time 0.3700000000, query time of that 0.2385206180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049922800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0497793010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1908.64 < 1927.5
  -> Decision False in time 0.0900000000, query time of that 0.0072911610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 368.5400000000009
Index size:  252496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074470020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0653343620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6448086060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076664090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0740583580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.7337137370, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0074385410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0723355710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2017.75 < 2021.2
  -> Decision False in time 2.4600000000, query time of that 0.2178333930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.11000000000058
Index size:  197888.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2796433333
  Testing...
|S| = 20
|T| = 283
Reject!
1706.52 < 1943.28
  -> Decision False in time 0.0100000000, query time of that 0.0026026480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1743.68 < 1780.49
  -> Decision False in time 0.0000000000, query time of that 0.0021855040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1835.87 < 2267.17
  -> Decision False in time 0.0000000000, query time of that 0.0018211670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1781.04 < 2026.24
  -> Decision False in time 0.0100000000, query time of that 0.0016416750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1828.51 < 1834.19
  -> Decision False in time 0.0000000000, query time of that 0.0016534760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1804.63 < 1811.47
  -> Decision False in time 0.0000000000, query time of that 0.0016808090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1985.9 < 2023.59
  -> Decision False in time 0.0000000000, query time of that 0.0017549450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2043.02 < 2054.01
  -> Decision False in time 0.0100000000, query time of that 0.0017428970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2045.32 < 2149.05
  -> Decision False in time 0.0000000000, query time of that 0.0018432870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 77.67000000000189
Index size:  177688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1032116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0033282390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2110.05 < 2296.52
  -> Decision False in time 0.0200000000, query time of that 0.0110292180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1552 < 2059.52
  -> Decision False in time 0.0000000000, query time of that 0.0041522870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1592.75 < 1904.58
  -> Decision False in time 0.0000000000, query time of that 0.0029042670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2122.22 < 2259.53
  -> Decision False in time 0.0100000000, query time of that 0.0026958740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1447.15 < 1479.69
  -> Decision False in time 0.0000000000, query time of that 0.0029015830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1832.65 < 1863.72
  -> Decision False in time 0.0000000000, query time of that 0.0027495830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1481.14 < 1656.46
  -> Decision False in time 0.0100000000, query time of that 0.0027672880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1534.65 < 1562.3
  -> Decision False in time 0.0100000000, query time of that 0.0027925220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 370.0799999999981
Index size:  256300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000650000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0103669680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0896408030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.9084262650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0099200830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1030199050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2500000000, query time of that 1.0428444530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0107129890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0997053130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1516.65 < 1520.86
  -> Decision False in time 7.7100000000, query time of that 0.9336805870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 390.6100000000006
Index size:  254088.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0373595010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3681649380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.7000000000, query time of that 3.6453872350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0412917450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4225195220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.0800000000, query time of that 3.9293331750, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0477833720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.5261787660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.3200000000, query time of that 5.4577045180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 146.65999999999985
Index size:  194560.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0018383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066139600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0556891780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5611215430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061539570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0656127060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1222.11 < 1344.88
  -> Decision False in time 0.4000000000, query time of that 0.2982353290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0066051900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1159.55 < 1359.58
  -> Decision False in time 0.0200000000, query time of that 0.0061378410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1656.28 < 1690.88
  -> Decision False in time 0.0400000000, query time of that 0.0063739000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 371.8999999999978
Index size:  230880.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0130296250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1127284180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1700000000, query time of that 1.1307243040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0133805410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1276507550, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5200000000, query time of that 1.2928104680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0133553540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1244972320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1335.11 < 1345.83
  -> Decision False in time 3.1700000000, query time of that 0.4871475840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 112.61999999999898
Index size:  198900.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0037016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055061490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0445325560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1973.33 < 2108.48
  -> Decision False in time 0.2500000000, query time of that 0.2272519300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048425400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1522.51 < 1539.84
  -> Decision False in time 0.0700000000, query time of that 0.0458938250, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1192.18 < 1281.35
  -> Decision False in time 0.2000000000, query time of that 0.1289553600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049871520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1488.2 < 1503.94
  -> Decision False in time 0.3100000000, query time of that 0.0212945810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1610.42 < 1662.2
  -> Decision False in time 0.9500000000, query time of that 0.0601251800, with c1=5.0000000000, c2=0.1000000000
