copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 78.51
Index size:  395556.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1200600000
  Testing...
|S| = 20
|T| = 283
Reject!
821.461 < 824.982
  -> Decision False in time 0.0100000000, query time of that 0.0043125130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2216.46 < 2421.1
  -> Decision False in time 0.0100000000, query time of that 0.0025992940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1628.76 < 2882.93
  -> Decision False in time 0.0100000000, query time of that 0.0039284750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2275.71 < 2295.25
  -> Decision False in time 0.0100000000, query time of that 0.0015038170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1171.37 < 1238.65
  -> Decision False in time 0.0100000000, query time of that 0.0025081220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1052.77 < 1071.21
  -> Decision False in time 0.0300000000, query time of that 0.0077704100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1357.56 < 1373.62
  -> Decision False in time 0.0400000000, query time of that 0.0027148780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1531.49 < 1557.04
  -> Decision False in time 0.0400000000, query time of that 0.0028084030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1873.94 < 2755.58
  -> Decision False in time 0.0000000000, query time of that 0.0017533460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.91
Index size:  201692.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.6319750000
  Testing...
|S| = 20
|T| = 283
Reject!
2007.81 < 2562.96
  -> Decision False in time 0.0000000000, query time of that 0.0012118200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2033.59 < 2222.38
  -> Decision False in time 0.0100000000, query time of that 0.0010347910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1770.44 < 1860.14
  -> Decision False in time 0.0000000000, query time of that 0.0009497940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1873.22 < 2005.48
  -> Decision False in time 0.0000000000, query time of that 0.0009029090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1865.45 < 1940.11
  -> Decision False in time 0.0100000000, query time of that 0.0009368840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1085.62 < 1162.78
  -> Decision False in time 0.0000000000, query time of that 0.0009154550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
977.52 < 1249.24
  -> Decision False in time 0.0100000000, query time of that 0.0009460810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2313.68 < 2367.23
  -> Decision False in time 0.0000000000, query time of that 0.0009878850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2600.49 < 2657.54
  -> Decision False in time 0.0100000000, query time of that 0.0008512700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 300.18
Index size:  266200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0155342890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1473011290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4400000000, query time of that 1.3928827130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0141585600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1590738880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7900000000, query time of that 1.6073532670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0175950680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1639044270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1984.84 < 2049.49
  -> Decision False in time 3.3600000000, query time of that 0.6591856020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 293.68999999999994
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1078100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027904080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0197109750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1117.18 < 1140.22
  -> Decision False in time 0.0200000000, query time of that 0.0122838910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0019419570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1757.67 < 1762.17
  -> Decision False in time 0.0100000000, query time of that 0.0024171470, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
906.615 < 915.04
  -> Decision False in time 0.0000000000, query time of that 0.0022668620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
937.146 < 940.13
  -> Decision False in time 0.0100000000, query time of that 0.0022269800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1314.66 < 1320.67
  -> Decision False in time 0.0000000000, query time of that 0.0023726940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1244.83 < 1255.43
  -> Decision False in time 0.0100000000, query time of that 0.0023602070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 129.44000000000005
Index size:  205568.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1058750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031780510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1869.3 < 1923.9
  -> Decision False in time 0.0100000000, query time of that 0.0038761610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1136.34 < 1163.63
  -> Decision False in time 0.0100000000, query time of that 0.0121375840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1144.29 < 1183.55
  -> Decision False in time 0.0000000000, query time of that 0.0020098520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2233.98 < 2253.58
  -> Decision False in time 0.0100000000, query time of that 0.0021575760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
996.376 < 1009.99
  -> Decision False in time 0.0100000000, query time of that 0.0045103030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1609.59 < 1662.73
  -> Decision False in time 0.0000000000, query time of that 0.0022228280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1289.12 < 1309.03
  -> Decision False in time 0.0100000000, query time of that 0.0023526290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1134.19 < 1183.06
  -> Decision False in time 0.0000000000, query time of that 0.0021712020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 293.05999999999995
Index size:  235220.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0111494710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0997739160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.9773168560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0120502170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1128696260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1939.74 < 1958.57
  -> Decision False in time 0.1700000000, query time of that 0.1692662360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0119670630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1132222270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2106.12 < 2123.28
  -> Decision False in time 0.4300000000, query time of that 0.0641820770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 129.81999999999994
Index size:  203560.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0410000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033175560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0228583530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1192.88 < 1247.22
  -> Decision False in time 0.0500000000, query time of that 0.0439403800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0024716050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1394.78 < 1437.08
  -> Decision False in time 0.0200000000, query time of that 0.0083099240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
951.319 < 962.228
  -> Decision False in time 0.0300000000, query time of that 0.0123366720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1044.26 < 1060.25
  -> Decision False in time 0.0100000000, query time of that 0.0028051500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1335.6 < 1386.54
  -> Decision False in time 0.0900000000, query time of that 0.0043474750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1159.84 < 1195
  -> Decision False in time 0.0200000000, query time of that 0.0028714250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 129.85000000000014
Index size:  181788.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0019800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0077279720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0638599370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6434192170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0075311920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0740258680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1727.84 < 1808.86
  -> Decision False in time 0.0400000000, query time of that 0.0394500680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0072448010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1560.33 < 1621.11
  -> Decision False in time 0.5900000000, query time of that 0.0560545560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
850.008 < 865.043
  -> Decision False in time 0.2200000000, query time of that 0.0230758290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 109.63000000000011
Index size:  188548.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0103997030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0943196960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.9212505270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0111607710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1108926780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.0794687340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0119441810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1097428560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1759.22 < 1848.18
  -> Decision False in time 0.5900000000, query time of that 0.0773929220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 300.8699999999999
Index size:  251336.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0142117850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1337133300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3100000000, query time of that 1.2648691040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0146217270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1484297240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5400000000, query time of that 1.4434237920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0144353250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1556331300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0100000000, query time of that 1.5311465220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 109.50999999999976
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0142583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041419140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0318635440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1194.03 < 1238.53
  -> Decision False in time 0.1800000000, query time of that 0.1601259670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1149.04 < 1190.95
  -> Decision False in time 0.0000000000, query time of that 0.0034199940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1240.82 < 1249.46
  -> Decision False in time 0.0100000000, query time of that 0.0075183480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
852.486 < 929.308
  -> Decision False in time 0.0100000000, query time of that 0.0036779330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1529.62 < 1549.36
  -> Decision False in time 0.0100000000, query time of that 0.0038078860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1211.27 < 1222.65
  -> Decision False in time 0.0200000000, query time of that 0.0041293410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1725.39 < 1732.69
  -> Decision False in time 0.0100000000, query time of that 0.0040063830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 130.0
Index size:  184616.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083976180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0699394500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2021.26 < 2067.77
  -> Decision False in time 0.1200000000, query time of that 0.1110082410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0077550790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0818080630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.8269553960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0085850870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0818893560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
438.749 < 531.135
  -> Decision False in time 0.5900000000, query time of that 0.0620896490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 293.24000000000024
Index size:  236028.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0050247250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0404496980, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.3951914520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0044655340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1380.54 < 1382.56
  -> Decision False in time 0.0600000000, query time of that 0.0330790840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1541.43 < 1562.36
  -> Decision False in time 0.6400000000, query time of that 0.3794763870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0047050230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1411.56 < 1424.15
  -> Decision False in time 0.6500000000, query time of that 0.0381549170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1840.32 < 1862.07
  -> Decision False in time 0.6000000000, query time of that 0.0349599880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 294.9200000000001
Index size:  232384.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057181320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0467994340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4608366910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0054164360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0526785610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.5273197270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0054105460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0530993890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1644.65 < 1647.15
  -> Decision False in time 3.4400000000, query time of that 0.2195614580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 293.6600000000003
Index size:  245468.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0152118150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1376618480, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3700000000, query time of that 1.3249822710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0154290860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1504111260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6500000000, query time of that 1.5298684320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0156113670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1677753840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2122.56 < 2123.28
  -> Decision False in time 1.0100000000, query time of that 0.1998249420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 129.01000000000022
Index size:  205144.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0222933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0037004520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0269066940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1568.05 < 1622.64
  -> Decision False in time 0.0900000000, query time of that 0.0807317550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028998250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1170.8 < 1191.95
  -> Decision False in time 0.0600000000, query time of that 0.0255585500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1423.68 < 1446.71
  -> Decision False in time 0.0200000000, query time of that 0.0094259490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1346.81 < 1354.28
  -> Decision False in time 0.0000000000, query time of that 0.0031861650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
779.551 < 843.729
  -> Decision False in time 0.2000000000, query time of that 0.0097764250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1304.37 < 1340.4
  -> Decision False in time 0.0100000000, query time of that 0.0034150960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 290.46000000000004
Index size:  230412.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0060133333
  Testing...
|S| = 20
|T| = 283
Reject!
1018.22 < 1027.72
  -> Decision False in time 0.0100000000, query time of that 0.0041954490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0323149330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3192425930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0038597340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0378563090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2504.16 < 2701.59
  -> Decision False in time 0.1700000000, query time of that 0.0879659110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0038084600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1884 < 1923.1
  -> Decision False in time 0.0900000000, query time of that 0.0078781640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1412.58 < 1415.96
  -> Decision False in time 0.1000000000, query time of that 0.0074526490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 108.71999999999935
Index size:  198044.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0045583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066444230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0541694340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5200589250, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0059542250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0608678340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1783.83 < 1834.8
  -> Decision False in time 0.3200000000, query time of that 0.2505556930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060281830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0605297610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1744.27 < 1773.22
  -> Decision False in time 1.0100000000, query time of that 0.0766173610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 108.15999999999985
Index size:  171080.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0085051680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0763048090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7900000000, query time of that 0.7495782270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0077748760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1277.53 < 1281.44
  -> Decision False in time 0.0900000000, query time of that 0.0751649710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.8700515250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0088807410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0871201530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1293.19 < 1331.76
  -> Decision False in time 0.7100000000, query time of that 0.0782459430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 127.6299999999992
Index size:  193572.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065069620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0526825670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5124095560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057769660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0598724130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1260.42 < 1268.48
  -> Decision False in time 0.0400000000, query time of that 0.0364994190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060083180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1696.11 < 1727.87
  -> Decision False in time 0.3500000000, query time of that 0.0275237900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1341.79 < 1342.75
  -> Decision False in time 0.5900000000, query time of that 0.0458122650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 108.22000000000025
Index size:  185996.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0713883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028349960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0191834420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1524.23 < 1533.88
  -> Decision False in time 0.0300000000, query time of that 0.0218155150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1580.17 < 1590.89
  -> Decision False in time 0.0000000000, query time of that 0.0020658180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1183.46 < 1221.68
  -> Decision False in time 0.0000000000, query time of that 0.0020582870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
960.393 < 992.92
  -> Decision False in time 0.0100000000, query time of that 0.0021416890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1880.8 < 1892.1
  -> Decision False in time 0.0000000000, query time of that 0.0021473600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1110.79 < 1129.99
  -> Decision False in time 0.0100000000, query time of that 0.0022709890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1300.46 < 1310.25
  -> Decision False in time 0.0100000000, query time of that 0.0023820920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 301.03000000000065
Index size:  259408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0330273480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3305637720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.3100000000, query time of that 3.2593460630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0358550570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3490044060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.6500000000, query time of that 3.5080843430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0352346030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.4612430770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.4700000000, query time of that 4.8701453560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 108.14000000000033
Index size:  184940.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0066183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055989910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0423966110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4246344980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0048209720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0504161050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
728.087 < 1210.74
  -> Decision False in time 0.0300000000, query time of that 0.0230188110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049080300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1450.48 < 1535.22
  -> Decision False in time 0.1000000000, query time of that 0.0105432520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1319.97 < 1323.54
  -> Decision False in time 0.0200000000, query time of that 0.0049271170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 78.30000000000018
Index size:  174520.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0784650000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0034420010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2235.57 < 2248.67
  -> Decision False in time 0.0100000000, query time of that 0.0059325900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
799.609 < 804.66
  -> Decision False in time 0.0200000000, query time of that 0.0115064440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1513.93 < 1535.88
  -> Decision False in time 0.0000000000, query time of that 0.0025618380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1664.09 < 1703.98
  -> Decision False in time 0.0100000000, query time of that 0.0054274090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1845.46 < 1897.56
  -> Decision False in time 0.0100000000, query time of that 0.0053078160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1232.56 < 1271.12
  -> Decision False in time 0.0100000000, query time of that 0.0028671040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2490.59 < 2566.52
  -> Decision False in time 0.0000000000, query time of that 0.0026641510, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
869.664 < 1029.5
  -> Decision False in time 0.0100000000, query time of that 0.0027188100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 77.92000000000007
Index size:  177716.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0181316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062749060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0536998070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1576.11 < 2207.36
  -> Decision False in time 0.4800000000, query time of that 0.4485108500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0056122900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1762.37 < 1776.39
  -> Decision False in time 0.0300000000, query time of that 0.0255888100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1988.48 < 2003.42
  -> Decision False in time 0.0200000000, query time of that 0.0179113380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1928.56 < 1937.47
  -> Decision False in time 0.0200000000, query time of that 0.0061969790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1184.67 < 1286.91
  -> Decision False in time 0.0300000000, query time of that 0.0061310480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1882.32 < 1893.49
  -> Decision False in time 0.6800000000, query time of that 0.0524943120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 298.89999999999964
Index size:  257708.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066940270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0523158280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1708.08 < 1736.46
  -> Decision False in time 0.4500000000, query time of that 0.4146988750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0054926990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0608071390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.6016580460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0067258060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0597651560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1458.06 < 1559.93
  -> Decision False in time 0.8700000000, query time of that 0.0667013830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 78.17000000000007
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0248516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057530250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0446865070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1090.37 < 1106.8
  -> Decision False in time 0.0700000000, query time of that 0.0698839610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1819.74 < 1857.98
  -> Decision False in time 0.0100000000, query time of that 0.0048849030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
674.1 < 813.886
  -> Decision False in time 0.0500000000, query time of that 0.0332194780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1237.76 < 1426
  -> Decision False in time 0.1700000000, query time of that 0.1176023940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1125.78 < 1127.7
  -> Decision False in time 0.0100000000, query time of that 0.0051498570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1353.77 < 1381.05
  -> Decision False in time 0.1000000000, query time of that 0.0105006140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1257.19 < 1273.19
  -> Decision False in time 0.0800000000, query time of that 0.0075473530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 77.71000000000004
Index size:  139004.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3601916667
  Testing...
|S| = 20
|T| = 283
Reject!
1343.12 < 1370.73
  -> Decision False in time 0.0100000000, query time of that 0.0020911550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1732.83 < 2154.77
  -> Decision False in time 0.0000000000, query time of that 0.0045836040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1400.95 < 1404.18
  -> Decision False in time 0.0100000000, query time of that 0.0016887420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1104.89 < 1256.75
  -> Decision False in time 0.0000000000, query time of that 0.0014574450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2145.92 < 2179.92
  -> Decision False in time 0.0000000000, query time of that 0.0014336980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1305.91 < 1316.72
  -> Decision False in time 0.0000000000, query time of that 0.0014448960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1123.75 < 1225.79
  -> Decision False in time 0.0000000000, query time of that 0.0014151410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1776.57 < 1777.19
  -> Decision False in time 0.0100000000, query time of that 0.0013830320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2121.36 < 2322.91
  -> Decision False in time 0.0000000000, query time of that 0.0014302330, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 108.3100000000004
Index size:  189872.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3337050000
  Testing...
|S| = 20
|T| = 283
Reject!
1037.43 < 1123.97
  -> Decision False in time 0.0000000000, query time of that 0.0022384900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
822.369 < 853.265
  -> Decision False in time 0.0000000000, query time of that 0.0016115410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1195.54 < 1270.21
  -> Decision False in time 0.0100000000, query time of that 0.0067839520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1281.66 < 1306.49
  -> Decision False in time 0.0000000000, query time of that 0.0014168470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
609.724 < 618.391
  -> Decision False in time 0.0100000000, query time of that 0.0014127810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1379.15 < 1410.96
  -> Decision False in time 0.0000000000, query time of that 0.0014329980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1687.74 < 1744.28
  -> Decision False in time 0.0000000000, query time of that 0.0014195070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1812.81 < 1907
  -> Decision False in time 0.0000000000, query time of that 0.0014671160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
830.599 < 945.313
  -> Decision False in time 0.0100000000, query time of that 0.0014850370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 291.6100000000006
Index size:  230072.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0120038980, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1080063640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1200000000, query time of that 1.0652157670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0126077700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1231174460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4700000000, query time of that 1.2231987990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0139901080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1208500270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9200000000, query time of that 1.2290794780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 301.2399999999998
Index size:  251612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127966710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1166161460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1916270130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0150112200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1439172330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6100000000, query time of that 1.3945719180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0160468980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1478204750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1805.17 < 1920.02
  -> Decision False in time 5.7300000000, query time of that 1.0023482580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 128.51999999999953
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0140600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040331130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0300803740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1694.3 < 1716.89
  -> Decision False in time 0.0800000000, query time of that 0.0720976260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034062630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1729.75 < 1756.56
  -> Decision False in time 0.0200000000, query time of that 0.0111398360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
796.021 < 876.865
  -> Decision False in time 0.0900000000, query time of that 0.0427154820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0035808900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1494.46 < 1530.79
  -> Decision False in time 0.2500000000, query time of that 0.0115088020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1588.96 < 1594.86
  -> Decision False in time 0.0100000000, query time of that 0.0038285390, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 299.89999999999964
Index size:  231664.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226942490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.2130492120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1200000000, query time of that 2.0607748610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226838430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2260019930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4800000000, query time of that 2.3372405980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0245148640, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.2740959680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2105.89 < 2122.87
  -> Decision False in time 1.1200000000, query time of that 0.3783341880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 291.5799999999999
Index size:  197488.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074910120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0694166200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7200000000, query time of that 0.6784004990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0075817180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0797391730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.7979843740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0082019190, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0773976020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6600000000, query time of that 0.7864403430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 78.34999999999854
Index size:  196344.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0429700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038095000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0309414560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2230.95 < 2253.51
  -> Decision False in time 0.0200000000, query time of that 0.0245401430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1723.74 < 1736.08
  -> Decision False in time 0.0100000000, query time of that 0.0031645330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
877.489 < 894.718
  -> Decision False in time 0.0000000000, query time of that 0.0032048490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1079.68 < 1155.66
  -> Decision False in time 0.0100000000, query time of that 0.0034868510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1897.61 < 2025.76
  -> Decision False in time 0.0100000000, query time of that 0.0038231440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
951.805 < 959.822
  -> Decision False in time 0.0300000000, query time of that 0.0037168800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1942.49 < 1946.11
  -> Decision False in time 0.0000000000, query time of that 0.0036273150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 301.4800000000014
Index size:  249540.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0266347040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2700401270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7300000000, query time of that 2.6816008410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0304747370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.2987069400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1100000000, query time of that 2.9192128200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0330539850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.3797690950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.2200000000, query time of that 3.9761258650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 128.86999999999898
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4908500000
  Testing...
|S| = 20
|T| = 283
Reject!
1799.37 < 1859.77
  -> Decision False in time 0.0000000000, query time of that 0.0016521890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
990.942 < 995.195
  -> Decision False in time 0.0100000000, query time of that 0.0027453460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1631.5 < 1730.98
  -> Decision False in time 0.0100000000, query time of that 0.0068668800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1385.21 < 1834.26
  -> Decision False in time 0.0000000000, query time of that 0.0011534870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1148.93 < 1226.36
  -> Decision False in time 0.0100000000, query time of that 0.0012104350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1309.32 < 1360.19
  -> Decision False in time 0.0000000000, query time of that 0.0013278990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1867.23 < 1905.18
  -> Decision False in time 0.0100000000, query time of that 0.0013656180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1370.81 < 1674.32
  -> Decision False in time 0.0000000000, query time of that 0.0013650520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1943.33 < 2005.36
  -> Decision False in time 0.0100000000, query time of that 0.0013480890, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.59000000000015
Index size:  168960.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2244766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0024154420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1292.72 < 1409.79
  -> Decision False in time 0.0000000000, query time of that 0.0030214500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2287.16 < 2329.75
  -> Decision False in time 0.0100000000, query time of that 0.0033890150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0017347730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
584.669 < 629.982
  -> Decision False in time 0.0000000000, query time of that 0.0017974870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
748.864 < 749.344
  -> Decision False in time 0.0100000000, query time of that 0.0017384150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1760.14 < 1778.5
  -> Decision False in time 0.0100000000, query time of that 0.0017385390, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1351.89 < 1456.39
  -> Decision False in time 0.0000000000, query time of that 0.0016990410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1240.93 < 1322.8
  -> Decision False in time 0.0100000000, query time of that 0.0018724100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 292.65999999999985
Index size:  232044.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072268240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0593642440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6300000000, query time of that 0.5824211780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0064956340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0666250130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.6612690870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0069124870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0676845010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1289.7 < 1296.37
  -> Decision False in time 1.1000000000, query time of that 0.0907909270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 300.21999999999935
Index size:  259048.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0209520360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1896398760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8900000000, query time of that 1.8409044500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0207051870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2204631920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3200000000, query time of that 2.1355371650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0237651560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.2307766360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1805.17 < 1920.02
  -> Decision False in time 8.1300000000, query time of that 2.3420461250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.86999999999898
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7971850000
  Testing...
|S| = 20
|T| = 283
Reject!
942.984 < 973.867
  -> Decision False in time 0.0000000000, query time of that 0.0014598210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1422.26 < 1458.91
  -> Decision False in time 0.0100000000, query time of that 0.0011465190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1724.47 < 1905.86
  -> Decision False in time 0.0000000000, query time of that 0.0012239720, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1893 < 1989.02
  -> Decision False in time 0.0000000000, query time of that 0.0010594630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2031.92 < 2082.59
  -> Decision False in time 0.0100000000, query time of that 0.0009476760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1083.32 < 1106.92
  -> Decision False in time 0.0000000000, query time of that 0.0008597790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1651.96 < 1743.38
  -> Decision False in time 0.0100000000, query time of that 0.0009948360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2003.96 < 2021.85
  -> Decision False in time 0.0000000000, query time of that 0.0010035430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2384.97 < 3058.1
  -> Decision False in time 0.0100000000, query time of that 0.0008298050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 109.19000000000051
Index size:  139512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.6026950000
  Testing...
|S| = 20
|T| = 283
Reject!
1012.29 < 1119.94
  -> Decision False in time 0.0000000000, query time of that 0.0019626690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1244.84 < 1265.33
  -> Decision False in time 0.0100000000, query time of that 0.0023666900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1466.69 < 1509.78
  -> Decision False in time 0.0000000000, query time of that 0.0031536270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1803.16 < 1908.43
  -> Decision False in time 0.0100000000, query time of that 0.0011894550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1132.33 < 1147.28
  -> Decision False in time 0.0000000000, query time of that 0.0011099240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1996.22 < 2139.01
  -> Decision False in time 0.0100000000, query time of that 0.0011968560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1104.19 < 1146.67
  -> Decision False in time 0.0000000000, query time of that 0.0012361870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1166.45 < 1268.95
  -> Decision False in time 0.0100000000, query time of that 0.0012433010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2104.1 < 2105.27
  -> Decision False in time 0.0000000000, query time of that 0.0012818100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 300.03999999999905
Index size:  248828.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0165432370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1560123300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6100000000, query time of that 1.5493242090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0188001670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1852173190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9300000000, query time of that 1.7687478100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0195704650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1811568110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6500000000, query time of that 2.0483237080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 109.22999999999956
Index size:  185212.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1569733333
  Testing...
|S| = 20
|T| = 283
Reject!
1353.36 < 1589.19
  -> Decision False in time 0.0100000000, query time of that 0.0024473800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1392.7 < 1438.05
  -> Decision False in time 0.0100000000, query time of that 0.0056073730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1140.82 < 1182.79
  -> Decision False in time 0.0100000000, query time of that 0.0088514420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1780.8 < 1787.11
  -> Decision False in time 0.0100000000, query time of that 0.0016502500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
863.236 < 910.81
  -> Decision False in time 0.0000000000, query time of that 0.0016850890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1683.76 < 1700.63
  -> Decision False in time 0.0200000000, query time of that 0.0036712850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1094.79 < 1157.53
  -> Decision False in time 0.0100000000, query time of that 0.0016941220, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1534.51 < 1558.99
  -> Decision False in time 0.0000000000, query time of that 0.0018432520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1561.5 < 1591.81
  -> Decision False in time 0.0100000000, query time of that 0.0018896870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 109.17000000000007
Index size:  175132.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0034666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0073279370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0636605290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6800000000, query time of that 0.6266138710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0074947970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0724573780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1816.91 < 1856.24
  -> Decision False in time 0.0200000000, query time of that 0.0164106540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0073904010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0710648230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1185.49 < 1190.35
  -> Decision False in time 0.5800000000, query time of that 0.0543294040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 293.27000000000044
Index size:  243840.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0252450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0034095370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0250826800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1129.08 < 1181.45
  -> Decision False in time 0.0200000000, query time of that 0.0177752840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026559360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1780.23 < 1939.44
  -> Decision False in time 0.0000000000, query time of that 0.0032408290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1398.56 < 1428.62
  -> Decision False in time 0.0800000000, query time of that 0.0307483480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1593.59 < 1614.44
  -> Decision False in time 0.0700000000, query time of that 0.0028566390, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
639.781 < 666.023
  -> Decision False in time 0.0200000000, query time of that 0.0031553330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1416.82 < 1447.02
  -> Decision False in time 0.0700000000, query time of that 0.0031024240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 299.2600000000002
Index size:  259068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0095531380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0893716240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.8847695170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0099521030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1038387020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1900000000, query time of that 1.0345220390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0104234940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1039622230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1458.06 < 1559.93
  -> Decision False in time 1.2800000000, query time of that 0.1612433030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 300.1399999999994
Index size:  202508.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0115524120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1022306670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0400000000, query time of that 1.0024186820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117988690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1153453950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4300000000, query time of that 1.1722890490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0129168140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1135674480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2106.12 < 2123.28
  -> Decision False in time 3.5300000000, query time of that 0.4834718210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 128.64999999999964
Index size:  188384.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0065650000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049364900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0374883530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4200000000, query time of that 0.3769073410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0040312650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1041.73 < 1050.71
  -> Decision False in time 0.0200000000, query time of that 0.0081901290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1917.75 < 1976.24
  -> Decision False in time 0.0400000000, query time of that 0.0228041910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1489.81 < 1494.19
  -> Decision False in time 0.0700000000, query time of that 0.0043866030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1460.13 < 1482.47
  -> Decision False in time 0.3400000000, query time of that 0.0203443860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
938.057 < 945.715
  -> Decision False in time 0.1100000000, query time of that 0.0091622340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 293.880000000001
Index size:  218740.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0203557990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1924790750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9100000000, query time of that 1.8536319740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0197973260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2064443180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2200000000, query time of that 2.0729696340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0231195980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.2507470810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6200000000, query time of that 2.5038779900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.6200000000008
Index size:  196224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0335916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0047395870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1521.88 < 1548.64
  -> Decision False in time 0.0200000000, query time of that 0.0138971320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2521.79 < 2673.77
  -> Decision False in time 0.1000000000, query time of that 0.0887206260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039737570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0438855850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2284.87 < 2287.85
  -> Decision False in time 0.0100000000, query time of that 0.0090570010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2176.49 < 2323.94
  -> Decision False in time 0.0100000000, query time of that 0.0046878720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1092.82 < 1114.18
  -> Decision False in time 0.0600000000, query time of that 0.0040866260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1158.66 < 1181.75
  -> Decision False in time 0.0000000000, query time of that 0.0045927010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 301.2599999999984
Index size:  252920.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072230430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0678975950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6576712210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0079526510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0800369660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1679.52 < 1693.03
  -> Decision False in time 0.4200000000, query time of that 0.3699812060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0078680070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1080.76 < 1083.3
  -> Decision False in time 0.5200000000, query time of that 0.0492297030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9300000000, query time of that 0.7590918120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 292.25
Index size:  194300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0095884220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0813332560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7838672260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0092177670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0923460140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.9201360850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0095845490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0904682320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6800000000, query time of that 0.8913290680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 302.03999999999905
Index size:  259816.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0161281250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1591970970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.6275231620, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0190139980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1851942680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0500000000, query time of that 1.9143547010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0189477620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.2149126600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3700000000, query time of that 2.2011267490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 301.7099999999991
Index size:  201960.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0090370620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0772889870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7767473130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0087419620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0914582030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.9140702130, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0095301610, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.1029567980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1805.51 < 1808.88
  -> Decision False in time 0.1100000000, query time of that 0.0188345400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 108.42000000000007
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0279450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0036739190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0257250250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2528864310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029267110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1585.04 < 1591.69
  -> Decision False in time 0.0600000000, query time of that 0.0244838840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1669.13 < 1710.3
  -> Decision False in time 0.0200000000, query time of that 0.0093303730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0031622970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1185.98 < 1203.28
  -> Decision False in time 0.0700000000, query time of that 0.0033190390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
904.048 < 1004.39
  -> Decision False in time 0.0000000000, query time of that 0.0031766670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 128.59000000000015
Index size:  190044.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2536466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0023389010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1275.09 < 1322.15
  -> Decision False in time 0.0100000000, query time of that 0.0059039070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1196.8 < 1280.44
  -> Decision False in time 0.0000000000, query time of that 0.0020046410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2143.38 < 2231.16
  -> Decision False in time 0.0000000000, query time of that 0.0015967930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1120.58 < 1123.53
  -> Decision False in time 0.0100000000, query time of that 0.0016783510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1309.55 < 1309.58
  -> Decision False in time 0.0000000000, query time of that 0.0015306220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1037.23 < 1071.82
  -> Decision False in time 0.0000000000, query time of that 0.0018658860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
892.863 < 919.861
  -> Decision False in time 0.0100000000, query time of that 0.0018242980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2219.26 < 2333.69
  -> Decision False in time 0.0000000000, query time of that 0.0017472920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 292.84000000000015
Index size:  241200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0313084240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2972188460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9400000000, query time of that 2.8951342420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0308847940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3600000000, query time of that 0.3284462670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.3600000000, query time of that 3.2340555840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0330362710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.4027506980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1734.97 < 1769.38
  -> Decision False in time 6.6400000000, query time of that 3.2794345360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 128.63000000000102
Index size:  204908.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0036933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056237280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0455588360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1839.41 < 1848.66
  -> Decision False in time 0.3500000000, query time of that 0.3162988310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049698430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0517021640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1192.27 < 1290.75
  -> Decision False in time 0.0300000000, query time of that 0.0214093510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0053884550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1918.44 < 1993.61
  -> Decision False in time 0.7900000000, query time of that 0.0506707230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1247.34 < 1276.22
  -> Decision False in time 0.4000000000, query time of that 0.0263329760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 128.5
Index size:  184360.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0103684920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0896784950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.9020369500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0098143710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1062734840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2100000000, query time of that 1.0484261510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0116335970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1090918690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1982.74 < 2005.61
  -> Decision False in time 0.4300000000, query time of that 0.0617967110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 300.5499999999993
Index size:  254500.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0131724920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1082684180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1600000000, query time of that 1.1073266860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0123149250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1288271110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4300000000, query time of that 1.2701311160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0140539730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.1269595640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1503.4 < 1524.31
  -> Decision False in time 6.8400000000, query time of that 1.1228020110, with c1=5.0000000000, c2=0.1000000000
