copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 247.13
Index size:  457596.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1068566667
  Testing...
|S| = 20
|T| = 283
Reject!
1236.05 < 1286.19
  -> Decision False in time 0.0200000000, query time of that 0.0100876260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
831.026 < 839.324
  -> Decision False in time 0.0500000000, query time of that 0.0275618560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
780.195 < 794.168
  -> Decision False in time 0.0100000000, query time of that 0.0085401320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
939.814 < 944.144
  -> Decision False in time 0.0000000000, query time of that 0.0028547460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
824.933 < 859.748
  -> Decision False in time 0.0000000000, query time of that 0.0030392010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1698.13 < 1753.35
  -> Decision False in time 0.0100000000, query time of that 0.0051738530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1513.65 < 1525.03
  -> Decision False in time 0.0100000000, query time of that 0.0028689120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
706.888 < 708.797
  -> Decision False in time 0.0100000000, query time of that 0.0026157970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
859.627 < 898.261
  -> Decision False in time 0.0100000000, query time of that 0.0029973360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 76.33000000000004
Index size:  201692.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2219766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0123548230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1116.38 < 1171.38
  -> Decision False in time 0.0100000000, query time of that 0.0043837980, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2249.57 < 2359.42
  -> Decision False in time 0.0000000000, query time of that 0.0022794110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1744.76 < 1752.78
  -> Decision False in time 0.0100000000, query time of that 0.0022881050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
772.15 < 808.332
  -> Decision False in time 0.0000000000, query time of that 0.0022435690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2100.68 < 2268.32
  -> Decision False in time 0.0100000000, query time of that 0.0023911530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
921.454 < 924.314
  -> Decision False in time 0.0000000000, query time of that 0.0021423940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1080.74 < 1192.22
  -> Decision False in time 0.0100000000, query time of that 0.0022168480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1297.76 < 1306.7
  -> Decision False in time 0.0000000000, query time of that 0.0022770800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 71.77999999999997
Index size:  187364.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3645433333
  Testing...
|S| = 20
|T| = 283
Reject!
1211.02 < 1215.17
  -> Decision False in time 0.0100000000, query time of that 0.0074773690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1021.93 < 1031.1
  -> Decision False in time 0.0000000000, query time of that 0.0032302640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1257.33 < 1291.51
  -> Decision False in time 0.0100000000, query time of that 0.0023401310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1858.89 < 1879.46
  -> Decision False in time 0.0000000000, query time of that 0.0019486010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1150.68 < 1230.94
  -> Decision False in time 0.0000000000, query time of that 0.0018951760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1200.24 < 1287.12
  -> Decision False in time 0.0100000000, query time of that 0.0019201180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1148.48 < 1238.7
  -> Decision False in time 0.0000000000, query time of that 0.0019250410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1459.5 < 1481.17
  -> Decision False in time 0.0000000000, query time of that 0.0018755460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1403.4 < 1482.97
  -> Decision False in time 0.0100000000, query time of that 0.0018128960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 253.51999999999998
Index size:  245608.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084789360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0676112510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6600000000, query time of that 0.6043479700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0087565390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0667793360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1787.46 < 2363.05
  -> Decision False in time 0.3100000000, query time of that 0.2371255840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1435.2 < 1473.39
  -> Decision False in time 0.0800000000, query time of that 0.0066834910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1988.97 < 2034.32
  -> Decision False in time 0.3000000000, query time of that 0.0263875420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1921.7 < 1923.58
  -> Decision False in time 2.1800000000, query time of that 0.1571428590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 72.84000000000003
Index size:  196372.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0452966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0053002960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0386027430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1060.35 < 1142.57
  -> Decision False in time 0.0600000000, query time of that 0.0530476360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1326.27 < 1353.21
  -> Decision False in time 0.0100000000, query time of that 0.0037970920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1252.9 < 1307.41
  -> Decision False in time 0.0100000000, query time of that 0.0075424030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1288.4 < 1355.57
  -> Decision False in time 0.0100000000, query time of that 0.0035228270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1463.57 < 1491.07
  -> Decision False in time 0.0600000000, query time of that 0.0036805140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1318.07 < 1348.13
  -> Decision False in time 0.0600000000, query time of that 0.0034970390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1651.73 < 1674.91
  -> Decision False in time 0.0800000000, query time of that 0.0034544260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 268.23
Index size:  252336.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0284831170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2261206290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9600000000, query time of that 1.9040655540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0237164800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2054620530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1600000000, query time of that 1.9794701550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0261774030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.2223134380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4900000000, query time of that 2.2390509190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 105.7800000000002
Index size:  190548.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0133583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0077703730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0382469420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1123.81 < 1156.53
  -> Decision False in time 0.1400000000, query time of that 0.1210073520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035920590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1707.43 < 1721.5
  -> Decision False in time 0.0100000000, query time of that 0.0074952740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1308.23 < 1313.74
  -> Decision False in time 0.0700000000, query time of that 0.0297409710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1233.18 < 1234.02
  -> Decision False in time 0.0300000000, query time of that 0.0035935430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1580.62 < 1608.53
  -> Decision False in time 0.0100000000, query time of that 0.0037832330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1504.55 < 1578.1
  -> Decision False in time 0.4100000000, query time of that 0.0179328230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 258.52
Index size:  210592.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127991480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0804872220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7800000000, query time of that 0.7223714810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0095605060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0821234760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.7326573220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0081599660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.0831618450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1497.42 < 1504.06
  -> Decision False in time 4.4900000000, query time of that 0.3896526490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 104.45999999999981
Index size:  204324.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0018200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0128253470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0824086660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7800000000, query time of that 0.7253182150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0116151770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1459.29 < 1773.44
  -> Decision False in time 0.1100000000, query time of that 0.0737922460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1495.43 < 1531.88
  -> Decision False in time 0.2400000000, query time of that 0.1905241040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.0083725200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1672.48 < 1695.89
  -> Decision False in time 0.0900000000, query time of that 0.0085033560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1553.18 < 1566.32
  -> Decision False in time 2.7400000000, query time of that 0.2468873150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 67.21000000000004
Index size:  177768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0850766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062278650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2185.08 < 2716.45
  -> Decision False in time 0.0100000000, query time of that 0.0094787070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1769.22 < 1885.83
  -> Decision False in time 0.0100000000, query time of that 0.0078085110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031205940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2046.57 < 2054.16
  -> Decision False in time 0.0100000000, query time of that 0.0034651890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2576.64 < 2820.4
  -> Decision False in time 0.0100000000, query time of that 0.0068166670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1070.96 < 1109.11
  -> Decision False in time 0.0100000000, query time of that 0.0030854900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1129.17 < 1184.38
  -> Decision False in time 0.0000000000, query time of that 0.0031631280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2186.95 < 2220.31
  -> Decision False in time 0.0100000000, query time of that 0.0031845270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 114.47000000000025
Index size:  192188.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2544766667
  Testing...
|S| = 20
|T| = 283
Reject!
1299.65 < 1619.27
  -> Decision False in time 0.0000000000, query time of that 0.0048438070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
729.168 < 770.702
  -> Decision False in time 0.0000000000, query time of that 0.0054473660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2077.24 < 2146.13
  -> Decision False in time 0.0100000000, query time of that 0.0064015200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1601.46 < 1621.52
  -> Decision False in time 0.0000000000, query time of that 0.0020835840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1200.73 < 1202.82
  -> Decision False in time 0.0100000000, query time of that 0.0021034280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1410.71 < 1522.62
  -> Decision False in time 0.0000000000, query time of that 0.0022126270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
573.632 < 590.706
  -> Decision False in time 0.0100000000, query time of that 0.0021154560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1197.54 < 1221.51
  -> Decision False in time 0.0000000000, query time of that 0.0021578270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2067.26 < 2078.83
  -> Decision False in time 0.0000000000, query time of that 0.0020061220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 259.8299999999999
Index size:  234084.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0061783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079252420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1520.13 < 1539.36
  -> Decision False in time 0.0200000000, query time of that 0.0169662730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3283457650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049032670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0399822400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1177.23 < 1185.55
  -> Decision False in time 0.1300000000, query time of that 0.0577310930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1380.76 < 1397.24
  -> Decision False in time 0.0100000000, query time of that 0.0035157180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1788.31 < 1793.61
  -> Decision False in time 0.1100000000, query time of that 0.0075914180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2190.14 < 2206.68
  -> Decision False in time 0.1100000000, query time of that 0.0076815030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 67.92000000000007
Index size:  195568.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0236716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086752790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0533096020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1497.24 < 1558.51
  -> Decision False in time 0.0200000000, query time of that 0.0241676870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0055278080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1046.09 < 1080.79
  -> Decision False in time 0.0100000000, query time of that 0.0054332760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1424.54 < 1470.15
  -> Decision False in time 0.0000000000, query time of that 0.0052650650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2598.83 < 2636.68
  -> Decision False in time 0.0100000000, query time of that 0.0052487290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1661.02 < 1870.79
  -> Decision False in time 0.0200000000, query time of that 0.0051486520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
784.876 < 874.465
  -> Decision False in time 0.1000000000, query time of that 0.0102434700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 90.32999999999993
Index size:  190952.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0707516667
  Testing...
|S| = 20
|T| = 283
Reject!
1955.54 < 1956.85
  -> Decision False in time 0.0000000000, query time of that 0.0041309610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1739.73 < 1752.99
  -> Decision False in time 0.0300000000, query time of that 0.0207136010, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1735.44 < 1760.65
  -> Decision False in time 0.0300000000, query time of that 0.0234044740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1672.63 < 1693.19
  -> Decision False in time 0.0000000000, query time of that 0.0023762670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1258.7 < 1290.26
  -> Decision False in time 0.0100000000, query time of that 0.0026232480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1310.25 < 1351.9
  -> Decision False in time 0.0100000000, query time of that 0.0026293330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1083.9 < 1156.43
  -> Decision False in time 0.0100000000, query time of that 0.0025392800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1452.18 < 1559.71
  -> Decision False in time 0.0200000000, query time of that 0.0026411180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1110.43 < 1225.57
  -> Decision False in time 0.0000000000, query time of that 0.0024688630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 240.25999999999976
Index size:  246928.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0207243330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1602665070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4900000000, query time of that 1.4319570690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0177298370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1600985460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7200000000, query time of that 1.4962668650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0180390710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.1591190860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8500000000, query time of that 1.4546882180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 68.48000000000002
Index size:  186596.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5738033333
  Testing...
|S| = 20
|T| = 283
Reject!
1382.16 < 1422.09
  -> Decision False in time 0.0100000000, query time of that 0.0043732460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1676.89 < 1940.08
  -> Decision False in time 0.0100000000, query time of that 0.0022329050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1276.8 < 1364.97
  -> Decision False in time 0.0100000000, query time of that 0.0020650990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1415.27 < 1452.17
  -> Decision False in time 0.0000000000, query time of that 0.0017916540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1125.58 < 1197.53
  -> Decision False in time 0.0000000000, query time of that 0.0016694770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1138.78 < 1240.3
  -> Decision False in time 0.0100000000, query time of that 0.0017016080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1165.23 < 1176.98
  -> Decision False in time 0.0000000000, query time of that 0.0017463340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2101.78 < 2102.88
  -> Decision False in time 0.0000000000, query time of that 0.0016306870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1868.48 < 1891.79
  -> Decision False in time 0.0100000000, query time of that 0.0015483930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 129.8800000000001
Index size:  130972.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0415583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075740160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1195.53 < 1282.59
  -> Decision False in time 0.0200000000, query time of that 0.0200108040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1736.14 < 1808.02
  -> Decision False in time 0.0400000000, query time of that 0.0274329100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1090.52 < 1095.85
  -> Decision False in time 0.0000000000, query time of that 0.0027257140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
660.566 < 693.289
  -> Decision False in time 0.0600000000, query time of that 0.0182600180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1462.88 < 1510.27
  -> Decision False in time 0.0000000000, query time of that 0.0025891770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1385.52 < 1391.08
  -> Decision False in time 0.0200000000, query time of that 0.0026744900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
621.783 < 666.815
  -> Decision False in time 0.0000000000, query time of that 0.0030177590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1125.63 < 1127.94
  -> Decision False in time 0.0500000000, query time of that 0.0026574080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 278.7600000000002
Index size:  256488.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117985030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0910432030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.8130834170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0099546090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0919942300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.8787275820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.0119317920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.0830582510, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1644.65 < 1647.15
  -> Decision False in time 1.9600000000, query time of that 0.2269444940, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 96.81999999999971
Index size:  201776.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0119239090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0865109950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7702874260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0106186890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0891702310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.8094389780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0108094920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1054.31 < 1088.21
  -> Decision False in time 0.3500000000, query time of that 0.0371067490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
888.171 < 951.735
  -> Decision False in time 1.0300000000, query time of that 0.1064997200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 242.2599999999993
Index size:  238904.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084689950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0612275730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5421047360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0082435770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0657199290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2163.51 < 2177.32
  -> Decision False in time 0.4600000000, query time of that 0.3195309460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060729080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1669.94 < 1689.39
  -> Decision False in time 0.5800000000, query time of that 0.0419047720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1644.65 < 1647.15
  -> Decision False in time 0.1300000000, query time of that 0.0115400850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 92.38000000000011
Index size:  188640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0037183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0105649060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0740227790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6548621370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1909.81 < 1914.16
  -> Decision False in time 0.0100000000, query time of that 0.0083267620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0744772540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2095.68 < 2190.14
  -> Decision False in time 0.0700000000, query time of that 0.0599249160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0068766750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1155.68 < 1220.95
  -> Decision False in time 0.2600000000, query time of that 0.0232766300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1485.34 < 1488.18
  -> Decision False in time 0.1000000000, query time of that 0.0138307790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 110.61999999999989
Index size:  183548.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0064600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064108340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0482216600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4400000000, query time of that 0.3903491080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061064010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1480.15 < 1488.77
  -> Decision False in time 0.0600000000, query time of that 0.0293369990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1578.81 < 1678.07
  -> Decision False in time 0.0600000000, query time of that 0.0331600340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0047930730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1504.97 < 1523.24
  -> Decision False in time 0.2200000000, query time of that 0.0132967580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1307.58 < 1341.61
  -> Decision False in time 0.0700000000, query time of that 0.0044056040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 252.67000000000007
Index size:  239136.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0250283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0045982450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1371.44 < 1398.12
  -> Decision False in time 0.0200000000, query time of that 0.0237703910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
837.725 < 866.745
  -> Decision False in time 0.0300000000, query time of that 0.0300882520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029796150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1225.19 < 1227.28
  -> Decision False in time 0.0200000000, query time of that 0.0062866100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1018.4 < 1021.54
  -> Decision False in time 0.0100000000, query time of that 0.0061598940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
919.592 < 929.634
  -> Decision False in time 0.0400000000, query time of that 0.0029892180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1771.49 < 1788.3
  -> Decision False in time 0.0100000000, query time of that 0.0033771210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
992.758 < 1048.69
  -> Decision False in time 0.0200000000, query time of that 0.0028874070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 302.5100000000002
Index size:  258264.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0143654280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1581.73 < 1586.92
  -> Decision False in time 0.0600000000, query time of that 0.0581143340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0700000000, query time of that 1.0063285890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0143717330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1120002410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.1016207120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0133246840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1087481710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 1.0546926130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 117.86999999999989
Index size:  191688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0039533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072322910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0508767200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4575508120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0066246530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1661.02 < 1871.07
  -> Decision False in time 0.0200000000, query time of that 0.0123196650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2177.37 < 2177.76
  -> Decision False in time 0.0900000000, query time of that 0.0489051580, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049742620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1607.49 < 1612.91
  -> Decision False in time 0.1700000000, query time of that 0.0127539480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1253.09 < 1265.1
  -> Decision False in time 0.2500000000, query time of that 0.0154980200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 108.51999999999953
Index size:  173976.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0221016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048766010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0341646210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1744.9 < 1819.2
  -> Decision False in time 0.0400000000, query time of that 0.0349136140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038475810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
937.345 < 967.949
  -> Decision False in time 0.0500000000, query time of that 0.0200439950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
926.308 < 927.618
  -> Decision False in time 0.0500000000, query time of that 0.0184176600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0031597620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1104.31 < 1116.26
  -> Decision False in time 0.1100000000, query time of that 0.0140472050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
848.435 < 867.892
  -> Decision False in time 0.1300000000, query time of that 0.0079355250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 92.53999999999996
Index size:  188672.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3350850000
  Testing...
|S| = 20
|T| = 283
Reject!
1663.36 < 1729.25
  -> Decision False in time 0.0000000000, query time of that 0.0032529550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1089.41 < 1121.18
  -> Decision False in time 0.0100000000, query time of that 0.0032369280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1501.37 < 1558.11
  -> Decision False in time 0.0000000000, query time of that 0.0022747220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1293.71 < 1410.39
  -> Decision False in time 0.0000000000, query time of that 0.0021546900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1159.82 < 1289.77
  -> Decision False in time 0.0100000000, query time of that 0.0018976110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
680.099 < 825.301
  -> Decision False in time 0.0000000000, query time of that 0.0019886220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1225.07 < 1233.25
  -> Decision False in time 0.0000000000, query time of that 0.0019183450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
972.497 < 1160.44
  -> Decision False in time 0.0100000000, query time of that 0.0019102590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1898.49 < 1903.79
  -> Decision False in time 0.0000000000, query time of that 0.0018485080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 234.97999999999956
Index size:  236068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067602780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0482718600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4400000000, query time of that 0.3954596430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0056271590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1366.97 < 1388.12
  -> Decision False in time 0.0300000000, query time of that 0.0162676850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1097.5 < 1121.67
  -> Decision False in time 0.3300000000, query time of that 0.1788285180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1120.76 < 1136.36
  -> Decision False in time 0.0100000000, query time of that 0.0043478070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1442.63 < 1451.91
  -> Decision False in time 0.4100000000, query time of that 0.0228915000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
970.12 < 982.972
  -> Decision False in time 0.0900000000, query time of that 0.0093464590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 105.13999999999942
Index size:  204396.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0108478080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0746929840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6487812110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0083839890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0748046960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1419.52 < 1545.2
  -> Decision False in time 0.3400000000, query time of that 0.2716022950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0071421860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0685207690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
900.566 < 924.299
  -> Decision False in time 0.0800000000, query time of that 0.0091162350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 105.46999999999935
Index size:  185768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0131077640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1042002830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
615.109 < 644.691
  -> Decision False in time 0.5400000000, query time of that 0.5200324300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101927700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1017493410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1300000000, query time of that 0.9815346360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0138002010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.0979010340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
728.087 < 1210.74
  -> Decision False in time 1.8200000000, query time of that 0.2373894060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 239.34000000000015
Index size:  249680.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0253328010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2494638040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.2500000000, query time of that 2.1982588980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0271753130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2362955070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4500000000, query time of that 2.2775686870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.0306043120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.2694548380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7300000000, query time of that 2.5802030130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 241.0
Index size:  200432.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0102714320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0789237260, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6880480800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0086708380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0770468120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.7159910320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0094659810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0690786120, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1403.12 < 1404.03
  -> Decision False in time 3.4700000000, query time of that 0.2901996560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 239.47999999999956
Index size:  204304.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0361882970, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4100000000, query time of that 0.3933351540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.1900000000, query time of that 4.0964011230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0388217140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3449435430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.4400000000, query time of that 3.2560629870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.0410829140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.3616744070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5300000000, query time of that 3.8074775180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 235.80000000000018
Index size:  196876.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0362283160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4400000000, query time of that 0.4192940600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.3700000000, query time of that 4.2848369520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0423226020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4200000000, query time of that 0.3851948960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.4400000000, query time of that 4.2619347200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.0425456010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1200000000, query time of that 0.3694867940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5700000000, query time of that 3.6860392710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 67.04999999999927
Index size:  196432.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0186483333
  Testing...
|S| = 20
|T| = 283
Reject!
2144.6 < 2160.68
  -> Decision False in time 0.0100000000, query time of that 0.0096585790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0641886980, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5900000000, query time of that 0.5408214520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076285710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2393.23 < 2522.73
  -> Decision False in time 0.0500000000, query time of that 0.0372239210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1307.88 < 1308.92
  -> Decision False in time 0.0200000000, query time of that 0.0119249360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2538.42 < 2545.22
  -> Decision False in time 0.0600000000, query time of that 0.0062118330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1267.1 < 1292.52
  -> Decision False in time 0.2000000000, query time of that 0.0183812900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1416.55 < 1433.27
  -> Decision False in time 0.1200000000, query time of that 0.0118161230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 90.76000000000022
Index size:  175032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0142066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055496090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0400200710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1186.2 < 1214.6
  -> Decision False in time 0.1400000000, query time of that 0.1275313560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037014560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1534.9 < 1536.37
  -> Decision False in time 0.0400000000, query time of that 0.0198990080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1128.11 < 1129.17
  -> Decision False in time 0.0900000000, query time of that 0.0421224590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1589.02 < 1596.7
  -> Decision False in time 0.0100000000, query time of that 0.0036913550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1750.04 < 1834.59
  -> Decision False in time 0.0300000000, query time of that 0.0037155490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1256.61 < 1328.73
  -> Decision False in time 0.1000000000, query time of that 0.0072955920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 90.52999999999884
Index size:  189208.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0024366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0138273800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1021644130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.9389338770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0128811590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1071315690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1496.05 < 1608.73
  -> Decision False in time 0.4700000000, query time of that 0.4283809290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.0115379850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
847.989 < 859.676
  -> Decision False in time 0.6100000000, query time of that 0.0721018880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1912.64 < 1923.58
  -> Decision False in time 0.0500000000, query time of that 0.0110570330, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 235.96999999999935
Index size:  253164.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0081891060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0548806000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4681672760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0063620140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0548651440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1918.11 < 2004.63
  -> Decision False in time 0.6400000000, query time of that 0.3885566490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0048153350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0508687270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1896.07 < 1908.31
  -> Decision False in time 0.1400000000, query time of that 0.0124259700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 242.10000000000036
Index size:  241172.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0180445670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1516448460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4700000000, query time of that 1.4181381360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0180785510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1573572110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6900000000, query time of that 1.5239670640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0193673180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1616724760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1900000000, query time of that 1.6470303640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 240.86000000000058
Index size:  235136.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0256745160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2247385340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.0200000000, query time of that 1.9605070850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0299013090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2194743920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1500000000, query time of that 2.0337749290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.0247883460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1200000000, query time of that 0.2588790600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4000000000, query time of that 2.1575702550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 89.45000000000073
Index size:  200796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0284066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0050221060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0327493050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1109.47 < 1142.44
  -> Decision False in time 0.0700000000, query time of that 0.0587123080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030091530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1766.59 < 1837.3
  -> Decision False in time 0.0700000000, query time of that 0.0280475320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1264.4 < 1350.27
  -> Decision False in time 0.0300000000, query time of that 0.0118318290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0031104730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2476.43 < 2518.6
  -> Decision False in time 0.0000000000, query time of that 0.0035248740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1162.92 < 1220.52
  -> Decision False in time 0.0200000000, query time of that 0.0030331930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 240.0
Index size:  241952.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0496311940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.5011418880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.9900000000, query time of that 4.8911249510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0431176580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5300000000, query time of that 0.5053604190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 5.0100000000, query time of that 4.8453117600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.0525566960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.4573324930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.2500000000, query time of that 4.3713695500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 66.84000000000015
Index size:  186800.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1145050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0043722200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1505.96 < 1523.95
  -> Decision False in time 0.0100000000, query time of that 0.0042736010, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1222.2 < 1281.73
  -> Decision False in time 0.0200000000, query time of that 0.0098754840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
862.073 < 871.885
  -> Decision False in time 0.0100000000, query time of that 0.0028517990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2151.84 < 2198.65
  -> Decision False in time 0.0100000000, query time of that 0.0026535020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1527.85 < 1540.5
  -> Decision False in time 0.0000000000, query time of that 0.0024243670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1685.14 < 1713.31
  -> Decision False in time 0.0100000000, query time of that 0.0024263810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2092.57 < 2286.21
  -> Decision False in time 0.0100000000, query time of that 0.0023875650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
994.576 < 1022.87
  -> Decision False in time 0.0300000000, query time of that 0.0025234980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 238.28999999999905
Index size:  199508.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0165595960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1393332310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3000000000, query time of that 1.2470817350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0158086610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1411448140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4700000000, query time of that 1.3115164600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0162870680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1286259850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7400000000, query time of that 1.2758749250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 72.81999999999971
Index size:  186800.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0372616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075810370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2368.02 < 2549.86
  -> Decision False in time 0.0200000000, query time of that 0.0113685490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1858.74 < 2788.69
  -> Decision False in time 0.0400000000, query time of that 0.0357745110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0052377710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1337.66 < 1369.76
  -> Decision False in time 0.0100000000, query time of that 0.0112591690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1856.42 < 2565.02
  -> Decision False in time 0.0400000000, query time of that 0.0201204100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
777.108 < 777.151
  -> Decision False in time 0.0100000000, query time of that 0.0040382630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1200.4 < 1206.03
  -> Decision False in time 0.0100000000, query time of that 0.0047227800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1768.31 < 2617.97
  -> Decision False in time 0.0900000000, query time of that 0.0070826550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 240.21999999999935
Index size:  199796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0220314630, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1809264040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6700000000, query time of that 1.6219638510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0207193590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.1740505690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9800000000, query time of that 1.7861841660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.0250883010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.1738820150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0600000000, query time of that 1.7973780910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 104.69999999999891
Index size:  190548.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1056200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040055760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0248036070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1064.5 < 1065.61
  -> Decision False in time 0.0200000000, query time of that 0.0225814960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
954.837 < 974.97
  -> Decision False in time 0.0100000000, query time of that 0.0022628270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1194.44 < 1275.59
  -> Decision False in time 0.0100000000, query time of that 0.0025084660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1110.63 < 1151.7
  -> Decision False in time 0.0000000000, query time of that 0.0022948250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1164.47 < 1277.84
  -> Decision False in time 0.0100000000, query time of that 0.0023234360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
870.678 < 871.997
  -> Decision False in time 0.0100000000, query time of that 0.0022746040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2048.15 < 2124.19
  -> Decision False in time 0.0000000000, query time of that 0.0023903440, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 238.29999999999927
Index size:  190144.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0138659180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1132665530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0800000000, query time of that 1.0156226100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0154204820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1111199750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2600000000, query time of that 1.0718217390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.0139800830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.1076833830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 1.0321303370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 89.3700000000008
Index size:  200012.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1548866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036890410, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
545.135 < 558.194
  -> Decision False in time 0.0000000000, query time of that 0.0030326390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1449.99 < 1485.32
  -> Decision False in time 0.0100000000, query time of that 0.0028669960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1179.92 < 1180.85
  -> Decision False in time 0.0000000000, query time of that 0.0023204000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
907.482 < 924.724
  -> Decision False in time 0.0200000000, query time of that 0.0049165200, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
926.404 < 950.071
  -> Decision False in time 0.0000000000, query time of that 0.0024377500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
572.114 < 633.684
  -> Decision False in time 0.0100000000, query time of that 0.0022706460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
808.295 < 820.29
  -> Decision False in time 0.0200000000, query time of that 0.0023281280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1377.46 < 1383.93
  -> Decision False in time 0.0000000000, query time of that 0.0024244700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 67.27000000000044
Index size:  180996.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8075750000
  Testing...
|S| = 20
|T| = 283
Reject!
1769.91 < 1956.92
  -> Decision False in time 0.0000000000, query time of that 0.0028966170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1035.55 < 1096.27
  -> Decision False in time 0.0000000000, query time of that 0.0016254640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1524.37 < 1856.46
  -> Decision False in time 0.0100000000, query time of that 0.0015772700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1773.89 < 2222.71
  -> Decision False in time 0.0000000000, query time of that 0.0014243460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1431.22 < 2073.42
  -> Decision False in time 0.0000000000, query time of that 0.0014605780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1095.01 < 1388.05
  -> Decision False in time 0.0000000000, query time of that 0.0014286900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1406.85 < 1456.22
  -> Decision False in time 0.0000000000, query time of that 0.0013685830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1595.73 < 2055.13
  -> Decision False in time 0.0100000000, query time of that 0.0013984080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1462.03 < 1714.14
  -> Decision False in time 0.0000000000, query time of that 0.0014372150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 236.92000000000007
Index size:  239676.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0156227960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1218859360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1400000000, query time of that 1.0857386790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0150558910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1191420370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.1535499900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0141670530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1199587210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1934.9 < 1997.39
  -> Decision False in time 1.4800000000, query time of that 0.2092229570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 87.92000000000007
Index size:  201552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0046083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0087143450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0629162150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5488962550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080298130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0623496620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1506.07 < 1524.93
  -> Decision False in time 0.0400000000, query time of that 0.0256835090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060118840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.0580996410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1344.69 < 1464.37
  -> Decision False in time 0.0400000000, query time of that 0.0072616160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 103.5
Index size:  185452.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0024883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083997680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0607034820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5800000000, query time of that 0.5260931870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1709.95 < 1714.32
  -> Decision False in time 0.0100000000, query time of that 0.0074284680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0607617770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1546.18 < 1568.1
  -> Decision False in time 0.4100000000, query time of that 0.2681497600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056099340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
755.238 < 842.11
  -> Decision False in time 0.5300000000, query time of that 0.0384383840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1662.06 < 1691.42
  -> Decision False in time 3.4800000000, query time of that 0.2295793970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 240.51000000000022
Index size:  243164.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0136525330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0990970110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9106780040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0129979150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1052653450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1400000000, query time of that 0.9717433120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0131952630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.0987353530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1920.95 < 2011.56
  -> Decision False in time 3.8600000000, query time of that 0.4432706880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 88.18999999999869
Index size:  188640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0067316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072772330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0521982990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4432900440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0063477520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0559292060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1324.46 < 1347.61
  -> Decision False in time 0.1100000000, query time of that 0.0711383660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0045705770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1541.07 < 1554.55
  -> Decision False in time 0.5100000000, query time of that 0.0306395720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1263.88 < 1272.74
  -> Decision False in time 0.1900000000, query time of that 0.0137503990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 240.07999999999993
Index size:  254820.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0188743910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1476245550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.3368959870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0185966780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1466799290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6300000000, query time of that 1.4114733840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0165147280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1447423570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8200000000, query time of that 1.4168507830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 88.68000000000029
Index size:  188672.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5934000000
  Testing...
|S| = 20
|T| = 283
Reject!
1243.93 < 1256.69
  -> Decision False in time 0.0000000000, query time of that 0.0024163520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1999.12 < 2535.71
  -> Decision False in time 0.0200000000, query time of that 0.0067009430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1619.49 < 1740.83
  -> Decision False in time 0.0100000000, query time of that 0.0019170590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1453.07 < 1485.92
  -> Decision False in time 0.0000000000, query time of that 0.0016446290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1432.61 < 1450.28
  -> Decision False in time 0.0200000000, query time of that 0.0022636100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1513.05 < 1647.58
  -> Decision False in time 0.0100000000, query time of that 0.0017025350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
938.491 < 944.367
  -> Decision False in time 0.0000000000, query time of that 0.0014235340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1651.94 < 1819.21
  -> Decision False in time 0.0100000000, query time of that 0.0015031880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1079.03 < 1134
  -> Decision False in time 0.0000000000, query time of that 0.0013851630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 110.42000000000007
Index size:  186444.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4988516667
  Testing...
|S| = 20
|T| = 283
Reject!
1324.16 < 1328.35
  -> Decision False in time 0.0000000000, query time of that 0.0035336920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1426.71 < 1462.65
  -> Decision False in time 0.0200000000, query time of that 0.0141079380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1403.95 < 1408.2
  -> Decision False in time 0.0000000000, query time of that 0.0034782940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1172.59 < 1222.98
  -> Decision False in time 0.0100000000, query time of that 0.0018132930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1582.58 < 1805.21
  -> Decision False in time 0.0000000000, query time of that 0.0018539220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2080.63 < 2113.4
  -> Decision False in time 0.0000000000, query time of that 0.0019046930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1262.68 < 1275.78
  -> Decision False in time 0.0100000000, query time of that 0.0017312930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1559.66 < 1648.85
  -> Decision False in time 0.0000000000, query time of that 0.0018472760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2415.87 < 2440.84
  -> Decision False in time 0.0000000000, query time of that 0.0018121080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 242.40000000000146
Index size:  256364.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0237834430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2061221310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8200000000, query time of that 1.7644573710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226411340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1955312160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0100000000, query time of that 1.8727739490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0215390020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.2049017570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1734.97 < 1769.38
  -> Decision False in time 3.2600000000, query time of that 0.7935621990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 241.98000000000138
Index size:  200756.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0146318290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1288663640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2100000000, query time of that 1.1530659440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0127490020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1263628880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3700000000, query time of that 1.2157582190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0154220290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.1280881330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8100000000, query time of that 1.1703000770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 243.8799999999992
Index size:  200684.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0114448560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0929744150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.7954415280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0106024720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0889818960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1418.13 < 1440.95
  -> Decision False in time 0.8500000000, query time of that 0.7922248010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0076533840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0811273530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7800000000, query time of that 0.8181638430, with c1=5.0000000000, c2=0.1000000000
