copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 292.18
Index size:  457548.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0249566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039438180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0276502450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1588.89 < 1599.76
  -> Decision False in time 0.1400000000, query time of that 0.1113517140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0031548830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1000.81 < 1033.57
  -> Decision False in time 0.0100000000, query time of that 0.0054788100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1067.72 < 1093.2
  -> Decision False in time 0.0400000000, query time of that 0.0136400020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0033480740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1331.32 < 1343.93
  -> Decision False in time 0.0200000000, query time of that 0.0034382860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1057.57 < 1060.79
  -> Decision False in time 0.0600000000, query time of that 0.0033137700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 299.56
Index size:  282224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0257672730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2093874070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1700000000, query time of that 2.1157842130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0255893200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2495823440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5700000000, query time of that 2.4242191890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0264386680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2999190330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2400000000, query time of that 3.1350957160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 108.25
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0098063710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0924122790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.9252393220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0105064520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1088698000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.0708092720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0108746890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1734.97 < 1769.91
  -> Decision False in time 0.7600000000, query time of that 0.1009663430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
817.853 < 839.673
  -> Decision False in time 0.1600000000, query time of that 0.0248397390, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 79.12999999999988
Index size:  177660.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0228283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057303840, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0442980310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4300139220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1778.91 < 1860.04
  -> Decision False in time 0.0100000000, query time of that 0.0043526200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1601.36 < 1733.12
  -> Decision False in time 0.0400000000, query time of that 0.0249447870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1331.82 < 1383.39
  -> Decision False in time 0.0100000000, query time of that 0.0083534070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052082710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1005.05 < 1014.58
  -> Decision False in time 0.0200000000, query time of that 0.0054421100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1010.04 < 1012.28
  -> Decision False in time 0.1400000000, query time of that 0.0106823080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 292.6100000000001
Index size:  234232.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0070557440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0586006290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6200000000, query time of that 0.5765697050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065984870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0656662700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1746.08 < 1747.57
  -> Decision False in time 0.5800000000, query time of that 0.4928594640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0065479860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.0669016800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1823.68 < 1859.5
  -> Decision False in time 1.8000000000, query time of that 0.1458092710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 298.55999999999995
Index size:  259012.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0170827870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1681150180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6900000000, query time of that 1.6411646690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0174470680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1850561080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0800000000, query time of that 1.8879647630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0201560010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2106327930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1757.54 < 1828.04
  -> Decision False in time 0.5500000000, query time of that 0.1309585570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 78.05999999999995
Index size:  183924.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0474033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041356000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1944.71 < 2068.07
  -> Decision False in time 0.0200000000, query time of that 0.0220474030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2416.54 < 2939.34
  -> Decision False in time 0.0400000000, query time of that 0.0285120900, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1214.41 < 1302.42
  -> Decision False in time 0.0000000000, query time of that 0.0032675790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2040.7 < 2438.8
  -> Decision False in time 0.0100000000, query time of that 0.0072942190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
803.69 < 828.493
  -> Decision False in time 0.0100000000, query time of that 0.0036795450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1538.19 < 1736.08
  -> Decision False in time 0.0000000000, query time of that 0.0037186540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1100.6 < 1125.44
  -> Decision False in time 0.0400000000, query time of that 0.0036826200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1578.29 < 1646.06
  -> Decision False in time 0.1200000000, query time of that 0.0082445830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 78.09999999999991
Index size:  139320.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4602333333
  Testing...
|S| = 20
|T| = 283
Reject!
1914.47 < 2087.47
  -> Decision False in time 0.0000000000, query time of that 0.0022963850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1569.58 < 2158.8
  -> Decision False in time 0.0000000000, query time of that 0.0018379610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
909.586 < 964.017
  -> Decision False in time 0.0100000000, query time of that 0.0019574640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1529.39 < 2091.96
  -> Decision False in time 0.0000000000, query time of that 0.0014574690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1741.5 < 2926.74
  -> Decision False in time 0.0000000000, query time of that 0.0014694680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1806.05 < 1883.51
  -> Decision False in time 0.0000000000, query time of that 0.0015379780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
970.871 < 1030.99
  -> Decision False in time 0.0100000000, query time of that 0.0013335930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
961.521 < 996.805
  -> Decision False in time 0.0000000000, query time of that 0.0015181010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2408.53 < 2418.18
  -> Decision False in time 0.0000000000, query time of that 0.0014034550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 298.4200000000001
Index size:  253388.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0136488350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1240482350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1947666260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0147701060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1418781050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5900000000, query time of that 1.4045775670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0138169540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1471788840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9100000000, query time of that 1.4453701200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 127.88999999999987
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0138166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0036111130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1175.22 < 1198.2
  -> Decision False in time 0.0200000000, query time of that 0.0084282360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
960.715 < 1003.53
  -> Decision False in time 0.0700000000, query time of that 0.0575909630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033131030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1728.91 < 1734.03
  -> Decision False in time 0.0200000000, query time of that 0.0031388080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1895.45 < 1998.52
  -> Decision False in time 0.1200000000, query time of that 0.0547747450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0038004410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1367.32 < 1375.04
  -> Decision False in time 0.0600000000, query time of that 0.0040774950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
988.864 < 993.55
  -> Decision False in time 0.0400000000, query time of that 0.0039816050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 128.46000000000004
Index size:  177452.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2557316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0022418610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1221.2 < 1227.47
  -> Decision False in time 0.0000000000, query time of that 0.0032645910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1589.72 < 1649.6
  -> Decision False in time 0.0100000000, query time of that 0.0087849810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1474.02 < 1538.16
  -> Decision False in time 0.0000000000, query time of that 0.0016030520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1885.69 < 1906.87
  -> Decision False in time 0.0100000000, query time of that 0.0016929740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1283.22 < 1296.57
  -> Decision False in time 0.0000000000, query time of that 0.0017004890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1762.6 < 1861.76
  -> Decision False in time 0.0000000000, query time of that 0.0017964370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
991.987 < 1049.19
  -> Decision False in time 0.0000000000, query time of that 0.0016648600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2779.71 < 2851.14
  -> Decision False in time 0.0100000000, query time of that 0.0017346570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 108.23000000000002
Index size:  185388.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0032950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0073210550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0619649790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6600000000, query time of that 0.6110957150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0071163560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0710852710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1247.57 < 1268.36
  -> Decision False in time 0.3700000000, query time of that 0.3302078870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0071571860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1045.4 < 1059.35
  -> Decision False in time 0.3000000000, query time of that 0.0288581210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1531.84 < 1561.81
  -> Decision False in time 0.3100000000, query time of that 0.0291254590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 292.57000000000016
Index size:  236156.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0297871400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.3055360230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9800000000, query time of that 2.9285066290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0313980550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3237152530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.4600000000, query time of that 3.2108510500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0316270000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.4150975040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6300000000, query time of that 4.2918954950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 126.90000000000009
Index size:  203308.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0066550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049499920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0384316850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1526.51 < 1557.54
  -> Decision False in time 0.2200000000, query time of that 0.1997398140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040942570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0439979150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
980.337 < 1002.57
  -> Decision False in time 0.0500000000, query time of that 0.0291700790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1551.19 < 1606.33
  -> Decision False in time 0.0000000000, query time of that 0.0046036210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1034.42 < 1048.99
  -> Decision False in time 0.0400000000, query time of that 0.0046066600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
965.42 < 975.999
  -> Decision False in time 0.0700000000, query time of that 0.0046637910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 299.2100000000005
Index size:  242372.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0101356800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0891512680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.8791010480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0096747080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1029222950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1900000000, query time of that 1.0326408320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0098233030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1030192650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6400000000, query time of that 1.0288304070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 128.8199999999997
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0230116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037968560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0260016190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2747.04 < 2966.98
  -> Decision False in time 0.1100000000, query time of that 0.0922189220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1297.37 < 1321.13
  -> Decision False in time 0.0100000000, query time of that 0.0027504720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1151.96 < 1184.6
  -> Decision False in time 0.0300000000, query time of that 0.0123130220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
942.601 < 962.271
  -> Decision False in time 0.0200000000, query time of that 0.0098346830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1469.31 < 1470.14
  -> Decision False in time 0.0500000000, query time of that 0.0030471950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1193.92 < 1267.65
  -> Decision False in time 0.1000000000, query time of that 0.0069090320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1531.14 < 1531.52
  -> Decision False in time 0.0100000000, query time of that 0.0035403270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 300.53999999999996
Index size:  229016.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0365360940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3320487940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.2800000000, query time of that 3.2262048910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0358290880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3659911490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.6800000000, query time of that 3.5673409840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0364687260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.4715422200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.5300000000, query time of that 4.8804702510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 127.89000000000033
Index size:  187204.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4934783333
  Testing...
|S| = 20
|T| = 283
Reject!
1084.63 < 1100.55
  -> Decision False in time 0.0000000000, query time of that 0.0018619020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
927.365 < 946.844
  -> Decision False in time 0.0100000000, query time of that 0.0038266740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1375.01 < 1430.95
  -> Decision False in time 0.0100000000, query time of that 0.0040750670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1145.34 < 1186.47
  -> Decision False in time 0.0000000000, query time of that 0.0012968530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
996.231 < 1027.66
  -> Decision False in time 0.0100000000, query time of that 0.0013331730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
824.18 < 874.889
  -> Decision False in time 0.0100000000, query time of that 0.0013311070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
770.133 < 836.219
  -> Decision False in time 0.0000000000, query time of that 0.0013552880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1193.96 < 1235.51
  -> Decision False in time 0.0100000000, query time of that 0.0012475110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1167.69 < 1189.48
  -> Decision False in time 0.0000000000, query time of that 0.0013806550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 292.64999999999964
Index size:  211888.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056343560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0467607690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4604551550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0054012950, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0529328450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1356.12 < 1358.58
  -> Decision False in time 0.6100000000, query time of that 0.3998691560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0053987140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1752.73 < 1768.76
  -> Decision False in time 0.6600000000, query time of that 0.0465310730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1512.69 < 1524.66
  -> Decision False in time 2.0600000000, query time of that 0.1359838600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 291.28999999999996
Index size:  251280.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0114957200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1073990760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1000000000, query time of that 1.0512562700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117437430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1232674260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4000000000, query time of that 1.1997025740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0117997700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.1197512290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.5900000000, query time of that 1.2173466120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 293.0799999999999
Index size:  241140.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1072716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0028283960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
992.307 < 1065.73
  -> Decision False in time 0.0200000000, query time of that 0.0140541580, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
707.989 < 793.526
  -> Decision False in time 0.0100000000, query time of that 0.0081855370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
962.484 < 975.894
  -> Decision False in time 0.0100000000, query time of that 0.0021202700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1912.7 < 1917.84
  -> Decision False in time 0.0300000000, query time of that 0.0070896390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1057.27 < 1080.95
  -> Decision False in time 0.0100000000, query time of that 0.0022734120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1266.31 < 1328.56
  -> Decision False in time 0.0000000000, query time of that 0.0024119530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1756.33 < 1823.28
  -> Decision False in time 0.0300000000, query time of that 0.0025162540, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1237.38 < 1273.62
  -> Decision False in time 0.0000000000, query time of that 0.0027328810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 298.8000000000002
Index size:  259368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0172008460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1499131470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5900000000, query time of that 1.5429272750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0193493690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1868088060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9000000000, query time of that 1.7890260480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0190603660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1988104210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3800000000, query time of that 1.9434364210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 127.15999999999985
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0038200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059674140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0474621760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1537.3 < 1544.83
  -> Decision False in time 0.4300000000, query time of that 0.3935651330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0050493870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0524057330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1967.36 < 2034.23
  -> Decision False in time 0.2500000000, query time of that 0.1713283700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0053023440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0535401980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1264 < 1301.14
  -> Decision False in time 0.4600000000, query time of that 0.0326827110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 127.8799999999992
Index size:  182428.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0104021550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0920561810, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.8975445920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0093724930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1046479980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.0510250820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0110980980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1870.79 < 1888.99
  -> Decision False in time 0.1900000000, query time of that 0.0317386360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1366.67 < 1385.02
  -> Decision False in time 1.6500000000, query time of that 0.2063472850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 127.36999999999989
Index size:  190844.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0412100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0032250090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0230316200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1868.4 < 1899.79
  -> Decision False in time 0.0800000000, query time of that 0.0687307630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0023647780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1280.23 < 1296.58
  -> Decision False in time 0.0100000000, query time of that 0.0056526450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1043.23 < 1050.09
  -> Decision False in time 0.0100000000, query time of that 0.0054763960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1531.6 < 1571.53
  -> Decision False in time 0.0300000000, query time of that 0.0027501760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1320.29 < 1386.54
  -> Decision False in time 0.0100000000, query time of that 0.0029512170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1035.31 < 1061
  -> Decision False in time 0.0300000000, query time of that 0.0028667760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 78.42999999999938
Index size:  183688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0945700000
  Testing...
|S| = 20
|T| = 283
Reject!
2070.86 < 2484.46
  -> Decision False in time 0.0100000000, query time of that 0.0032605710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1678.13 < 2221.49
  -> Decision False in time 0.0100000000, query time of that 0.0081219390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1308.66 < 1313.09
  -> Decision False in time 0.0000000000, query time of that 0.0041881480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025317380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1601.44 < 2384.03
  -> Decision False in time 0.0000000000, query time of that 0.0030564430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1993.72 < 2670.14
  -> Decision False in time 0.0100000000, query time of that 0.0028219180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2390.19 < 2541.36
  -> Decision False in time 0.0000000000, query time of that 0.0025895300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
886.592 < 955.225
  -> Decision False in time 0.0400000000, query time of that 0.0030004770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1354.88 < 1396.94
  -> Decision False in time 0.0000000000, query time of that 0.0032812130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 289.1200000000008
Index size:  231216.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0060600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0043614940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0324778680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3600000000, query time of that 0.3207342100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0037285390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0381173290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1388.42 < 1391.76
  -> Decision False in time 0.0400000000, query time of that 0.0206913200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1165.08 < 1177.93
  -> Decision False in time 0.0300000000, query time of that 0.0038202950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1037.83 < 1040.62
  -> Decision False in time 0.0200000000, query time of that 0.0040111020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1833.64 < 1883.21
  -> Decision False in time 0.0100000000, query time of that 0.0040576190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 297.85000000000036
Index size:  262364.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0108806390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0986790110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.9829533090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0098588680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1135227830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3000000000, query time of that 1.1346343160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0108901940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1101835790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1580.82 < 1584.3
  -> Decision False in time 3.3500000000, query time of that 0.4560050790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 288.83000000000175
Index size:  194416.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0150069820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1379994850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4300000000, query time of that 1.3806872430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0185488310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1617764210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7600000000, query time of that 1.5958351660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0173878260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1711496470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1820.45 < 1859.29
  -> Decision False in time 1.0500000000, query time of that 0.2272045420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 290.96999999999935
Index size:  235760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0095857650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0800394530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7862215960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0096221800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0916279150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.9150559760, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0091188990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0906916270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1466.95 < 1479.33
  -> Decision False in time 5.1200000000, query time of that 0.5540879360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 109.13999999999942
Index size:  200680.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0028283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084232020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0759312680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2271.73 < 2492.48
  -> Decision False in time 0.3900000000, query time of that 0.3665280480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083513470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0871090300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.8768781320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0089513120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2122.72 < 2182.84
  -> Decision False in time 0.8100000000, query time of that 0.0873488010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1675.62 < 2022.61
  -> Decision False in time 0.2200000000, query time of that 0.0268935930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 78.6200000000008
Index size:  183980.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0194966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063354990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0530868380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1327.99 < 1334.64
  -> Decision False in time 0.1700000000, query time of that 0.1539185380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055739400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0616769470, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2579.57 < 2644.18
  -> Decision False in time 0.1000000000, query time of that 0.0808707790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0062433800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1110.5 < 1133.6
  -> Decision False in time 0.3400000000, query time of that 0.0283599240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1993.04 < 2075.07
  -> Decision False in time 0.0900000000, query time of that 0.0125695510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 291.8199999999997
Index size:  237864.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0078254390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0699142250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7300000000, query time of that 0.6861910920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0075929190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0779102710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2106.12 < 2123.28
  -> Decision False in time 0.0200000000, query time of that 0.0170162770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0077965220, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0810521910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1953.02 < 1992.1
  -> Decision False in time 1.6600000000, query time of that 0.1554387590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 292.2000000000007
Index size:  245636.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052722500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0398356340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.3922599670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0045274980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0463538590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2105.89 < 2165.14
  -> Decision False in time 0.2600000000, query time of that 0.1552789100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1926.68 < 2040.34
  -> Decision False in time 0.0100000000, query time of that 0.0048619960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1503.4 < 1524.31
  -> Decision False in time 0.4400000000, query time of that 0.0265122020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1317.09 < 1319.88
  -> Decision False in time 0.0400000000, query time of that 0.0049135330, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 108.67999999999847
Index size:  197268.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0271566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0034882800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0258687270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1748.99 < 1790.66
  -> Decision False in time 0.0100000000, query time of that 0.0056149270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028976610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2091.55 < 2129.89
  -> Decision False in time 0.0300000000, query time of that 0.0124178240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1106.51 < 1107.88
  -> Decision False in time 0.0000000000, query time of that 0.0029221020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1008.09 < 1008.66
  -> Decision False in time 0.0200000000, query time of that 0.0030433870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
885.398 < 917.101
  -> Decision False in time 0.0100000000, query time of that 0.0034755850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1506.89 < 1556.01
  -> Decision False in time 0.0200000000, query time of that 0.0034095660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 109.32999999999993
Index size:  169332.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0146383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040439930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0317584950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1997.17 < 2049.2
  -> Decision False in time 0.3200000000, query time of that 0.2843910340, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034675020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0369969050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1306.3 < 1310.63
  -> Decision False in time 0.0300000000, query time of that 0.0138671060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1318.31 < 1347.27
  -> Decision False in time 0.0500000000, query time of that 0.0036592860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1908.62 < 2049.2
  -> Decision False in time 0.0100000000, query time of that 0.0040243340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
881.116 < 919.292
  -> Decision False in time 0.0500000000, query time of that 0.0037748740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 301.130000000001
Index size:  259704.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0155157360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1308414100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.2632055060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0142512520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1425780210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6100000000, query time of that 1.4534246690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0157161720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1489323910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1600000000, query time of that 1.5301310750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 301.97999999999956
Index size:  203476.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0095076870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0782451530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7709883670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080315270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0902182060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.9054569430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0093906580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0907023530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2000.48 < 2043.77
  -> Decision False in time 4.9700000000, query time of that 0.5343021950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 129.53999999999905
Index size:  191456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0029150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0061088230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0522953660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.5111688650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057121150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0595293080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1591.41 < 1621.81
  -> Decision False in time 0.0100000000, query time of that 0.0141707190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0059493480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1532.54 < 1537.3
  -> Decision False in time 0.5700000000, query time of that 0.0437463610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
776.413 < 878.368
  -> Decision False in time 0.2600000000, query time of that 0.0212120790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.82999999999993
Index size:  176648.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0341666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047629460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1827.89 < 1887.42
  -> Decision False in time 0.0000000000, query time of that 0.0071262830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1743.16 < 1745.13
  -> Decision False in time 0.0100000000, query time of that 0.0075394150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039314270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1336.64 < 1369.65
  -> Decision False in time 0.0100000000, query time of that 0.0048588390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1729.44 < 1775.06
  -> Decision False in time 0.0000000000, query time of that 0.0045106870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1278.32 < 1299.27
  -> Decision False in time 0.0200000000, query time of that 0.0044775110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2527.7 < 2614.33
  -> Decision False in time 0.0000000000, query time of that 0.0043613270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1180.29 < 1279.73
  -> Decision False in time 0.0400000000, query time of that 0.0043210410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 108.65000000000146
Index size:  185960.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3311200000
  Testing...
|S| = 20
|T| = 283
Reject!
1757.03 < 1815.11
  -> Decision False in time 0.0100000000, query time of that 0.0021109450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2043.52 < 2048.21
  -> Decision False in time 0.0000000000, query time of that 0.0032299040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1239.26 < 1336.75
  -> Decision False in time 0.0000000000, query time of that 0.0021117610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
957.444 < 1015.95
  -> Decision False in time 0.0100000000, query time of that 0.0015017630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
885.207 < 914.59
  -> Decision False in time 0.0000000000, query time of that 0.0015177030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1401.23 < 1476.43
  -> Decision False in time 0.0000000000, query time of that 0.0015521280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1079.48 < 1152.79
  -> Decision False in time 0.0000000000, query time of that 0.0014796790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1331.18 < 1345.77
  -> Decision False in time 0.0100000000, query time of that 0.0015141830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1124.38 < 1131.73
  -> Decision False in time 0.0000000000, query time of that 0.0015386930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.92000000000007
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2164016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026540230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1512.78 < 1541.63
  -> Decision False in time 0.0000000000, query time of that 0.0021275390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1555.92 < 1609.33
  -> Decision False in time 0.0000000000, query time of that 0.0032640930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0017327690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1742.3 < 1850.92
  -> Decision False in time 0.0000000000, query time of that 0.0019794220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2028.43 < 2097.02
  -> Decision False in time 0.0100000000, query time of that 0.0018146250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2145.95 < 2167.55
  -> Decision False in time 0.0000000000, query time of that 0.0018300080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2289.51 < 2588.43
  -> Decision False in time 0.0000000000, query time of that 0.0017454760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1169.22 < 1219.8
  -> Decision False in time 0.0100000000, query time of that 0.0017053920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 108.63999999999942
Index size:  188696.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5926783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0018406570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1729.3 < 1998.83
  -> Decision False in time 0.0100000000, query time of that 0.0012859570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1175.32 < 1241.31
  -> Decision False in time 0.0000000000, query time of that 0.0037236070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1156.85 < 1203.5
  -> Decision False in time 0.0000000000, query time of that 0.0012167870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
575.66 < 625.859
  -> Decision False in time 0.0000000000, query time of that 0.0011910080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1146.56 < 1152.72
  -> Decision False in time 0.0100000000, query time of that 0.0011280020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1794.9 < 1930.43
  -> Decision False in time 0.0000000000, query time of that 0.0011957590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1256.06 < 1316.68
  -> Decision False in time 0.0000000000, query time of that 0.0012792260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1115.44 < 1118.7
  -> Decision False in time 0.0100000000, query time of that 0.0011932570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 109.08999999999833
Index size:  188656.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1533383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0026455470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1447.33 < 1450.5
  -> Decision False in time 0.0100000000, query time of that 0.0019043110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1529.18 < 1535.27
  -> Decision False in time 0.0000000000, query time of that 0.0050003710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1014.01 < 1068.84
  -> Decision False in time 0.0000000000, query time of that 0.0016339330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1633 < 1678.33
  -> Decision False in time 0.0100000000, query time of that 0.0016255540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1231.97 < 1237.74
  -> Decision False in time 0.0000000000, query time of that 0.0017408950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1560.48 < 1613.53
  -> Decision False in time 0.0000000000, query time of that 0.0018082130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1833.67 < 1836.83
  -> Decision False in time 0.0000000000, query time of that 0.0017936170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2122.63 < 2125.01
  -> Decision False in time 0.0100000000, query time of that 0.0018906490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 128.8099999999995
Index size:  189012.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1047400000
  Testing...
|S| = 20
|T| = 283
Reject!
1199.52 < 1232.21
  -> Decision False in time 0.0000000000, query time of that 0.0026629770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0181976840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1676.52 < 1968.46
  -> Decision False in time 0.0000000000, query time of that 0.0053497210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1022.41 < 1060.3
  -> Decision False in time 0.0100000000, query time of that 0.0019239830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1175.95 < 1184.99
  -> Decision False in time 0.0000000000, query time of that 0.0021533080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
722.624 < 773.052
  -> Decision False in time 0.0100000000, query time of that 0.0022333620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1895.45 < 2007.73
  -> Decision False in time 0.0000000000, query time of that 0.0023015780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1382.4 < 1480.49
  -> Decision False in time 0.0100000000, query time of that 0.0023365400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
981.662 < 998.712
  -> Decision False in time 0.0200000000, query time of that 0.0023423470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 301.1700000000001
Index size:  257756.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0204655720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1780604190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8400000000, query time of that 1.7883673250, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0204691970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2001532210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2200000000, query time of that 2.0496219480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0211058470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.2292442600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1939.74 < 1958.57
  -> Decision False in time 3.9000000000, query time of that 1.1514950350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.88999999999942
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8118050000
  Testing...
|S| = 20
|T| = 283
Reject!
1073.31 < 1481.5
  -> Decision False in time 0.0000000000, query time of that 0.0016871000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2182.58 < 2388.05
  -> Decision False in time 0.0000000000, query time of that 0.0011184060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2417.59 < 2455.98
  -> Decision False in time 0.0000000000, query time of that 0.0010590380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1764.4 < 2826.81
  -> Decision False in time 0.0000000000, query time of that 0.0010243600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2035.03 < 2195.12
  -> Decision False in time 0.0000000000, query time of that 0.0008783070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1296.86 < 1360.61
  -> Decision False in time 0.0100000000, query time of that 0.0009075490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1455.43 < 1460.27
  -> Decision False in time 0.0000000000, query time of that 0.0009084560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1054.94 < 1055.91
  -> Decision False in time 0.0000000000, query time of that 0.0009710350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1881.48 < 2014.47
  -> Decision False in time 0.0000000000, query time of that 0.0009423500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 108.98999999999978
Index size:  142380.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0040783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066237230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0532557300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5245789170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0059648090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0610067170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1166.88 < 1196.3
  -> Decision False in time 0.5200000000, query time of that 0.3882522140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056928340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1976.41 < 2170.58
  -> Decision False in time 0.4600000000, query time of that 0.0380104330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1430.49 < 1440.62
  -> Decision False in time 1.3700000000, query time of that 0.1007831170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 299.9499999999989
Index size:  246024.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0121485970, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1123192800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1600000000, query time of that 1.1068994750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0134034290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1279653570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5500000000, query time of that 1.3576803910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0144532900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1282514740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9300000000, query time of that 1.2803050220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 299.7000000000007
Index size:  203488.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0143162220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1413379090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.3521808310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0136801380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1564803260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6400000000, query time of that 1.5448052070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0143442510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1665144460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2353.84 < 2394.91
  -> Decision False in time 3.1400000000, query time of that 0.6108095190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 300.3600000000006
Index size:  210300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065614040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0519912090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5187741810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057214850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0604003980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2057.84 < 2076.81
  -> Decision False in time 0.3500000000, query time of that 0.2644675620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0058891250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0614632580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1551.08 < 1556
  -> Decision False in time 7.7200000000, query time of that 0.5651733720, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 129.03000000000065
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079301480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0649341230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6800000000, query time of that 0.6326299820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0069708400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
929.436 < 945.516
  -> Decision False in time 0.1000000000, query time of that 0.0723258640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
635.541 < 647.252
  -> Decision False in time 0.6700000000, query time of that 0.6044327050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0078894800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1241.82 < 1242.64
  -> Decision False in time 0.1100000000, query time of that 0.0152670350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
713.609 < 838.933
  -> Decision False in time 0.9600000000, query time of that 0.0861205100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 79.19000000000051
Index size:  179976.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1176800000
  Testing...
|S| = 20
|T| = 283
Reject!
723.226 < 738.047
  -> Decision False in time 0.0000000000, query time of that 0.0027530660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
944.395 < 993.741
  -> Decision False in time 0.0100000000, query time of that 0.0030949730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2212.4 < 2270.14
  -> Decision False in time 0.0100000000, query time of that 0.0124410820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1421.26 < 1593.55
  -> Decision False in time 0.0100000000, query time of that 0.0020190890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1483.27 < 1565.81
  -> Decision False in time 0.0000000000, query time of that 0.0021546940, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2340.07 < 2389.11
  -> Decision False in time 0.0000000000, query time of that 0.0023033780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1901.49 < 2033.79
  -> Decision False in time 0.0100000000, query time of that 0.0023524390, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1162.57 < 1169.57
  -> Decision False in time 0.0000000000, query time of that 0.0022654570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2300.22 < 2493.61
  -> Decision False in time 0.0000000000, query time of that 0.0021754310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 300.53000000000065
Index size:  256036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079074000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0666263140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6538723580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0075045610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0768461870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.7403962220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0079130030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0753828670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1206.38 < 1216.23
  -> Decision False in time 7.5500000000, query time of that 0.6783901800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 293.39000000000124
Index size:  194180.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0218532810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1891251070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8700000000, query time of that 1.8174588590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0204632490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2160997330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2900000000, query time of that 2.1238422890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0218533070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2457304740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6200000000, query time of that 2.4925972490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.64999999999782
Index size:  197064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5766116667
  Testing...
|S| = 20
|T| = 283
Reject!
1822.29 < 1822.7
  -> Decision False in time 0.0000000000, query time of that 0.0015644500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
984.883 < 1136.07
  -> Decision False in time 0.0100000000, query time of that 0.0015411670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1281.43 < 1448.16
  -> Decision False in time 0.0000000000, query time of that 0.0010018610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1845.94 < 1874.33
  -> Decision False in time 0.0100000000, query time of that 0.0009995740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1734.35 < 1761.9
  -> Decision False in time 0.0000000000, query time of that 0.0009718440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1354.06 < 1368.72
  -> Decision False in time 0.0100000000, query time of that 0.0009803750, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1748.02 < 1870.96
  -> Decision False in time 0.0000000000, query time of that 0.0009383180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1867.47 < 2041.77
  -> Decision False in time 0.0100000000, query time of that 0.0009490050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2060.33 < 2066.85
  -> Decision False in time 0.0000000000, query time of that 0.0009439840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 109.08000000000175
Index size:  181440.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0731216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0027220920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1141.74 < 1152.72
  -> Decision False in time 0.0300000000, query time of that 0.0177810840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1551.94 < 1593.17
  -> Decision False in time 0.0100000000, query time of that 0.0042972980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020310460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
907.388 < 918.464
  -> Decision False in time 0.0200000000, query time of that 0.0046910640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2732.69 < 2735.55
  -> Decision False in time 0.0200000000, query time of that 0.0043492410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1527.13 < 1619.99
  -> Decision False in time 0.0300000000, query time of that 0.0023681510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1189.27 < 1221.13
  -> Decision False in time 0.0100000000, query time of that 0.0026930240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
813.327 < 1331.32
  -> Decision False in time 0.0000000000, query time of that 0.0024504210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 293.9300000000003
Index size:  244708.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0117004270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0970935340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.9559220800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0104171410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1129384930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.1122160340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0122073270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1123281320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2136.37 < 2151.25
  -> Decision False in time 2.7900000000, query time of that 0.3790864020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 129.21999999999753
Index size:  205064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084057990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0714215080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.6947560260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0072156490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0816458030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1096.03 < 1153.23
  -> Decision False in time 0.6700000000, query time of that 0.6292324120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0082992650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1349.84 < 1350.58
  -> Decision False in time 0.6000000000, query time of that 0.0613930720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1487.86 < 1501.12
  -> Decision False in time 1.3400000000, query time of that 0.1350580610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 108.70000000000073
Index size:  178852.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0068166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0050778150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0422403770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4600000000, query time of that 0.4191544370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0047742360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0497063120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
949.127 < 950.315
  -> Decision False in time 0.1300000000, query time of that 0.0870789350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049031110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1708.45 < 1747.48
  -> Decision False in time 0.0900000000, query time of that 0.0074834080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1691.5 < 1732.4
  -> Decision False in time 0.9000000000, query time of that 0.0566907990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 300.619999999999
Index size:  257784.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0299853670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2767316370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.8400000000, query time of that 2.7682623070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0335156560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3600000000, query time of that 0.3300420110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.2900000000, query time of that 3.1492476620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0392812870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.3931252650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7400000000, query time of that 4.2609664430, with c1=5.0000000000, c2=0.1000000000
