copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 392.0
Index size:  476456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0111286850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1004555350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.9324846120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0102822310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1047726660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2600000000, query time of that 1.0613362580, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0118592080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1075120340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 1.0674470390, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 147.7399999999999
Index size:  212940.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4531133333
  Testing...
|S| = 20
|T| = 283
Reject!
1737.09 < 1888.85
  -> Decision False in time 0.0100000000, query time of that 0.0064494810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1680.04 < 1840.13
  -> Decision False in time 0.0100000000, query time of that 0.0051001390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1257.2 < 1335.24
  -> Decision False in time 0.0000000000, query time of that 0.0030060980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2043.94 < 2051.51
  -> Decision False in time 0.0000000000, query time of that 0.0013967670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1541.05 < 1544.72
  -> Decision False in time 0.0100000000, query time of that 0.0014214770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2463.98 < 2495.71
  -> Decision False in time 0.0000000000, query time of that 0.0017066730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1986.91 < 2010.25
  -> Decision False in time 0.0000000000, query time of that 0.0015373530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1346.23 < 1426.83
  -> Decision False in time 0.0100000000, query time of that 0.0016466410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1176.9 < 1255.57
  -> Decision False in time 0.0000000000, query time of that 0.0015694910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 77.10000000000002
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2462616667
  Testing...
|S| = 20
|T| = 283
Reject!
1690.74 < 1710.71
  -> Decision False in time 0.0000000000, query time of that 0.0027232810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1746.77 < 1854.05
  -> Decision False in time 0.0000000000, query time of that 0.0032746610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1094.22 < 1745.65
  -> Decision False in time 0.0100000000, query time of that 0.0029958760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2079.98 < 2119.42
  -> Decision False in time 0.0000000000, query time of that 0.0016243650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1810.94 < 1989.67
  -> Decision False in time 0.0000000000, query time of that 0.0016647230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2032.87 < 2098.75
  -> Decision False in time 0.0100000000, query time of that 0.0016620390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1668.96 < 1682.23
  -> Decision False in time 0.0000000000, query time of that 0.0016553650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1594.32 < 1708.9
  -> Decision False in time 0.0000000000, query time of that 0.0017526410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1866.14 < 2047.49
  -> Decision False in time 0.0000000000, query time of that 0.0017174290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 369.52
Index size:  250344.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0138800290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1275248850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2800000000, query time of that 1.2347008170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0149495720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1394197180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6400000000, query time of that 1.4171012940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0152686170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1396865770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8800000000, query time of that 1.4507321160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 147.1500000000001
Index size:  203084.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0043166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051635440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0382825170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4040275190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0046351300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0469946110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1693.65 < 1758.5
  -> Decision False in time 0.2600000000, query time of that 0.1513289210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0045496500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1208.72 < 1226.43
  -> Decision False in time 0.4300000000, query time of that 0.0262393930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1598.74 < 1626.37
  -> Decision False in time 0.4100000000, query time of that 0.0264033930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 111.75
Index size:  174444.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0015100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0108280140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0990517730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.9823915940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112079880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1111871820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
368.026 < 410.39
  -> Decision False in time 0.4700000000, query time of that 0.4491727390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0110939430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1587.44 < 1597.44
  -> Decision False in time 0.0500000000, query time of that 0.0115511650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1582.84 < 1672.73
  -> Decision False in time 0.6300000000, query time of that 0.0860365060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 147.18000000000006
Index size:  186352.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0088496980, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0773009760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7694050480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0092975970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0882389540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1918.2 < 2153.28
  -> Decision False in time 0.6600000000, query time of that 0.6250674990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0089995580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
993.679 < 1000.27
  -> Decision False in time 0.0400000000, query time of that 0.0084846400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1441.37 < 1566.35
  -> Decision False in time 1.2800000000, query time of that 0.1352736890, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 390.3499999999999
Index size:  259960.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0275611270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2656945940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7300000000, query time of that 2.6712603320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0256541790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3200000000, query time of that 0.2917393840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1000000000, query time of that 2.9626761660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0314378120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.3730767470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5000000000, query time of that 4.1068693520, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 112.01000000000022
Index size:  190612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086976800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0792568010, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7776476590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086328740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0901783520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
977.215 < 1075.69
  -> Decision False in time 0.6100000000, query time of that 0.5756042880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0089647080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1448.69 < 1510.45
  -> Decision False in time 0.3200000000, query time of that 0.0363895470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1541.33 < 1605.44
  -> Decision False in time 0.1200000000, query time of that 0.0185487090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 388.53999999999996
Index size:  257124.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0358541170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3600000000, query time of that 0.3516974990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.6700000000, query time of that 3.6241392950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0422786210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3853421180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.0800000000, query time of that 3.8955015310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0434302420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.5140999810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6900000000, query time of that 5.3903369080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 111.61999999999989
Index size:  189200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0037233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048742090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0425808830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1010.1 < 1044.62
  -> Decision False in time 0.2800000000, query time of that 0.2583014610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047690980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0500796530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1056.97 < 1061.88
  -> Decision False in time 0.1200000000, query time of that 0.0791530850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0051760230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1342.9 < 1399.61
  -> Decision False in time 0.0300000000, query time of that 0.0053969310, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1581.84 < 1583.7
  -> Decision False in time 0.1300000000, query time of that 0.0103917920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 368.7300000000005
Index size:  244036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117232510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1138388460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1800000000, query time of that 1.1364120090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127467750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1261246130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4800000000, query time of that 1.2987934230, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0144604430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1228694410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0100000000, query time of that 1.2731956030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 388.53999999999996
Index size:  250228.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0433624670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4600000000, query time of that 0.4514351440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.6400000000, query time of that 4.5738699920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0507732790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5200000000, query time of that 0.4969272370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 5.0200000000, query time of that 4.9253010030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0530806380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1300000000, query time of that 0.6390736170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.5700000000, query time of that 6.4862804500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 389.4899999999998
Index size:  211364.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0180977900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1632154720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.6376898590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0177065940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1861135060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8400000000, query time of that 1.7562648390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0177568680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.2040563070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8400000000, query time of that 1.9029511970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 370.47000000000025
Index size:  217776.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0151100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032296780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1157.52 < 1168.01
  -> Decision False in time 0.0100000000, query time of that 0.0092583530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1202.89 < 1206.3
  -> Decision False in time 0.2700000000, query time of that 0.2347518590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027778660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1153.6 < 1159.97
  -> Decision False in time 0.0300000000, query time of that 0.0135116960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1206.68 < 1212
  -> Decision False in time 0.0400000000, query time of that 0.0170477630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
991.351 < 1015.06
  -> Decision False in time 0.0500000000, query time of that 0.0032916350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1317.08 < 1352.11
  -> Decision False in time 0.0700000000, query time of that 0.0032564040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1202.89 < 1206.3
  -> Decision False in time 0.0400000000, query time of that 0.0033278260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 391.8699999999999
Index size:  259964.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0192470830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1888672610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9700000000, query time of that 1.9247987820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0222606380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2181445500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3000000000, query time of that 2.1660977980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0264469690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2466315820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3400000000, query time of that 2.5326629350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 112.0
Index size:  192220.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2863616667
  Testing...
|S| = 20
|T| = 283
Reject!
794.566 < 811.507
  -> Decision False in time 0.0000000000, query time of that 0.0017233500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1185.52 < 1201.93
  -> Decision False in time 0.0100000000, query time of that 0.0012418060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
879.971 < 898.293
  -> Decision False in time 0.0100000000, query time of that 0.0019488660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
967.584 < 1034.17
  -> Decision False in time 0.0000000000, query time of that 0.0012564030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1362.4 < 1422.52
  -> Decision False in time 0.0100000000, query time of that 0.0013204310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1797.64 < 1884.64
  -> Decision False in time 0.0000000000, query time of that 0.0012248470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1825.68 < 1927.63
  -> Decision False in time 0.0100000000, query time of that 0.0012678780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
681.155 < 705.79
  -> Decision False in time 0.0100000000, query time of that 0.0012237400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1738.38 < 1886.1
  -> Decision False in time 0.0100000000, query time of that 0.0016173070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 147.10999999999967
Index size:  185452.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0087500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038969970, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0325805050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3600000000, query time of that 0.3209083570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0036047220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1504.8 < 1533.27
  -> Decision False in time 0.0400000000, query time of that 0.0174305860, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1368.87 < 1421.27
  -> Decision False in time 0.0200000000, query time of that 0.0115852620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1772.74 < 1776.42
  -> Decision False in time 0.0100000000, query time of that 0.0038524020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1031.73 < 1072.32
  -> Decision False in time 0.0000000000, query time of that 0.0036627850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1880.42 < 1917.62
  -> Decision False in time 0.2900000000, query time of that 0.0154042780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 77.51999999999953
Index size:  183900.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3911066667
  Testing...
|S| = 20
|T| = 283
Reject!
1909.65 < 2268.2
  -> Decision False in time 0.0000000000, query time of that 0.0021862550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1951.49 < 1959.51
  -> Decision False in time 0.0100000000, query time of that 0.0028698560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2353.55 < 2435.77
  -> Decision False in time 0.0000000000, query time of that 0.0017422560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1901.07 < 1927.27
  -> Decision False in time 0.0000000000, query time of that 0.0014191340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1598.91 < 1607.79
  -> Decision False in time 0.0000000000, query time of that 0.0014554430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1608.24 < 1893.01
  -> Decision False in time 0.0100000000, query time of that 0.0013706820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1441.43 < 1458.22
  -> Decision False in time 0.0000000000, query time of that 0.0013726490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1210.12 < 1214.69
  -> Decision False in time 0.0000000000, query time of that 0.0015096850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1948.78 < 2004.84
  -> Decision False in time 0.0000000000, query time of that 0.0015112680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 112.18000000000029
Index size:  182448.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075616960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0660783660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6468946020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0068613930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0755089070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
562.452 < 606.867
  -> Decision False in time 0.2000000000, query time of that 0.1721234200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0070417290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0737635670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1444.13 < 1505.79
  -> Decision False in time 0.7400000000, query time of that 0.0699081280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 392.8800000000001
Index size:  260700.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0169416880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1695723190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7400000000, query time of that 1.6920556210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0208316770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.1968248720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0800000000, query time of that 1.9295438800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0195823420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2094018760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2900000000, query time of that 2.1573845310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 76.88000000000102
Index size:  187792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1404466667
  Testing...
|S| = 20
|T| = 283
Reject!
1914.74 < 2108.4
  -> Decision False in time 0.0100000000, query time of that 0.0026470050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1938.44 < 2003.03
  -> Decision False in time 0.0000000000, query time of that 0.0017520940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1933.3 < 1942.73
  -> Decision False in time 0.0100000000, query time of that 0.0016733940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2111.8 < 2275.89
  -> Decision False in time 0.0000000000, query time of that 0.0015609540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1687.66 < 1801.14
  -> Decision False in time 0.0100000000, query time of that 0.0017598350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1596.59 < 1840.41
  -> Decision False in time 0.0000000000, query time of that 0.0015718090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1597.52 < 1619.02
  -> Decision False in time 0.0100000000, query time of that 0.0016154820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2081.7 < 2269.96
  -> Decision False in time 0.0000000000, query time of that 0.0017558060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2183.73 < 2299
  -> Decision False in time 0.0100000000, query time of that 0.0016250920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 367.5499999999993
Index size:  196452.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0100199420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0966194280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.8936334630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101869490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1027171220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2600000000, query time of that 1.0148510540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0106300300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1040960640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7500000000, query time of that 0.9851508780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 369.3299999999999
Index size:  251156.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0053198640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0429579700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1994.85 < 2059.97
  -> Decision False in time 0.3000000000, query time of that 0.2753301460, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046055500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0497285980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1741.6 < 1763.25
  -> Decision False in time 0.3000000000, query time of that 0.1950720350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0051102130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1500.97 < 1532.22
  -> Decision False in time 0.4700000000, query time of that 0.0307706350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1142.11 < 2059.97
  -> Decision False in time 1.7900000000, query time of that 0.1101668540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 147.90999999999985
Index size:  203568.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0147533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0038800600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0281154140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1391.6 < 1402.73
  -> Decision False in time 0.0700000000, query time of that 0.0600622480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2077.36 < 2268.77
  -> Decision False in time 0.0000000000, query time of that 0.0031567050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1800.33 < 1807.34
  -> Decision False in time 0.0200000000, query time of that 0.0070670480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1228.58 < 1315.45
  -> Decision False in time 0.0100000000, query time of that 0.0068144100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2006.27 < 2048.65
  -> Decision False in time 0.0100000000, query time of that 0.0035137520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1196.22 < 1203.17
  -> Decision False in time 0.0300000000, query time of that 0.0034187910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
749.955 < 751.704
  -> Decision False in time 0.0100000000, query time of that 0.0035844040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 369.35000000000036
Index size:  233528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0397904640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3900000000, query time of that 0.3875079630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.8400000000, query time of that 3.7873774560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0418887670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4133165450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.2000000000, query time of that 4.0500617700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0493683970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.5514352150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7500000000, query time of that 5.7796798170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 388.75
Index size:  245456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0235454450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2202541970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.2600000000, query time of that 2.2111553550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0245939280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2559038220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.6900000000, query time of that 2.5490721400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0271453860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.3048833590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1600000000, query time of that 3.3243506710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 77.27000000000044
Index size:  189060.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0356883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046914040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1759.22 < 2022.57
  -> Decision False in time 0.0200000000, query time of that 0.0128946310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1666.9 < 1733.19
  -> Decision False in time 0.0200000000, query time of that 0.0110611600, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0044306430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1765 < 1916.98
  -> Decision False in time 0.0000000000, query time of that 0.0038706380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1684.25 < 2163.69
  -> Decision False in time 0.0300000000, query time of that 0.0125135080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1678.7 < 1713.12
  -> Decision False in time 0.0200000000, query time of that 0.0047927000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2202.3 < 2218.94
  -> Decision False in time 0.0100000000, query time of that 0.0036989890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1211.75 < 1928.54
  -> Decision False in time 0.0100000000, query time of that 0.0037596400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 76.90999999999985
Index size:  142800.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0952833333
  Testing...
|S| = 20
|T| = 283
Reject!
1823.78 < 1877.8
  -> Decision False in time 0.0000000000, query time of that 0.0027665500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2066.37 < 2086.43
  -> Decision False in time 0.0200000000, query time of that 0.0138133330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2078.32 < 2514.27
  -> Decision False in time 0.0100000000, query time of that 0.0026744730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1512.05 < 1525.21
  -> Decision False in time 0.0000000000, query time of that 0.0026559990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1357.38 < 1411.5
  -> Decision False in time 0.0100000000, query time of that 0.0024565290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1719.9 < 1733.48
  -> Decision False in time 0.0100000000, query time of that 0.0063191500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1591.29 < 1626.46
  -> Decision False in time 0.0100000000, query time of that 0.0028352370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1788.47 < 2134.47
  -> Decision False in time 0.0000000000, query time of that 0.0028099690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1720.86 < 1809.76
  -> Decision False in time 0.0000000000, query time of that 0.0029419580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 111.38000000000102
Index size:  190224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067222170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0565968570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5900000000, query time of that 0.5492796790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065075880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0625566480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1480.27 < 1523.26
  -> Decision False in time 0.0700000000, query time of that 0.0575429750, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0064287020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2128.79 < 2151.72
  -> Decision False in time 0.2100000000, query time of that 0.0195419160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1187.05 < 1208.4
  -> Decision False in time 0.6200000000, query time of that 0.0481547830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 369.2999999999993
Index size:  245408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0170446830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1681269360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.6358628500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0195158710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1923488520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0200000000, query time of that 1.8338656790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0216314800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.2007750770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2800000000, query time of that 2.0459753730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 369.27000000000044
Index size:  256004.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0247331630, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2436135120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3100000000, query time of that 2.2606374130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0256798030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2340251520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.6500000000, query time of that 2.5010399030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0273337110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.3050077170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1800000000, query time of that 3.2868689810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 147.89999999999964
Index size:  204540.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0068043460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0561915710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5564691270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0063844450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0639723080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1638.56 < 1639.04
  -> Decision False in time 0.0700000000, query time of that 0.0536628160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0063988010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1901.1 < 2047.49
  -> Decision False in time 0.6700000000, query time of that 0.0551079930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1176.95 < 1234.4
  -> Decision False in time 0.3900000000, query time of that 0.0327936470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 391.15000000000146
Index size:  249720.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0151176380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1359239600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.3201079740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0150864570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1494026640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6200000000, query time of that 1.4710620920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0145247590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1506545150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8100000000, query time of that 1.5215375800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 393.85000000000036
Index size:  211664.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0173787300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1436260100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4700000000, query time of that 1.4252759570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0164073350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1693153120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7600000000, query time of that 1.6292818550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0160222240, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1698358320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8500000000, query time of that 1.7099966120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 370.0
Index size:  212280.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076056050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0664482500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6509985090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0070699190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0732960180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.7293589090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0074689100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0730059080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1880.83 < 1912.49
  -> Decision False in time 1.3600000000, query time of that 0.1222752070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 113.42000000000007
Index size:  199792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0183600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035184470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1367.68 < 1368.24
  -> Decision False in time 0.0000000000, query time of that 0.0081908190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2220.52 < 2233.57
  -> Decision False in time 0.1500000000, query time of that 0.1269066770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028063950, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1687.64 < 1705.64
  -> Decision False in time 0.0100000000, query time of that 0.0031629570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1448.98 < 1461.87
  -> Decision False in time 0.0500000000, query time of that 0.0224492500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1753.42 < 1825.81
  -> Decision False in time 0.0000000000, query time of that 0.0030397240, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1121.65 < 1174.69
  -> Decision False in time 0.0200000000, query time of that 0.0032882990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1918.26 < 1936.43
  -> Decision False in time 0.0100000000, query time of that 0.0033719840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 393.3099999999995
Index size:  262400.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0127693340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1225420820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2200000000, query time of that 1.1741868490, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0122488790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1369007720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5400000000, query time of that 1.3387307870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0137781720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1414766390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9200000000, query time of that 1.3470490580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 112.72999999999956
Index size:  191536.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0505550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029089180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2308.46 < 2334.05
  -> Decision False in time 0.0100000000, query time of that 0.0105492760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1690.64 < 1712.03
  -> Decision False in time 0.0500000000, query time of that 0.0362920590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1428.42 < 1547.18
  -> Decision False in time 0.0100000000, query time of that 0.0017370620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1343.78 < 1347.97
  -> Decision False in time 0.0000000000, query time of that 0.0019040580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1467.17 < 1507.5
  -> Decision False in time 0.0200000000, query time of that 0.0040061050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1137.85 < 1338.08
  -> Decision False in time 0.0300000000, query time of that 0.0025311400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
509.999 < 513.606
  -> Decision False in time 0.0000000000, query time of that 0.0021673530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1219.87 < 1269.15
  -> Decision False in time 0.0100000000, query time of that 0.0020846650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 147.8700000000008
Index size:  187268.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082284270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0693018080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6975194190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076140000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0791794010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1208.66 < 1287.98
  -> Decision False in time 0.3800000000, query time of that 0.3596161990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0081406530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1523.37 < 1556.08
  -> Decision False in time 0.2500000000, query time of that 0.0273207340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1026.48 < 1126.8
  -> Decision False in time 0.4500000000, query time of that 0.0431797210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 391.15999999999985
Index size:  255044.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079607450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0752125220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7592044990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086551350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0892581230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.8570097970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0083475450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0857046760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8400000000, query time of that 0.8507220230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 372.40000000000146
Index size:  207044.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046249610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0349809140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1365.94 < 1371.71
  -> Decision False in time 0.0900000000, query time of that 0.0836170600, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038454270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1609.25 < 1647.38
  -> Decision False in time 0.0100000000, query time of that 0.0042115000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1231.04 < 1308.65
  -> Decision False in time 0.2100000000, query time of that 0.1142800160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0042217820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0424247440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1170.96 < 1205.17
  -> Decision False in time 1.2300000000, query time of that 0.0642116220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.0
Index size:  195692.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8168650000
  Testing...
|S| = 20
|T| = 283
Reject!
1708.94 < 2021.79
  -> Decision False in time 0.0100000000, query time of that 0.0015563130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1786.83 < 1814.21
  -> Decision False in time 0.0000000000, query time of that 0.0009117540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1856.83 < 1869.9
  -> Decision False in time 0.0000000000, query time of that 0.0009238830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1233.31 < 1350.93
  -> Decision False in time 0.0000000000, query time of that 0.0009005410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2306.28 < 2391.51
  -> Decision False in time 0.0000000000, query time of that 0.0008576870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2056.8 < 2437.76
  -> Decision False in time 0.0000000000, query time of that 0.0008315870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1863.59 < 2256.31
  -> Decision False in time 0.0000000000, query time of that 0.0008305030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2250.51 < 2340.24
  -> Decision False in time 0.0000000000, query time of that 0.0009240010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2041.56 < 2178.06
  -> Decision False in time 0.0000000000, query time of that 0.0009166590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 147.22000000000116
Index size:  179524.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0769966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0026814650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1436.73 < 1447.61
  -> Decision False in time 0.0100000000, query time of that 0.0075956950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1737.42 < 1742.19
  -> Decision False in time 0.0100000000, query time of that 0.0111736310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0019855580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1826.62 < 1877.32
  -> Decision False in time 0.0100000000, query time of that 0.0023447680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1054.6 < 1078.3
  -> Decision False in time 0.0000000000, query time of that 0.0021182020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
956.138 < 1059.6
  -> Decision False in time 0.0000000000, query time of that 0.0021000400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1503.21 < 1543.38
  -> Decision False in time 0.0100000000, query time of that 0.0022836680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1239.5 < 1267.26
  -> Decision False in time 0.0400000000, query time of that 0.0020802290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 77.04999999999927
Index size:  183608.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5941633333
  Testing...
|S| = 20
|T| = 283
Reject!
1913.96 < 1925.74
  -> Decision False in time 0.0000000000, query time of that 0.0019385170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1680.66 < 1987.5
  -> Decision False in time 0.0100000000, query time of that 0.0013726330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2077.08 < 2334.24
  -> Decision False in time 0.0000000000, query time of that 0.0012826780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2759.08 < 2823.48
  -> Decision False in time 0.0000000000, query time of that 0.0011876190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2065.08 < 2093.96
  -> Decision False in time 0.0000000000, query time of that 0.0012986000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1525.98 < 1605.38
  -> Decision False in time 0.0000000000, query time of that 0.0011385170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2836.31 < 2859.28
  -> Decision False in time 0.0100000000, query time of that 0.0011891000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1865.4 < 1922.73
  -> Decision False in time 0.0000000000, query time of that 0.0011984800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2216.36 < 2289.88
  -> Decision False in time 0.0000000000, query time of that 0.0011716170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 369.4399999999987
Index size:  250640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059751860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0518582600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.5027294920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057239180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0569069190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.5723427460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0060979960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0593167620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1506.86 < 1525.15
  -> Decision False in time 4.1100000000, query time of that 0.2881685540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 147.75
Index size:  203412.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0023983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062064310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0486897340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5300000000, query time of that 0.4815400670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052312650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0552099320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1321.78 < 1471.61
  -> Decision False in time 0.1300000000, query time of that 0.0905565620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1671.05 < 2009.63
  -> Decision False in time 0.0700000000, query time of that 0.0056870860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1784.68 < 1851.86
  -> Decision False in time 0.0500000000, query time of that 0.0059058460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1374.86 < 1377.62
  -> Decision False in time 0.1600000000, query time of that 0.0115458230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 391.0400000000009
Index size:  240744.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0069610840, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0593100130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6400000000, query time of that 0.5906975760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064941510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0660784040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.6633616570, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0067905540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0663178890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1476.09 < 1487.69
  -> Decision False in time 0.4200000000, query time of that 0.0375078960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 111.90000000000146
Index size:  190140.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1232016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0025923690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1747.73 < 1783.86
  -> Decision False in time 0.0000000000, query time of that 0.0038666640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1131.36 < 1148.43
  -> Decision False in time 0.0100000000, query time of that 0.0029388010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
982.343 < 1029.86
  -> Decision False in time 0.0000000000, query time of that 0.0018357570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1373.41 < 1434.4
  -> Decision False in time 0.0100000000, query time of that 0.0018645380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2611.24 < 2624.37
  -> Decision False in time 0.0100000000, query time of that 0.0038924700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1671.73 < 1704.89
  -> Decision False in time 0.0000000000, query time of that 0.0019501650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1212.52 < 1277.79
  -> Decision False in time 0.0100000000, query time of that 0.0018729690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1867.89 < 1900.68
  -> Decision False in time 0.0000000000, query time of that 0.0020245780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 77.43000000000029
Index size:  180240.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0464366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0040137020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1970.67 < 2010.84
  -> Decision False in time 0.0200000000, query time of that 0.0122542950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2150.97 < 2188.41
  -> Decision False in time 0.0000000000, query time of that 0.0077859420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0034809930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2107.78 < 2158.09
  -> Decision False in time 0.0100000000, query time of that 0.0076934190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2425.39 < 2446.63
  -> Decision False in time 0.0000000000, query time of that 0.0035210770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2055.56 < 2210.14
  -> Decision False in time 0.0100000000, query time of that 0.0033740470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1757.09 < 1774.65
  -> Decision False in time 0.0500000000, query time of that 0.0035466320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1861.89 < 1872.01
  -> Decision False in time 0.0100000000, query time of that 0.0038439580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 112.20000000000073
Index size:  189256.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5628233333
  Testing...
|S| = 20
|T| = 283
Reject!
1544.94 < 1699.4
  -> Decision False in time 0.0000000000, query time of that 0.0021381100, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1974.36 < 1999.14
  -> Decision False in time 0.0100000000, query time of that 0.0018363340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1737.2 < 1814.3
  -> Decision False in time 0.0000000000, query time of that 0.0019508410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
568.97 < 644.39
  -> Decision False in time 0.0000000000, query time of that 0.0011928630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1224.56 < 1303.56
  -> Decision False in time 0.0000000000, query time of that 0.0013492590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1710.88 < 1768.5
  -> Decision False in time 0.0100000000, query time of that 0.0013500180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1168.54 < 1375.9
  -> Decision False in time 0.0000000000, query time of that 0.0012524840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1869.94 < 2114.97
  -> Decision False in time 0.0000000000, query time of that 0.0012351730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1402.15 < 1834.84
  -> Decision False in time 0.0000000000, query time of that 0.0012146850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 77.41999999999825
Index size:  183732.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0165083333
  Testing...
|S| = 20
|T| = 283
Reject!
1484.03 < 1503.34
  -> Decision False in time 0.0100000000, query time of that 0.0065158470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1668.97 < 1714.24
  -> Decision False in time 0.0200000000, query time of that 0.0189557090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1870.79 < 1900.55
  -> Decision False in time 0.0800000000, query time of that 0.0740740330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057861590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2110.14 < 2153.28
  -> Decision False in time 0.0100000000, query time of that 0.0062959370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1898.69 < 1901.15
  -> Decision False in time 0.0000000000, query time of that 0.0063246130, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1687.43 < 1716.11
  -> Decision False in time 0.0100000000, query time of that 0.0060831260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1948.97 < 1988.29
  -> Decision False in time 0.0900000000, query time of that 0.0094217780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1194.47 < 1405.63
  -> Decision False in time 0.0200000000, query time of that 0.0064772840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 146.97999999999956
Index size:  192916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0268266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0033359400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1505.45 < 1514.36
  -> Decision False in time 0.0200000000, query time of that 0.0128685600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1351.26 < 1427.63
  -> Decision False in time 0.1400000000, query time of that 0.1168422410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0023725750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1868.95 < 1889.22
  -> Decision False in time 0.0200000000, query time of that 0.0063374670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1290.02 < 1294.23
  -> Decision False in time 0.0100000000, query time of that 0.0054615550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1317.7 < 1366.63
  -> Decision False in time 0.0100000000, query time of that 0.0027746470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1348.82 < 1374.8
  -> Decision False in time 0.0600000000, query time of that 0.0027386200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1311.71 < 1346.75
  -> Decision False in time 0.1200000000, query time of that 0.0058285620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 147.47999999999956
Index size:  191664.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2102333333
  Testing...
|S| = 20
|T| = 283
Reject!
2191.24 < 2327.86
  -> Decision False in time 0.0000000000, query time of that 0.0025999320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1496.9 < 1664.5
  -> Decision False in time 0.0100000000, query time of that 0.0023610200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1871.49 < 1956.63
  -> Decision False in time 0.0100000000, query time of that 0.0063961960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1976.48 < 2012.68
  -> Decision False in time 0.0000000000, query time of that 0.0016091140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1288.55 < 1474.19
  -> Decision False in time 0.0000000000, query time of that 0.0017219590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1321.28 < 1321.31
  -> Decision False in time 0.0100000000, query time of that 0.0016571930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1837.04 < 1946
  -> Decision False in time 0.0000000000, query time of that 0.0017963590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1109.85 < 1260.08
  -> Decision False in time 0.0000000000, query time of that 0.0018236940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1244.08 < 1256.97
  -> Decision False in time 0.0000000000, query time of that 0.0017142600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 369.2400000000016
Index size:  246080.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0093651780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0789412140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7722939220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0081299120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0872220120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.8806255200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0090360880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0877901070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8400000000, query time of that 0.8762138680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 389.84000000000015
Index size:  258756.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0096456380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1032702340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0800000000, query time of that 1.0337394260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117392280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1186594720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.1662183550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0112800910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1161280490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7800000000, query time of that 1.1838564980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 147.63999999999942
Index size:  192096.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0007433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0111970990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1017591070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.9937753060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101215520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1133775120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
859.704 < 864.343
  -> Decision False in time 0.4700000000, query time of that 0.4456645690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0120435780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1425.3 < 1446.17
  -> Decision False in time 0.2900000000, query time of that 0.0494512410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1818.83 < 1841.58
  -> Decision False in time 1.1900000000, query time of that 0.1676411250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 370.1100000000006
Index size:  225720.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0824200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029623360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0206811320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1615.64 < 1632.34
  -> Decision False in time 0.0200000000, query time of that 0.0177124500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1108.91 < 1127.47
  -> Decision False in time 0.0100000000, query time of that 0.0022416120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1257.68 < 1274.39
  -> Decision False in time 0.0000000000, query time of that 0.0022838620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
847.927 < 946.117
  -> Decision False in time 0.0100000000, query time of that 0.0050752440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1284.36 < 1310.18
  -> Decision False in time 0.0000000000, query time of that 0.0024856840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1134.82 < 1179.36
  -> Decision False in time 0.0100000000, query time of that 0.0024867990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1947.74 < 1961.56
  -> Decision False in time 0.0000000000, query time of that 0.0024128010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 77.45999999999913
Index size:  195264.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0226650000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056502170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0465023720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1603.59 < 2116.84
  -> Decision False in time 0.0300000000, query time of that 0.0328407300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1466.25 < 1483.11
  -> Decision False in time 0.0100000000, query time of that 0.0049789910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0527172180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1862.78 < 1887.28
  -> Decision False in time 0.0600000000, query time of that 0.0399947310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1398.48 < 1474.79
  -> Decision False in time 0.0400000000, query time of that 0.0052186730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2072.54 < 2096.82
  -> Decision False in time 0.0900000000, query time of that 0.0081195150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1829.29 < 1896.54
  -> Decision False in time 0.1100000000, query time of that 0.0112906320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 112.29000000000087
Index size:  171968.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0091666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0043151850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0327029800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1241.4 < 1296.58
  -> Decision False in time 0.1700000000, query time of that 0.1458924010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033636960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0379533600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1718.35 < 1819.32
  -> Decision False in time 0.0500000000, query time of that 0.0270750270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0035920460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1837.46 < 1897.92
  -> Decision False in time 0.0800000000, query time of that 0.0060403320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1494.5 < 1516.73
  -> Decision False in time 0.0200000000, query time of that 0.0039030590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 391.77999999999884
Index size:  261220.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0224501630, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2086009250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1300000000, query time of that 2.0915705890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0211868620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2225033800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4300000000, query time of that 2.3242849630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0258467890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.2721075970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1300000000, query time of that 2.9983960910, with c1=5.0000000000, c2=0.1000000000
