copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 367.48
Index size:  466252.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0093063220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0729437400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7200000000, query time of that 0.6726148850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0079584730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0771473650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.7578324560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0078778200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0747974160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2023.6 < 2046.61
  -> Decision False in time 8.0500000000, query time of that 0.7254324630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 146.59000000000003
Index size:  212064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0088516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0061173510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0335830250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3308794360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038039510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1793.82 < 1819.5
  -> Decision False in time 0.0300000000, query time of that 0.0157911740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1780.03 < 1789
  -> Decision False in time 0.0500000000, query time of that 0.0250067890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0038621840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1058.67 < 1063.86
  -> Decision False in time 0.0100000000, query time of that 0.0041210580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2009.22 < 2057.45
  -> Decision False in time 0.0600000000, query time of that 0.0036166330, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 366.20000000000016
Index size:  247804.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0125785320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1168358540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1900000000, query time of that 1.1447997610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0137770720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1240561390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4900000000, query time of that 1.3140374110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0145236960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1304617390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8500000000, query time of that 1.3053086610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 385.93000000000006
Index size:  254780.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0154508660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1545017390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6300000000, query time of that 1.5812258540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0193441550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1836811690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9700000000, query time of that 1.8072556740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0198051040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1852513860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4500000000, query time of that 2.0468122050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 366.6500000000001
Index size:  210368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0221831750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2272015640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3600000000, query time of that 2.3143295240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0258177780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2688603090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7800000000, query time of that 2.6449693280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0316932700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.3099747100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.1300000000, query time of that 3.2770379850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 76.65000000000009
Index size:  193796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5917066667
  Testing...
|S| = 20
|T| = 283
Reject!
1926.85 < 2016.43
  -> Decision False in time 0.0100000000, query time of that 0.0015470650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1973.86 < 2015.33
  -> Decision False in time 0.0000000000, query time of that 0.0009799080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1980.55 < 2020.02
  -> Decision False in time 0.0100000000, query time of that 0.0009198190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2073.78 < 2163.46
  -> Decision False in time 0.0000000000, query time of that 0.0009005170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2176.73 < 2414.72
  -> Decision False in time 0.0100000000, query time of that 0.0008630040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1528.73 < 1613.41
  -> Decision False in time 0.0000000000, query time of that 0.0009166290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1286.52 < 1568.51
  -> Decision False in time 0.0100000000, query time of that 0.0008725800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2127.43 < 2291.44
  -> Decision False in time 0.0000000000, query time of that 0.0009063890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2118.71 < 2169.96
  -> Decision False in time 0.0100000000, query time of that 0.0008411760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 111.11999999999989
Index size:  171200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059951470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0516421900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5599285980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0064976530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0642574360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1440.63 < 1472.68
  -> Decision False in time 0.5500000000, query time of that 0.4225540480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0065835440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1317.96 < 1433.32
  -> Decision False in time 0.0800000000, query time of that 0.0094756340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1492.86 < 1546.17
  -> Decision False in time 0.6200000000, query time of that 0.0477467750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 366.3600000000001
Index size:  250068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0828183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030966860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2060.49 < 2073.04
  -> Decision False in time 0.0100000000, query time of that 0.0064719470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2321.04 < 2437.66
  -> Decision False in time 0.0100000000, query time of that 0.0096809600, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1462.3 < 1480.76
  -> Decision False in time 0.0000000000, query time of that 0.0023212490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1575.47 < 1594.6
  -> Decision False in time 0.0100000000, query time of that 0.0024224050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1312.06 < 1379
  -> Decision False in time 0.0100000000, query time of that 0.0026521150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1814.27 < 1869.72
  -> Decision False in time 0.0000000000, query time of that 0.0025979900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1593.7 < 1611.68
  -> Decision False in time 0.0000000000, query time of that 0.0025105140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
443.044 < 463.964
  -> Decision False in time 0.0400000000, query time of that 0.0025785010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 146.34000000000015
Index size:  203596.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0018183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0069682570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0582157920, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6100000000, query time of that 0.5720714920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0069672990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0654358680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1658.83 < 1862.34
  -> Decision False in time 0.0800000000, query time of that 0.0674133620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0068273650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0659570740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1728.58 < 1732
  -> Decision False in time 0.0600000000, query time of that 0.0069885140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 111.75
Index size:  188576.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2829516667
  Testing...
|S| = 20
|T| = 283
Reject!
2164.55 < 2279.51
  -> Decision False in time 0.0000000000, query time of that 0.0023388510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2217.38 < 2407.52
  -> Decision False in time 0.0100000000, query time of that 0.0028171250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1600.54 < 1604.61
  -> Decision False in time 0.0000000000, query time of that 0.0020467190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1957.05 < 1957.16
  -> Decision False in time 0.0000000000, query time of that 0.0016496680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1110.98 < 1145.9
  -> Decision False in time 0.0000000000, query time of that 0.0016233140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1505.92 < 1512.08
  -> Decision False in time 0.0000000000, query time of that 0.0015996110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1982.17 < 2077.19
  -> Decision False in time 0.0100000000, query time of that 0.0016784370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1899.07 < 1928.79
  -> Decision False in time 0.0000000000, query time of that 0.0016108230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1496.04 < 1648.7
  -> Decision False in time 0.0000000000, query time of that 0.0015103610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 387.3899999999999
Index size:  247016.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0228275820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1946122140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.0100000000, query time of that 1.9669902860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0257662130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2340072550, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4000000000, query time of that 2.2025868610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0257871140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2495849700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6300000000, query time of that 2.5461080070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 146.84999999999945
Index size:  191496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049507200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0404273440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4142402020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0048034140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1847.78 < 1936.53
  -> Decision False in time 0.0600000000, query time of that 0.0337068870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1380.39 < 1416.36
  -> Decision False in time 0.1500000000, query time of that 0.0942003160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0048164830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1754.57 < 1778.67
  -> Decision False in time 0.0900000000, query time of that 0.0072387600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1838.41 < 1881.29
  -> Decision False in time 0.1800000000, query time of that 0.0151124980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 146.75
Index size:  174536.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4557600000
  Testing...
|S| = 20
|T| = 283
Reject!
1999.82 < 2002.09
  -> Decision False in time 0.0100000000, query time of that 0.0022382230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1802.42 < 1806.63
  -> Decision False in time 0.0000000000, query time of that 0.0024985850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1600.35 < 1627.87
  -> Decision False in time 0.0100000000, query time of that 0.0038456170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1515.08 < 1525.95
  -> Decision False in time 0.0000000000, query time of that 0.0014358560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1582.32 < 1645.86
  -> Decision False in time 0.0000000000, query time of that 0.0015759280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1219.77 < 1309.34
  -> Decision False in time 0.0100000000, query time of that 0.0035426050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1758.91 < 1781.27
  -> Decision False in time 0.0100000000, query time of that 0.0018690090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2274.32 < 2286.85
  -> Decision False in time 0.0000000000, query time of that 0.0018981780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1719.67 < 1779.48
  -> Decision False in time 0.0100000000, query time of that 0.0018017000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 112.03999999999996
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0522616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0029559040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1562.37 < 1563.89
  -> Decision False in time 0.0200000000, query time of that 0.0103288540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1092.42 < 1106.34
  -> Decision False in time 0.0300000000, query time of that 0.0254647730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0022015280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1653.63 < 1801.94
  -> Decision False in time 0.0000000000, query time of that 0.0025976590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1470 < 1478.93
  -> Decision False in time 0.0100000000, query time of that 0.0024727700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1133.21 < 1171.08
  -> Decision False in time 0.0200000000, query time of that 0.0026398090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1663.14 < 1667.84
  -> Decision False in time 0.0100000000, query time of that 0.0026409000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1792.32 < 1810.8
  -> Decision False in time 0.0200000000, query time of that 0.0024662880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 368.8800000000001
Index size:  249128.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0405299160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3773901870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.7900000000, query time of that 3.7360803540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0445278500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4200000000, query time of that 0.3951483630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.2600000000, query time of that 4.1099044980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0438588760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.5324690220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1600000000, query time of that 5.3869903730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 390.4499999999998
Index size:  248912.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0268636550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2669256830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.6600000000, query time of that 2.6156993570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0325009170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3200000000, query time of that 0.2869559350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.0700000000, query time of that 2.9823538850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0321295360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.3616281470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0000000000, query time of that 3.8091873150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 146.32000000000062
Index size:  195448.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079992950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0769939530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7693808890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082499160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0891866790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1849.9 < 1896.14
  -> Decision False in time 0.8700000000, query time of that 0.8051439640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0091005750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0872526040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1791.42 < 1808.39
  -> Decision False in time 2.9000000000, query time of that 0.3026991460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 146.96000000000004
Index size:  182468.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0765150000
  Testing...
|S| = 20
|T| = 283
Reject!
2098.51 < 2321.58
  -> Decision False in time 0.0000000000, query time of that 0.0028264930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1929.46 < 2316.52
  -> Decision False in time 0.0200000000, query time of that 0.0136963860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
702.177 < 736.911
  -> Decision False in time 0.0100000000, query time of that 0.0056660820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2009.7 < 2022.61
  -> Decision False in time 0.0000000000, query time of that 0.0020841370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1768.45 < 1815.85
  -> Decision False in time 0.0000000000, query time of that 0.0021626660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1124.61 < 1155.57
  -> Decision False in time 0.0000000000, query time of that 0.0022236770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1413.55 < 1447.66
  -> Decision False in time 0.0100000000, query time of that 0.0022913090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1725.01 < 2121.05
  -> Decision False in time 0.0000000000, query time of that 0.0022965750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1286.32 < 1287.45
  -> Decision False in time 0.0100000000, query time of that 0.0023081820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 147.35000000000036
Index size:  188304.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2121300000
  Testing...
|S| = 20
|T| = 283
Reject!
921.728 < 926.662
  -> Decision False in time 0.0000000000, query time of that 0.0026112920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1381.79 < 1483.29
  -> Decision False in time 0.0100000000, query time of that 0.0055441320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1725.75 < 1795.89
  -> Decision False in time 0.0000000000, query time of that 0.0022369020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1774.32 < 1795.89
  -> Decision False in time 0.0000000000, query time of that 0.0017846950, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1848.84 < 1868.19
  -> Decision False in time 0.0100000000, query time of that 0.0017123050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1786.08 < 1852.54
  -> Decision False in time 0.0000000000, query time of that 0.0019076040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
775.081 < 881.766
  -> Decision False in time 0.0000000000, query time of that 0.0017667230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1788.08 < 1852.96
  -> Decision False in time 0.0000000000, query time of that 0.0019436300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1838.49 < 1871.82
  -> Decision False in time 0.0100000000, query time of that 0.0018480960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 77.65000000000055
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0451716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042991030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1448.24 < 1602.18
  -> Decision False in time 0.0200000000, query time of that 0.0175340780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1168.91 < 1910.44
  -> Decision False in time 0.0200000000, query time of that 0.0201580000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2072.48 < 2179.07
  -> Decision False in time 0.0100000000, query time of that 0.0034167530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1387.71 < 1756.87
  -> Decision False in time 0.0000000000, query time of that 0.0035195890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1643.19 < 1777.7
  -> Decision False in time 0.0500000000, query time of that 0.0270584440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1496.23 < 1760.05
  -> Decision False in time 0.0100000000, query time of that 0.0037597020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1961.48 < 2014.88
  -> Decision False in time 0.0000000000, query time of that 0.0037270070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2033.85 < 2323.34
  -> Decision False in time 0.0100000000, query time of that 0.0035432030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 77.3100000000004
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0314500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0049406570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1860.57 < 1877.6
  -> Decision False in time 0.0100000000, query time of that 0.0076627740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1900.71 < 1927.87
  -> Decision False in time 0.0200000000, query time of that 0.0170317220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039826830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1476.77 < 1522.6
  -> Decision False in time 0.0300000000, query time of that 0.0187514290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1969.34 < 1980.69
  -> Decision False in time 0.0500000000, query time of that 0.0284352970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1422.75 < 1483.52
  -> Decision False in time 0.0800000000, query time of that 0.0047896020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1294.4 < 1364.63
  -> Decision False in time 0.2200000000, query time of that 0.0142660110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1555.75 < 1645.93
  -> Decision False in time 0.0000000000, query time of that 0.0050954060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 147.02000000000044
Index size:  190680.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0025666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058882150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0496342830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5400000000, query time of that 0.4943022370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0054903840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0570903660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1637.66 < 1640.13
  -> Decision False in time 0.3700000000, query time of that 0.2734513270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0059806200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1938.77 < 1948.45
  -> Decision False in time 0.3500000000, query time of that 0.0260891510, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1518.25 < 1611.44
  -> Decision False in time 0.6300000000, query time of that 0.0465881850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 147.4300000000003
Index size:  190568.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0144600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039131870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0294473310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.2866728320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0033717640, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1329.98 < 1339.22
  -> Decision False in time 0.0200000000, query time of that 0.0105984740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1550.21 < 1681.91
  -> Decision False in time 0.0800000000, query time of that 0.0392299190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0035614130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1351.35 < 1354.55
  -> Decision False in time 0.0700000000, query time of that 0.0037708950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1411 < 1450.56
  -> Decision False in time 0.0200000000, query time of that 0.0036904230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 390.1700000000001
Index size:  258020.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089394080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0765817660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7796570450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0092641710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0872003540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.8818230720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0092940440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0886483470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1725.2 < 1730.63
  -> Decision False in time 7.7500000000, query time of that 0.8101852450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 390.2600000000002
Index size:  211060.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0390685120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3837167300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.7000000000, query time of that 3.6510175730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0411608210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4400000000, query time of that 0.4122142720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.1000000000, query time of that 3.9810521400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0512047620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0900000000, query time of that 0.5414061350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.7600000000, query time of that 5.5197104630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 145.9400000000005
Index size:  198548.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072797430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0658971760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.7133183200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0078624140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0839396800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1667.91 < 1721.47
  -> Decision False in time 0.6800000000, query time of that 0.6366025370, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0084084350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1580.73 < 1693.43
  -> Decision False in time 0.7100000000, query time of that 0.0664359480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1434.21 < 1484.88
  -> Decision False in time 1.5200000000, query time of that 0.1518312370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 368.6800000000003
Index size:  241772.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0100334610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0925730700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.9006674270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0092298700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1026908740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2200000000, query time of that 1.0282227960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0109075300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1014309550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6600000000, query time of that 1.0249194560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 389.15000000000146
Index size:  250660.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0097731250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0899270990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9076708610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092874390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1050941660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2000000000, query time of that 1.0241360830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0111823800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1025708680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6400000000, query time of that 1.0287094690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 389.10999999999876
Index size:  214768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0116009790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1024958970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0900000000, query time of that 1.0472685660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115770680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1170413310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.1997584220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0119292850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1164751490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.5900000000, query time of that 1.2015773690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 388.0100000000002
Index size:  233332.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0214137600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2312363430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3400000000, query time of that 2.2840508590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0256265320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2448108790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.6800000000, query time of that 2.5389594080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0299100930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.2957475100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0200000000, query time of that 3.1567640930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 387.9200000000001
Index size:  225988.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0369318360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.4185139490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.2900000000, query time of that 4.2312155340, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0494102060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4766519780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.8600000000, query time of that 4.7347516160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0530419750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.6291362290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2900000000, query time of that 6.1903982900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 385.72000000000116
Index size:  228876.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0149505250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1308774670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.2987241930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0151789220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1428763980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6400000000, query time of that 1.5108297860, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0159234210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1621681870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6800000000, query time of that 1.5417618480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 110.4900000000016
Index size:  195052.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0114014800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0988248700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9752244060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0114909480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1125131270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.1106482380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0112413130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1105403090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
544.359 < 588.162
  -> Decision False in time 7.1900000000, query time of that 0.9575455400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 367.0500000000011
Index size:  247484.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046971470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0363839350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1979.97 < 1987.67
  -> Decision False in time 0.3100000000, query time of that 0.2829522570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039131510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1356.99 < 1362.39
  -> Decision False in time 0.0300000000, query time of that 0.0170288730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1097.33 < 1105.98
  -> Decision False in time 0.7400000000, query time of that 0.4035068720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0042070820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1156.86 < 1159.12
  -> Decision False in time 0.1700000000, query time of that 0.0109662700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1681.38 < 1700.63
  -> Decision False in time 0.1900000000, query time of that 0.0129663800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 111.14999999999964
Index size:  200000.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1233816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0025318110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1603.97 < 1655.84
  -> Decision False in time 0.0100000000, query time of that 0.0038851450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1551.78 < 1798.24
  -> Decision False in time 0.0000000000, query time of that 0.0038510150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1865.59 < 1873.68
  -> Decision False in time 0.0000000000, query time of that 0.0019432220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1680.62 < 1867.73
  -> Decision False in time 0.0100000000, query time of that 0.0018964850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1308.62 < 1316.04
  -> Decision False in time 0.0000000000, query time of that 0.0020943010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1036.46 < 1050.56
  -> Decision False in time 0.0100000000, query time of that 0.0021399890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2048.37 < 2261.02
  -> Decision False in time 0.0000000000, query time of that 0.0021456930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2092.84 < 2226.4
  -> Decision False in time 0.0000000000, query time of that 0.0019255880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 76.67000000000007
Index size:  183836.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0148500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065442180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0568532180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1850 < 1860.8
  -> Decision False in time 0.0500000000, query time of that 0.0514095040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065011750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1915.94 < 1997.55
  -> Decision False in time 0.0600000000, query time of that 0.0461744160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1684.74 < 1702.9
  -> Decision False in time 0.0800000000, query time of that 0.0642917500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1716.68 < 1717.68
  -> Decision False in time 0.0700000000, query time of that 0.0066629900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1293.02 < 1316.92
  -> Decision False in time 0.1600000000, query time of that 0.0132288360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1763.54 < 1768.5
  -> Decision False in time 0.0100000000, query time of that 0.0071684550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 367.369999999999
Index size:  251384.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0093954070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0803339600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7801106910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0079902900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0903187520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1400000000, query time of that 0.8936981900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0089099120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.0906455380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7400000000, query time of that 0.8743413340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 366.5
Index size:  248292.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057540360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0462162410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4415975580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049882310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0512206380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1939.01 < 1959.47
  -> Decision False in time 0.4300000000, query time of that 0.2735339570, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049781720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0523462950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1562.92 < 1577.69
  -> Decision False in time 2.1900000000, query time of that 0.1382137000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 386.14999999999964
Index size:  250124.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0250251660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2198687650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1700000000, query time of that 2.1278278720, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0235777070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2277564540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5600000000, query time of that 2.3263155500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0224821560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.2622004460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6200000000, query time of that 2.7390858330, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 75.88999999999942
Index size:  187768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8027616667
  Testing...
|S| = 20
|T| = 283
Reject!
1098.64 < 1251.67
  -> Decision False in time 0.0000000000, query time of that 0.0013870330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1480.5 < 1706.4
  -> Decision False in time 0.0100000000, query time of that 0.0013529440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1889.7 < 2013.52
  -> Decision False in time 0.0000000000, query time of that 0.0013423800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1619.11 < 1708.6
  -> Decision False in time 0.0100000000, query time of that 0.0009268790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1476.33 < 1582.28
  -> Decision False in time 0.0000000000, query time of that 0.0010716860, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
964.412 < 1308.46
  -> Decision False in time 0.0100000000, query time of that 0.0009891190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1868.62 < 1925.25
  -> Decision False in time 0.0000000000, query time of that 0.0009873990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1881.24 < 1928.24
  -> Decision False in time 0.0000000000, query time of that 0.0002956780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1548.66 < 1569.89
  -> Decision False in time 0.0100000000, query time of that 0.0009617130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 364.0799999999999
Index size:  196012.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0149866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035782950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0272762450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1245.23 < 1276.62
  -> Decision False in time 0.0400000000, query time of that 0.0421765570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028367290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1510.04 < 1552.64
  -> Decision False in time 0.0200000000, query time of that 0.0065232310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1663.58 < 1673.53
  -> Decision False in time 0.0100000000, query time of that 0.0065730630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1380.59 < 1400.21
  -> Decision False in time 0.0100000000, query time of that 0.0032370590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1499.44 < 1507.95
  -> Decision False in time 0.1000000000, query time of that 0.0068078510, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1586.86 < 1598.38
  -> Decision False in time 0.0900000000, query time of that 0.0066264910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 76.61000000000058
Index size:  194964.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0226450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056236820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1554.93 < 1758.68
  -> Decision False in time 0.0200000000, query time of that 0.0125913400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2161.45 < 2248.36
  -> Decision False in time 0.0200000000, query time of that 0.0237980290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1468.32 < 1551.58
  -> Decision False in time 0.0100000000, query time of that 0.0049019400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1237.87 < 1303.37
  -> Decision False in time 0.0000000000, query time of that 0.0055355000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1834.86 < 1866.34
  -> Decision False in time 0.0300000000, query time of that 0.0156129240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2086.22 < 2144.62
  -> Decision False in time 0.0000000000, query time of that 0.0054405060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1510.76 < 1525.65
  -> Decision False in time 0.2500000000, query time of that 0.0196367650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1250.71 < 1538.53
  -> Decision False in time 0.0100000000, query time of that 0.0054619640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 387.72999999999956
Index size:  244748.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0070813400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0623134870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6600000000, query time of that 0.6029419450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0066608200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0679614120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.6782610420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0071410300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0677309240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1292.14 < 1324.61
  -> Decision False in time 6.7500000000, query time of that 0.5434357780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 145.5600000000013
Index size:  189720.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0275900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0032211660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1645.39 < 1720.83
  -> Decision False in time 0.0200000000, query time of that 0.0112897960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2034.53 < 2089.8
  -> Decision False in time 0.1100000000, query time of that 0.0991071870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025890710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1023.18 < 1048.25
  -> Decision False in time 0.0100000000, query time of that 0.0058434600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1539.2 < 1745.84
  -> Decision False in time 0.0700000000, query time of that 0.0288909470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1625.53 < 1648.2
  -> Decision False in time 0.0300000000, query time of that 0.0028381090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1536.57 < 1537.61
  -> Decision False in time 0.1000000000, query time of that 0.0061561780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
957.518 < 1017.4
  -> Decision False in time 0.1400000000, query time of that 0.0061233790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 387.7599999999984
Index size:  238828.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0159825700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1436441020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4700000000, query time of that 1.4181879640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0165214300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1691505390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8200000000, query time of that 1.6059346880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0160300420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1757484970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.5500000000, query time of that 1.7648509200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 110.77999999999884
Index size:  189956.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0091266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040559380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0344630130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1359.43 < 1376.52
  -> Decision False in time 0.0500000000, query time of that 0.0473760680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037276390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0391801380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
439.03 < 475.335
  -> Decision False in time 0.0700000000, query time of that 0.0374600410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0040309120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1608.38 < 1627.21
  -> Decision False in time 0.1200000000, query time of that 0.0084186620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1741.91 < 1764.16
  -> Decision False in time 0.5400000000, query time of that 0.0289778920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 110.79999999999927
Index size:  186032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076423210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0663642040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6556082140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072176340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0747062390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1669.95 < 1735.64
  -> Decision False in time 0.3600000000, query time of that 0.3252030100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0068374230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1256.05 < 1343.12
  -> Decision False in time 0.5300000000, query time of that 0.0482487090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1567.98 < 1676.93
  -> Decision False in time 0.0500000000, query time of that 0.0082802900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 365.4800000000032
Index size:  246504.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0142364180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1248931540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2800000000, query time of that 1.2251693260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0135683620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1387868580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5600000000, query time of that 1.3879710500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0139375760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1443567310, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2700000000, query time of that 1.4308886180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 367.40000000000146
Index size:  248072.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0004816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057618480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0511007050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5138283040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0058410470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0592561520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1423.75 < 1437.6
  -> Decision False in time 0.4400000000, query time of that 0.3205857810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0060996480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0599386280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1622.82 < 1653.77
  -> Decision False in time 0.0700000000, query time of that 0.0061542930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 386.52999999999884
Index size:  253176.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0169095450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1695606040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7200000000, query time of that 1.6746699010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0158958760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1810245370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0200000000, query time of that 1.8589495140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0184774990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.2188620230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1165.73 < 1257.39
  -> Decision False in time 8.1100000000, query time of that 1.9891386050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 389.4200000000019
Index size:  215528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0133510800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1220067300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1948943800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0143939110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1327683920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4800000000, query time of that 1.3387441210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0142941260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1403358280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2152.01 < 2182.18
  -> Decision False in time 6.3700000000, query time of that 1.0783722700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 111.10000000000218
Index size:  194780.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0181733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036854420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2153.11 < 2158.65
  -> Decision False in time 0.0300000000, query time of that 0.0254672870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1842.09 < 1992.83
  -> Decision False in time 0.1100000000, query time of that 0.0945238530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031120530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1503.56 < 1605.25
  -> Decision False in time 0.0400000000, query time of that 0.0194549890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1074.13 < 1161.23
  -> Decision False in time 0.0300000000, query time of that 0.0131293860, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1095.65 < 1116.39
  -> Decision False in time 0.0200000000, query time of that 0.0031140560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1879.3 < 1887.87
  -> Decision False in time 0.0000000000, query time of that 0.0036221560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1641.16 < 1669.03
  -> Decision False in time 0.0400000000, query time of that 0.0033988920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 76.23999999999796
Index size:  180064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2319966667
  Testing...
|S| = 20
|T| = 283
Reject!
2177.49 < 2260.84
  -> Decision False in time 0.0000000000, query time of that 0.0025581110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1483.53 < 2206.4
  -> Decision False in time 0.0000000000, query time of that 0.0019379960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1925.4 < 2179.9
  -> Decision False in time 0.0100000000, query time of that 0.0040400000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1407.46 < 1455.93
  -> Decision False in time 0.0100000000, query time of that 0.0017641780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1886.02 < 1977.5
  -> Decision False in time 0.0000000000, query time of that 0.0020193580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1725.55 < 2058.63
  -> Decision False in time 0.0000000000, query time of that 0.0020060150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1852.65 < 1938.67
  -> Decision False in time 0.0100000000, query time of that 0.0017347230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2271.16 < 2411.78
  -> Decision False in time 0.0000000000, query time of that 0.0017351890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1786.91 < 2169.34
  -> Decision False in time 0.0000000000, query time of that 0.0020564580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 76.40999999999985
Index size:  186820.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4009500000
  Testing...
|S| = 20
|T| = 283
Reject!
2369.21 < 2616.47
  -> Decision False in time 0.0000000000, query time of that 0.0023017810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2064.13 < 2245.08
  -> Decision False in time 0.0100000000, query time of that 0.0023392820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2005.48 < 2152.6
  -> Decision False in time 0.0000000000, query time of that 0.0023971810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1750.33 < 1860.99
  -> Decision False in time 0.0000000000, query time of that 0.0015014970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2414.69 < 2426.77
  -> Decision False in time 0.0000000000, query time of that 0.0014967670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1838.45 < 1992.11
  -> Decision False in time 0.0100000000, query time of that 0.0014768420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1932.05 < 2123.56
  -> Decision False in time 0.0000000000, query time of that 0.0013998200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2327.72 < 2353.33
  -> Decision False in time 0.0000000000, query time of that 0.0014284380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2095.3 < 2157.17
  -> Decision False in time 0.0000000000, query time of that 0.0015505910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 366.90999999999985
Index size:  253408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0168836690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1643790820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6300000000, query time of that 1.5875330660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0177257340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1789873840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9500000000, query time of that 1.8041406090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0184950530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1870097530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7300000000, query time of that 1.9713649280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 76.66999999999825
Index size:  194436.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1595733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029169070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1908.88 < 1925.41
  -> Decision False in time 0.0000000000, query time of that 0.0036592900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2046.08 < 2063.43
  -> Decision False in time 0.0100000000, query time of that 0.0052390100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1704.81 < 1831.77
  -> Decision False in time 0.0100000000, query time of that 0.0019843930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2130.57 < 2158.04
  -> Decision False in time 0.0000000000, query time of that 0.0021206900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2418.26 < 2441.75
  -> Decision False in time 0.0100000000, query time of that 0.0019630180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1510.37 < 1602.72
  -> Decision False in time 0.0100000000, query time of that 0.0019231370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1880.54 < 1944.41
  -> Decision False in time 0.0300000000, query time of that 0.0025502670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2029.08 < 2058.1
  -> Decision False in time 0.0000000000, query time of that 0.0026582080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 76.15999999999985
Index size:  173616.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0832333333
  Testing...
|S| = 20
|T| = 283
Reject!
1968.88 < 2079.61
  -> Decision False in time 0.0000000000, query time of that 0.0029924600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2473.74 < 2576.93
  -> Decision False in time 0.0100000000, query time of that 0.0042624050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1689.97 < 1795.36
  -> Decision False in time 0.0100000000, query time of that 0.0057691750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1897.93 < 2021.78
  -> Decision False in time 0.0100000000, query time of that 0.0028175650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1885.89 < 2002.88
  -> Decision False in time 0.0100000000, query time of that 0.0026377520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2197.67 < 2266.83
  -> Decision False in time 0.0000000000, query time of that 0.0024721070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1159.35 < 1186.2
  -> Decision False in time 0.0300000000, query time of that 0.0029582160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1003.79 < 1027.68
  -> Decision False in time 0.0600000000, query time of that 0.0032047000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2024.95 < 2189.56
  -> Decision False in time 0.0100000000, query time of that 0.0030502540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 111.15000000000146
Index size:  190288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5613550000
  Testing...
|S| = 20
|T| = 283
Reject!
1228.27 < 1245.7
  -> Decision False in time 0.0000000000, query time of that 0.0020352410, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2275.35 < 2339.63
  -> Decision False in time 0.0000000000, query time of that 0.0014680930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2758.44 < 2770.58
  -> Decision False in time 0.0100000000, query time of that 0.0015853960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1856.67 < 2158.46
  -> Decision False in time 0.0000000000, query time of that 0.0013958940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1625.21 < 1650.21
  -> Decision False in time 0.0000000000, query time of that 0.0014113280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1427.25 < 1451.76
  -> Decision False in time 0.0000000000, query time of that 0.0014005500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2680.23 < 2681.67
  -> Decision False in time 0.0100000000, query time of that 0.0014148810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1998.41 < 2021.25
  -> Decision False in time 0.0000000000, query time of that 0.0013231400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1759.54 < 1761.94
  -> Decision False in time 0.0000000000, query time of that 0.0013580340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 110.82999999999811
Index size:  186188.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0034966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056279140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0462325270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1617.79 < 1628.53
  -> Decision False in time 0.1400000000, query time of that 0.1345374240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049676980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0520555590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1668.01 < 1668.47
  -> Decision False in time 0.0200000000, query time of that 0.0108500850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0054837820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1923.3 < 1957.89
  -> Decision False in time 0.1900000000, query time of that 0.0165474560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1222.49 < 1301.67
  -> Decision False in time 0.9000000000, query time of that 0.0603920500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 110.65999999999985
Index size:  185740.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0091229630, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0815562000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.8023180950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0090429450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0914797630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1927.5 < 1928.71
  -> Decision False in time 0.4400000000, query time of that 0.4083473720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0089916280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0916118570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1429.17 < 1467.11
  -> Decision False in time 0.9200000000, query time of that 0.1040267080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 146.0699999999997
Index size:  190220.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0004266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0111112500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1017217990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0700000000, query time of that 1.0157965560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0107501150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1157827350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1551.53 < 1567.08
  -> Decision False in time 1.1100000000, query time of that 1.0415695090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0112375110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1366.26 < 1441.88
  -> Decision False in time 0.0200000000, query time of that 0.0119674290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1364.69 < 1393.21
  -> Decision False in time 2.3400000000, query time of that 0.3301498700, with c1=5.0000000000, c2=0.1000000000
