copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 387.79
Index size:  466300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0161127560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1323909030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3100000000, query time of that 1.2566089880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0125567330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1489941380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6200000000, query time of that 1.4269002850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0153732080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1436592910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1200000000, query time of that 1.5484676380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 381.4599999999999
Index size:  272932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0160207520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1123495710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1700000000, query time of that 1.1239921620, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0129902270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1288576210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5400000000, query time of that 1.3059962690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0125524640, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.1452053820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3100000000, query time of that 1.3026621680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 401.26
Index size:  265448.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0200802270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.2024846450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.0200000000, query time of that 1.9711903440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0214007150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2247360360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3700000000, query time of that 2.2244775390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0279416730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.2572519750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.8300000000, query time of that 2.6321084780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 380.33000000000015
Index size:  202576.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065190200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0527484270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1486.04 < 1503.72
  -> Decision False in time 0.4000000000, query time of that 0.3678364130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056203680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1135.36 < 1166.54
  -> Decision False in time 0.0500000000, query time of that 0.0451869130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.5851144500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061413120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1668.66 < 1734.18
  -> Decision False in time 0.0300000000, query time of that 0.0061256130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1316.81 < 1396.72
  -> Decision False in time 0.3500000000, query time of that 0.0269167820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.75
Index size:  194336.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0286316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0050460650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1543.25 < 1902.55
  -> Decision False in time 0.0200000000, query time of that 0.0123385860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2208.28 < 2224.94
  -> Decision False in time 0.0100000000, query time of that 0.0088228120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0045970930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1794.96 < 1827.11
  -> Decision False in time 0.0000000000, query time of that 0.0045956810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1723.59 < 1759.99
  -> Decision False in time 0.0200000000, query time of that 0.0134009790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
443.859 < 517.441
  -> Decision False in time 0.0200000000, query time of that 0.0046769860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
528.023 < 569.309
  -> Decision False in time 0.0100000000, query time of that 0.0047425100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1500.54 < 1500.83
  -> Decision False in time 0.0200000000, query time of that 0.0047278480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 113.76999999999998
Index size:  174460.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1210616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0024849670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1984.24 < 2041.15
  -> Decision False in time 0.0000000000, query time of that 0.0023211390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1839.7 < 1895.94
  -> Decision False in time 0.0100000000, query time of that 0.0075743650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1565.56 < 1627.42
  -> Decision False in time 0.0000000000, query time of that 0.0016634340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1342.03 < 1411.7
  -> Decision False in time 0.0100000000, query time of that 0.0016958670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1619.77 < 1676.08
  -> Decision False in time 0.0000000000, query time of that 0.0018885050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1902.49 < 2026.78
  -> Decision False in time 0.0000000000, query time of that 0.0019071380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1046.84 < 1052.76
  -> Decision False in time 0.0100000000, query time of that 0.0019548520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1844.01 < 1877.64
  -> Decision False in time 0.0100000000, query time of that 0.0018950570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 402.1800000000003
Index size:  260092.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0189056430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1557128280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6300000000, query time of that 1.5740581160, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0179703880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1752965450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.7964431200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0165243190, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1825187590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8100000000, query time of that 2.0138825040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 380.74000000000024
Index size:  206328.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0107815270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0972531930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.9074819350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0097868090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1092884570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2800000000, query time of that 1.0623177410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0114640120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1078553410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9000000000, query time of that 1.0356390440, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 113.67000000000007
Index size:  199612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0108631380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0968347190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.9830523670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115833700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1180131630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
483.71 < 534.188
  -> Decision False in time 0.8700000000, query time of that 0.8296374150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0110280810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1287.38 < 1290.24
  -> Decision False in time 0.1200000000, query time of that 0.0246408800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1407.32 < 1498.07
  -> Decision False in time 0.0800000000, query time of that 0.0120922920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 78.72000000000025
Index size:  183716.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0524150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0045785500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1466.7 < 1718.89
  -> Decision False in time 0.0100000000, query time of that 0.0070741530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1887.14 < 1990.73
  -> Decision False in time 0.0100000000, query time of that 0.0163715400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1581.3 < 1620.97
  -> Decision False in time 0.0100000000, query time of that 0.0037335840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1875.94 < 1993.33
  -> Decision False in time 0.0100000000, query time of that 0.0068345440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1924.14 < 2018.28
  -> Decision False in time 0.0100000000, query time of that 0.0079856320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1355.9 < 1370.76
  -> Decision False in time 0.0500000000, query time of that 0.0038198360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1369.5 < 1411.52
  -> Decision False in time 0.0100000000, query time of that 0.0041208390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2235.59 < 2361.7
  -> Decision False in time 0.0100000000, query time of that 0.0043040170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.4399999999996
Index size:  183640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2515966667
  Testing...
|S| = 20
|T| = 283
Reject!
2219.5 < 2252.33
  -> Decision False in time 0.0000000000, query time of that 0.0024771010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1625.31 < 2008.77
  -> Decision False in time 0.0100000000, query time of that 0.0027102660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1890.09 < 1914.92
  -> Decision False in time 0.0000000000, query time of that 0.0041442440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2168.41 < 2313.83
  -> Decision False in time 0.0000000000, query time of that 0.0016640630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1997.23 < 2413.21
  -> Decision False in time 0.0100000000, query time of that 0.0016989040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1745.48 < 2317.81
  -> Decision False in time 0.0000000000, query time of that 0.0017962450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1975.05 < 2119.53
  -> Decision False in time 0.0000000000, query time of that 0.0017529130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1430.3 < 1469.06
  -> Decision False in time 0.0100000000, query time of that 0.0018541560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1505.42 < 1697.26
  -> Decision False in time 0.0000000000, query time of that 0.0019119850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 78.59999999999945
Index size:  186656.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0246283333
  Testing...
|S| = 20
|T| = 283
Reject!
1870.74 < 1928.43
  -> Decision False in time 0.0000000000, query time of that 0.0057494500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2380.13 < 2483.74
  -> Decision False in time 0.0200000000, query time of that 0.0136383320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1904.27 < 1993.19
  -> Decision False in time 0.0400000000, query time of that 0.0433813050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049725740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1452.74 < 1471.23
  -> Decision False in time 0.0600000000, query time of that 0.0394370440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2104.05 < 2139.23
  -> Decision False in time 0.0800000000, query time of that 0.0610763410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1874.33 < 1910.54
  -> Decision False in time 0.0100000000, query time of that 0.0052907620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1623.75 < 1646.26
  -> Decision False in time 0.0600000000, query time of that 0.0056045640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1574.81 < 1635.88
  -> Decision False in time 0.0700000000, query time of that 0.0054898640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 400.16000000000076
Index size:  264460.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0145415150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1492307110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5300000000, query time of that 1.4827042630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0167673650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1769141440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8500000000, query time of that 1.6953828440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0178145320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1728995040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2800000000, query time of that 1.8271360140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 147.39000000000033
Index size:  192116.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062189080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0565469090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6100000000, query time of that 0.5649599790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065632570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0658306390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1293.83 < 1341.9
  -> Decision False in time 0.0500000000, query time of that 0.0405698440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1202.51 < 1604.38
  -> Decision False in time 0.0600000000, query time of that 0.0066231370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2002.93 < 2029.21
  -> Decision False in time 0.4800000000, query time of that 0.0397193870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1334.09 < 1339.82
  -> Decision False in time 0.7700000000, query time of that 0.0623459400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 380.03999999999996
Index size:  224760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052507940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0444981210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4800000000, query time of that 0.4344278690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052033420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0508737030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.4991244430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052992330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0511703500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1683.85 < 1692.54
  -> Decision False in time 1.5200000000, query time of that 0.0919725090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 113.75
Index size:  198252.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0193283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035970700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1906.84 < 1980.64
  -> Decision False in time 0.0100000000, query time of that 0.0085797180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1193.52 < 1197.63
  -> Decision False in time 0.0400000000, query time of that 0.0325021260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0028818470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0310922870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1622.04 < 1678.16
  -> Decision False in time 0.0000000000, query time of that 0.0033388610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1631.08 < 1646.75
  -> Decision False in time 0.0100000000, query time of that 0.0033230950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
627.83 < 635.108
  -> Decision False in time 0.0100000000, query time of that 0.0032642230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1572.87 < 1597.79
  -> Decision False in time 0.0100000000, query time of that 0.0033484900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 381.0499999999993
Index size:  244972.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0830300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031188430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1441.33 < 1476.58
  -> Decision False in time 0.0000000000, query time of that 0.0042962270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1460.81 < 1510.65
  -> Decision False in time 0.0200000000, query time of that 0.0161802590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0022737040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1847.46 < 1932.82
  -> Decision False in time 0.0100000000, query time of that 0.0052065630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1517.48 < 1547.49
  -> Decision False in time 0.0100000000, query time of that 0.0026494590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1134.76 < 1212.82
  -> Decision False in time 0.0000000000, query time of that 0.0024127860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1509.79 < 1567.94
  -> Decision False in time 0.0200000000, query time of that 0.0026311060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1672.69 < 1718.66
  -> Decision False in time 0.0000000000, query time of that 0.0027856430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 148.10000000000036
Index size:  205152.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0044400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0051645300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0418837340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4074587830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0045733060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0472469070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1875.88 < 1883.94
  -> Decision False in time 0.1700000000, query time of that 0.1053296950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0047126930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1198.12 < 1213.24
  -> Decision False in time 0.1000000000, query time of that 0.0102771440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1646.61 < 1648.69
  -> Decision False in time 1.0100000000, query time of that 0.0603323680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 113.39999999999964
Index size:  176752.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067903420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0563580730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5519047050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061826110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0634073040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1549.68 < 1566.44
  -> Decision False in time 0.1700000000, query time of that 0.1395451120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0066522260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0646505210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1212.96 < 1334.98
  -> Decision False in time 0.1300000000, query time of that 0.0131791740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 378.2099999999991
Index size:  250956.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075543310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0647879090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6510037520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0072845790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0765721150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.7610303220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0075995060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2215.76 < 2287.46
  -> Decision False in time 0.6400000000, query time of that 0.0606192470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1880.83 < 1912.49
  -> Decision False in time 1.1600000000, query time of that 0.1044416320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 148.3699999999999
Index size:  205144.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4523883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0022763210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2258.92 < 2351.82
  -> Decision False in time 0.0100000000, query time of that 0.0025880570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1697.06 < 1788.86
  -> Decision False in time 0.0000000000, query time of that 0.0034300830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1587.38 < 2035.64
  -> Decision False in time 0.0000000000, query time of that 0.0014116340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1389.4 < 1404.1
  -> Decision False in time 0.0100000000, query time of that 0.0015030370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2127.96 < 2146.62
  -> Decision False in time 0.0000000000, query time of that 0.0015244510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2040.33 < 2109.8
  -> Decision False in time 0.0000000000, query time of that 0.0014267880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2086.4 < 2209.84
  -> Decision False in time 0.0000000000, query time of that 0.0015051600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1753.37 < 1896.66
  -> Decision False in time 0.0100000000, query time of that 0.0015468470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 78.5
Index size:  177504.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0159350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0061447750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1601.69 < 1761.33
  -> Decision False in time 0.0200000000, query time of that 0.0188410600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2168.12 < 2200.65
  -> Decision False in time 0.1300000000, query time of that 0.1171892990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066627160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1860.96 < 1981.43
  -> Decision False in time 0.0600000000, query time of that 0.0507711890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1972.49 < 1984.96
  -> Decision False in time 0.0300000000, query time of that 0.0283669990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1544.66 < 1550.37
  -> Decision False in time 0.0300000000, query time of that 0.0065083870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1785.72 < 1806.93
  -> Decision False in time 0.1600000000, query time of that 0.0157304930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1380.35 < 1384.2
  -> Decision False in time 0.3800000000, query time of that 0.0326377190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 400.1100000000006
Index size:  256452.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0183316930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1697361450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7100000000, query time of that 1.6690314830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0190789230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1905808620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0600000000, query time of that 1.8942766690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0186351720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.2292891740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1880.83 < 1912.49
  -> Decision False in time 7.8100000000, query time of that 2.1008056500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 147.94999999999982
Index size:  195240.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0271983333
  Testing...
|S| = 20
|T| = 283
Reject!
1713.64 < 1810.87
  -> Decision False in time 0.0000000000, query time of that 0.0032930680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0241006200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1606.69 < 1834.39
  -> Decision False in time 0.0100000000, query time of that 0.0068391400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025542400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1243.44 < 1290.54
  -> Decision False in time 0.0100000000, query time of that 0.0060388700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1361.58 < 1383.65
  -> Decision False in time 0.0400000000, query time of that 0.0152606370, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1716.99 < 1825.72
  -> Decision False in time 0.0400000000, query time of that 0.0029425750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1581.75 < 1609.81
  -> Decision False in time 0.0100000000, query time of that 0.0031418270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1583.71 < 1586.33
  -> Decision False in time 0.0200000000, query time of that 0.0028554770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 112.76000000000022
Index size:  173488.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5659516667
  Testing...
|S| = 20
|T| = 283
Reject!
1922.53 < 1997.9
  -> Decision False in time 0.0100000000, query time of that 0.0021152700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1795.06 < 1874.43
  -> Decision False in time 0.0000000000, query time of that 0.0019362560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1499.1 < 1689.26
  -> Decision False in time 0.0000000000, query time of that 0.0012725320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1363.4 < 1372.43
  -> Decision False in time 0.0000000000, query time of that 0.0012586770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1494.58 < 1518.4
  -> Decision False in time 0.0100000000, query time of that 0.0014064210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1845.68 < 1863.24
  -> Decision False in time 0.0000000000, query time of that 0.0014634080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1916.3 < 1986.09
  -> Decision False in time 0.0000000000, query time of that 0.0013751710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2011.97 < 2077.24
  -> Decision False in time 0.0000000000, query time of that 0.0011644410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2491.59 < 2572.46
  -> Decision False in time 0.0100000000, query time of that 0.0012340680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.03999999999905
Index size:  183696.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5789200000
  Testing...
|S| = 20
|T| = 283
Reject!
2061.82 < 2107.21
  -> Decision False in time 0.0100000000, query time of that 0.0019743140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1873.98 < 2072.58
  -> Decision False in time 0.0000000000, query time of that 0.0013776000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1742.91 < 1802.82
  -> Decision False in time 0.0000000000, query time of that 0.0011775020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2354.2 < 2356.29
  -> Decision False in time 0.0000000000, query time of that 0.0012811260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1633.58 < 1741.6
  -> Decision False in time 0.0000000000, query time of that 0.0012153800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1633.59 < 1837.54
  -> Decision False in time 0.0100000000, query time of that 0.0011673490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1266.46 < 1276.29
  -> Decision False in time 0.0000000000, query time of that 0.0012336690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2764.52 < 2873.98
  -> Decision False in time 0.0000000000, query time of that 0.0011979390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2431.32 < 2456.86
  -> Decision False in time 0.0000000000, query time of that 0.0012915080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 399.96999999999935
Index size:  261108.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0125875550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1106891240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1300000000, query time of that 1.0809841140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0131368920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1238427000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4400000000, query time of that 1.2457046440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0138687520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1217996880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9100000000, query time of that 1.2356262470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 112.51999999999862
Index size:  189392.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0517783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0029794490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1992.84 < 2116.75
  -> Decision False in time 0.0200000000, query time of that 0.0078942650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1533.39 < 1544.33
  -> Decision False in time 0.0200000000, query time of that 0.0184492350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0026161810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1700.54 < 1913.55
  -> Decision False in time 0.0100000000, query time of that 0.0049414920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
940.073 < 963.255
  -> Decision False in time 0.0100000000, query time of that 0.0022824150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
442.971 < 453.786
  -> Decision False in time 0.0100000000, query time of that 0.0023765880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1141.28 < 1176.76
  -> Decision False in time 0.0300000000, query time of that 0.0025751080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1799.02 < 1808.28
  -> Decision False in time 0.0800000000, query time of that 0.0027508570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 111.82000000000153
Index size:  183232.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0090327840, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0822180480, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.7995745490, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0083982710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0893401650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
888.347 < 1035.71
  -> Decision False in time 0.4300000000, query time of that 0.4064546650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0092294270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1242.7 < 1261.91
  -> Decision False in time 0.0800000000, query time of that 0.0094933530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1516.58 < 1593.39
  -> Decision False in time 1.3300000000, query time of that 0.1459416760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 112.05000000000109
Index size:  188952.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0092433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0041743690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0334420120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1481.63 < 1520.77
  -> Decision False in time 0.2900000000, query time of that 0.2577366820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036588010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1596.47 < 1598.08
  -> Decision False in time 0.0500000000, query time of that 0.0295099060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1997.57 < 2035.68
  -> Decision False in time 0.0200000000, query time of that 0.0085988720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1516.12 < 1531.85
  -> Decision False in time 0.0200000000, query time of that 0.0040492610, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1287.22 < 1296.66
  -> Decision False in time 0.3000000000, query time of that 0.0162195810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1717.49 < 1732.66
  -> Decision False in time 0.4100000000, query time of that 0.0218961150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 379.3700000000008
Index size:  243940.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048794330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0367025750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3513576140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040151930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1709.36 < 1717.79
  -> Decision False in time 0.0200000000, query time of that 0.0081779240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1627.72 < 1639.42
  -> Decision False in time 0.0900000000, query time of that 0.0509473300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0041045600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1936.08 < 1970.29
  -> Decision False in time 0.3000000000, query time of that 0.0172798740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1311.3 < 1330.36
  -> Decision False in time 2.7700000000, query time of that 0.1414819400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 148.63000000000102
Index size:  204456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0086695490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0715353140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.7032246730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080297900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0823805260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1670.6 < 1693.11
  -> Decision False in time 0.0100000000, query time of that 0.0082861110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0084991590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0780047130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1454.22 < 1466.68
  -> Decision False in time 2.2000000000, query time of that 0.2145576380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 79.54000000000087
Index size:  177268.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1452766667
  Testing...
|S| = 20
|T| = 283
Reject!
1554.18 < 1555.61
  -> Decision False in time 0.0000000000, query time of that 0.0030813440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1731.11 < 1760.44
  -> Decision False in time 0.0000000000, query time of that 0.0039708980, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1922.42 < 1956.87
  -> Decision False in time 0.0100000000, query time of that 0.0040106760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0022276620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1664.61 < 1819.5
  -> Decision False in time 0.0100000000, query time of that 0.0051008810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1157.22 < 1207.89
  -> Decision False in time 0.0100000000, query time of that 0.0051559880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1608.74 < 1643.65
  -> Decision False in time 0.0200000000, query time of that 0.0025283020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1310.08 < 1354.63
  -> Decision False in time 0.0100000000, query time of that 0.0027725640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2268.31 < 2341.85
  -> Decision False in time 0.0000000000, query time of that 0.0024170420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 381.0099999999984
Index size:  245672.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0388004510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3890005390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.8900000000, query time of that 3.8394930710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0413911250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4800000000, query time of that 0.4375749570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.4300000000, query time of that 4.2833581310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0526812860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.6055402400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.9500000000, query time of that 6.1293175420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 402.9200000000001
Index size:  261640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0070203050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0601859100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6400000000, query time of that 0.5957117840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0070335410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0681393170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.6777397050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0069253900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0682069960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1917.88 < 1966.1
  -> Decision False in time 0.4000000000, query time of that 0.0335887080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 113.97999999999956
Index size:  192524.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2873750000
  Testing...
|S| = 20
|T| = 283
Reject!
2267.02 < 2272.27
  -> Decision False in time 0.0100000000, query time of that 0.0024821140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1619.92 < 2009.19
  -> Decision False in time 0.0000000000, query time of that 0.0022811580, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1521.36 < 1631.09
  -> Decision False in time 0.0000000000, query time of that 0.0024376100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1683.99 < 1702.18
  -> Decision False in time 0.0000000000, query time of that 0.0015531470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1961.12 < 2013.93
  -> Decision False in time 0.0100000000, query time of that 0.0014094140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1154.8 < 1178.05
  -> Decision False in time 0.0000000000, query time of that 0.0015196400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1979.99 < 2017.58
  -> Decision False in time 0.0000000000, query time of that 0.0015912560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1836.21 < 1864.21
  -> Decision False in time 0.0000000000, query time of that 0.0015303720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1633.56 < 1657.6
  -> Decision False in time 0.0100000000, query time of that 0.0015448850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 400.15999999999985
Index size:  254312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0087985370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0763343270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7578705880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083253480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0882071320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.8820045350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0091042680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0882235020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8900000000, query time of that 0.8691393080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 399.5799999999999
Index size:  207256.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0325604860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2934506040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9000000000, query time of that 2.8434223540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0327118490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3227863650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.2200000000, query time of that 3.1132582400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0348887580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.4284187330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.5600000000, query time of that 4.3432662350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 398.1999999999989
Index size:  237264.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0452190480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4379464750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.3400000000, query time of that 4.2806403910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0488997980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4819208870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 5.0200000000, query time of that 4.7991972460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0638282950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1400000000, query time of that 0.6959998950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.7900000000, query time of that 7.0587013770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 78.51000000000022
Index size:  189812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0859983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034297400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1138.99 < 2076.04
  -> Decision False in time 0.0000000000, query time of that 0.0022753720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1410.77 < 1480.59
  -> Decision False in time 0.0100000000, query time of that 0.0033954540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1414.96 < 1448.52
  -> Decision False in time 0.0100000000, query time of that 0.0020095480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1581.9 < 1717.48
  -> Decision False in time 0.0000000000, query time of that 0.0023828880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1872.58 < 1954.2
  -> Decision False in time 0.0100000000, query time of that 0.0021542720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1930.55 < 1957.74
  -> Decision False in time 0.0100000000, query time of that 0.0021566890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1975.26 < 2059.89
  -> Decision False in time 0.0100000000, query time of that 0.0022312100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1771.39 < 2037.28
  -> Decision False in time 0.0000000000, query time of that 0.0024457650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 147.76000000000022
Index size:  149472.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0111473650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1002442630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0700000000, query time of that 1.0239339670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0120352850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1205632620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3700000000, query time of that 1.1892086330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0123913740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1187316930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1702.21 < 1716.82
  -> Decision False in time 2.8200000000, query time of that 0.4216618260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 380.0
Index size:  245316.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089120970, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0800388650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7806299640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0083729020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0919037970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1100000000, query time of that 0.9084680390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0091492930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0893123640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1391.98 < 1398.51
  -> Decision False in time 4.1000000000, query time of that 0.4282882770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 113.3700000000008
Index size:  201408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0081366650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0671460410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6535757000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0071598390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0737264340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1516.58 < 1594.1
  -> Decision False in time 0.6700000000, query time of that 0.6299091960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1582.77 < 1648.3
  -> Decision False in time 0.0500000000, query time of that 0.0072494350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0755192700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1024.44 < 1272.54
  -> Decision False in time 0.3400000000, query time of that 0.0345577040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 147.97999999999956
Index size:  190616.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0143900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0037211200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0289000290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1332.84 < 1379.22
  -> Decision False in time 0.0400000000, query time of that 0.0399854870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1475.48 < 1636.54
  -> Decision False in time 0.0100000000, query time of that 0.0030242160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0329432230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1100.53 < 1109.76
  -> Decision False in time 0.0500000000, query time of that 0.0232314640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0033418630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1596.72 < 1670.67
  -> Decision False in time 0.0300000000, query time of that 0.0037447070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1577.7 < 1619.82
  -> Decision False in time 0.0100000000, query time of that 0.0036975070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 399.0699999999997
Index size:  257760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0142028490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1194145220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.2301096240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0154362670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1370116410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5700000000, query time of that 1.4004613630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0166193540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1442397730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3200000000, query time of that 1.4569447420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.48999999999978
Index size:  187944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7917833333
  Testing...
|S| = 20
|T| = 283
Reject!
1598.08 < 1799.28
  -> Decision False in time 0.0000000000, query time of that 0.0012923610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2090.88 < 2350.98
  -> Decision False in time 0.0000000000, query time of that 0.0007418420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1743.99 < 1863.07
  -> Decision False in time 0.0100000000, query time of that 0.0007698540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1877.95 < 1879.68
  -> Decision False in time 0.0000000000, query time of that 0.0006229790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2065.12 < 2070.14
  -> Decision False in time 0.0100000000, query time of that 0.0006954060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1838.01 < 2201.1
  -> Decision False in time 0.0000000000, query time of that 0.0006734550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2236.44 < 2285.19
  -> Decision False in time 0.0100000000, query time of that 0.0006704440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1823.62 < 1873.96
  -> Decision False in time 0.0000000000, query time of that 0.0006924960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1867.57 < 2036.65
  -> Decision False in time 0.0100000000, query time of that 0.0007261850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 399.72000000000116
Index size:  206572.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226771940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2268381680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1800000000, query time of that 2.1315174820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0226556590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2286164650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5200000000, query time of that 2.3527916680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0255809500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.3102818460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1165.73 < 1257.39
  -> Decision False in time 7.5300000000, query time of that 2.6671203310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 400.8600000000006
Index size:  214148.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0284553700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2204614530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.4400000000, query time of that 2.3819477100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0257879220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2797900350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.8200000000, query time of that 2.6920501100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0349167540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.3476510770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.0800000000, query time of that 3.5541567300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 380.09000000000015
Index size:  228428.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0195659090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1724065960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6900000000, query time of that 1.6388284560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0180484740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1887742710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0100000000, query time of that 1.8449983200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0182128530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1947457200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 2.1639142920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 147.9300000000003
Index size:  202916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089727850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0821413770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7770951660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0089717080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0907687100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1600000000, query time of that 0.9022811800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0091406810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0879241820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1204.91 < 1431.32
  -> Decision False in time 1.3300000000, query time of that 0.1414696140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 401.5400000000009
Index size:  246456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0108779910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0923479080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9091416320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101515410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1078987450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.0512844670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0100299180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1047600690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8900000000, query time of that 1.0331237710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 399.84000000000015
Index size:  210156.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0404739810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3600000000, query time of that 0.3539143890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.5100000000, query time of that 3.4528449000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0419397540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3869441190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.0700000000, query time of that 3.8929717800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0487423050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.5549770880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.6100000000, query time of that 5.6424009240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 378.5500000000029
Index size:  217024.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0039359600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0280619600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1439.44 < 1549.06
  -> Decision False in time 0.0500000000, query time of that 0.0425905840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0030267790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1507.06 < 1525.13
  -> Decision False in time 0.0100000000, query time of that 0.0066598570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1199.66 < 1231.04
  -> Decision False in time 0.0700000000, query time of that 0.0272714430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0032159520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
759.244 < 762.697
  -> Decision False in time 0.0100000000, query time of that 0.0033848860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1045.27 < 1061.09
  -> Decision False in time 0.1100000000, query time of that 0.0065303470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 148.1800000000003
Index size:  205148.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0088750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0045501430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0336473260, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3240026700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0037158010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0387572990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1748.94 < 1771.71
  -> Decision False in time 0.0700000000, query time of that 0.0353051720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0037863190, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1677.83 < 1713.32
  -> Decision False in time 0.0300000000, query time of that 0.0041845130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1635.53 < 1715.88
  -> Decision False in time 0.0800000000, query time of that 0.0041600520, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 147.53000000000247
Index size:  188024.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2071800000
  Testing...
|S| = 20
|T| = 283
Reject!
1863.17 < 1982.17
  -> Decision False in time 0.0000000000, query time of that 0.0025609030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1458.28 < 1512.89
  -> Decision False in time 0.0000000000, query time of that 0.0018578060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1829.13 < 1843.44
  -> Decision False in time 0.0100000000, query time of that 0.0020907980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1618.65 < 1716.37
  -> Decision False in time 0.0000000000, query time of that 0.0018260390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1346.6 < 1527.75
  -> Decision False in time 0.0000000000, query time of that 0.0017803800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1766.66 < 1945.92
  -> Decision False in time 0.0000000000, query time of that 0.0018082800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2160.68 < 2272.11
  -> Decision False in time 0.0100000000, query time of that 0.0017791800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1781.07 < 1868.12
  -> Decision False in time 0.0000000000, query time of that 0.0018635070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1199.86 < 1293.14
  -> Decision False in time 0.0000000000, query time of that 0.0018240760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 398.869999999999
Index size:  258792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0142902950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1361316440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4000000000, query time of that 1.3444541640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0152788250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1567677850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7200000000, query time of that 1.5585185410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0167653050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1619487790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0400000000, query time of that 1.6570461220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 379.08000000000175
Index size:  196104.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0255728940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2426822450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3700000000, query time of that 2.3275197430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0253054700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2447277880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.6600000000, query time of that 2.5162545560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0308808070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.3272424320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.0200000000, query time of that 3.4205888600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 79.29999999999927
Index size:  195916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4326816667
  Testing...
|S| = 20
|T| = 283
Reject!
1364.17 < 1380.56
  -> Decision False in time 0.0100000000, query time of that 0.0018475160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1710.66 < 1795
  -> Decision False in time 0.0000000000, query time of that 0.0015780430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2193.22 < 2379.55
  -> Decision False in time 0.0100000000, query time of that 0.0019023430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1106.43 < 1132.59
  -> Decision False in time 0.0000000000, query time of that 0.0011358120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1876.83 < 1949.96
  -> Decision False in time 0.0100000000, query time of that 0.0011768650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1990.07 < 2116.78
  -> Decision False in time 0.0000000000, query time of that 0.0011481390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1992.49 < 2008.96
  -> Decision False in time 0.0100000000, query time of that 0.0011193060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1689.46 < 1974.81
  -> Decision False in time 0.0000000000, query time of that 0.0011625720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1513.74 < 2394.73
  -> Decision False in time 0.0100000000, query time of that 0.0011653670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 149.0600000000013
Index size:  182300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0757183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026299140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1322.76 < 1346.36
  -> Decision False in time 0.0100000000, query time of that 0.0050643590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1428.58 < 1438.68
  -> Decision False in time 0.0100000000, query time of that 0.0038064060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1411.38 < 1485.36
  -> Decision False in time 0.0000000000, query time of that 0.0016563180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1555.2 < 1582.95
  -> Decision False in time 0.0200000000, query time of that 0.0057333700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1732.2 < 1760.18
  -> Decision False in time 0.0200000000, query time of that 0.0041991950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1278.27 < 1302.02
  -> Decision False in time 0.0100000000, query time of that 0.0019322040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1106.81 < 1138.13
  -> Decision False in time 0.0100000000, query time of that 0.0023621200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1472.25 < 1537.51
  -> Decision False in time 0.0100000000, query time of that 0.0020318890, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 148.8199999999997
Index size:  190972.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057370760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0499364910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5300000000, query time of that 0.4846700930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0054823700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0555705380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1864.49 < 1885.14
  -> Decision False in time 0.3400000000, query time of that 0.2391412070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0055623790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1141.91 < 1173.79
  -> Decision False in time 0.2700000000, query time of that 0.0232289200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1496.65 < 1524.77
  -> Decision False in time 0.0500000000, query time of that 0.0057153970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 113.86000000000058
Index size:  188496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0039866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0057361020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0452958400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1698.82 < 1721.67
  -> Decision False in time 0.2000000000, query time of that 0.1787655870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0050179530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2160.46 < 2161.63
  -> Decision False in time 0.0700000000, query time of that 0.0487398820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2078.26 < 2161.63
  -> Decision False in time 0.1200000000, query time of that 0.0801138820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0051556210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1572.67 < 1595.71
  -> Decision False in time 0.2600000000, query time of that 0.0183008340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
359.178 < 470.172
  -> Decision False in time 0.4200000000, query time of that 0.0300984220, with c1=5.0000000000, c2=0.1000000000
