copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 122.64
Index size:  405988.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0407850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042177250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0233931320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1168.99 < 1214.09
  -> Decision False in time 0.0300000000, query time of that 0.0270552000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0025368960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1368.32 < 1384.7
  -> Decision False in time 0.0100000000, query time of that 0.0056535400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2108.3 < 2215.39
  -> Decision False in time 0.0100000000, query time of that 0.0027377490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1138.12 < 1140.84
  -> Decision False in time 0.0800000000, query time of that 0.0026536410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1239.66 < 1265.2
  -> Decision False in time 0.0000000000, query time of that 0.0028989160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
770.025 < 781.506
  -> Decision False in time 0.0100000000, query time of that 0.0025429170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 287.02
Index size:  281080.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115525280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1100961290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1200000000, query time of that 1.0716050520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112978480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1215597150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.2313320160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0122015790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.1267183490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1934.9 < 1997.39
  -> Decision False in time 6.6100000000, query time of that 0.9663893310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 103.61000000000001
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5932383333
  Testing...
|S| = 20
|T| = 283
Reject!
1214.3 < 1306.08
  -> Decision False in time 0.0100000000, query time of that 0.0020623360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1027 < 1150.17
  -> Decision False in time 0.0000000000, query time of that 0.0029792490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
960.146 < 1047.91
  -> Decision False in time 0.0000000000, query time of that 0.0031422470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1117.04 < 1150.79
  -> Decision False in time 0.0100000000, query time of that 0.0011705010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1529.66 < 1563.75
  -> Decision False in time 0.0000000000, query time of that 0.0011667440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
868.325 < 911.609
  -> Decision False in time 0.0000000000, query time of that 0.0011661870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1688.83 < 1749.01
  -> Decision False in time 0.0000000000, query time of that 0.0011380130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
936.57 < 946.43
  -> Decision False in time 0.0000000000, query time of that 0.0012656530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1877.01 < 1949.78
  -> Decision False in time 0.0100000000, query time of that 0.0013408790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 287.47
Index size:  244932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0147221440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1408723750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.3331433350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0140568760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1541724990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6600000000, query time of that 1.5407530800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0151237020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1557856160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8300000000, query time of that 1.5705792280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 104.33999999999992
Index size:  185568.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0273166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0033920090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2313.93 < 2518.6
  -> Decision False in time 0.0200000000, query time of that 0.0212272100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1973.91 < 2012.75
  -> Decision False in time 0.2800000000, query time of that 0.2411099860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026900220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
942.626 < 945.378
  -> Decision False in time 0.0100000000, query time of that 0.0059814410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1178.23 < 1197.53
  -> Decision False in time 0.0500000000, query time of that 0.0209279710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0029993430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1208.73 < 1230.67
  -> Decision False in time 0.0000000000, query time of that 0.0031949100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1330.13 < 1350.83
  -> Decision False in time 0.0200000000, query time of that 0.0030465100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 75.44999999999982
Index size:  177772.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5773866667
  Testing...
|S| = 20
|T| = 283
Reject!
1137.8 < 1153.1
  -> Decision False in time 0.0100000000, query time of that 0.0018313030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1290.08 < 1585.37
  -> Decision False in time 0.0000000000, query time of that 0.0013304530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1304.73 < 1346.56
  -> Decision False in time 0.0100000000, query time of that 0.0012012870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1317.93 < 1481.27
  -> Decision False in time 0.0000000000, query time of that 0.0011990540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1252.33 < 1276.7
  -> Decision False in time 0.0100000000, query time of that 0.0011415490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1071.01 < 1073.48
  -> Decision False in time 0.0000000000, query time of that 0.0012044430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1231.17 < 1302.34
  -> Decision False in time 0.0000000000, query time of that 0.0012139460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1736.27 < 1883.82
  -> Decision False in time 0.0100000000, query time of that 0.0012117890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1387.12 < 1415.03
  -> Decision False in time 0.0000000000, query time of that 0.0011777460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 278.77
Index size:  237260.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0210973630, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1878811670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9400000000, query time of that 1.8887066610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0231297140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2234444490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2600000000, query time of that 2.1450679730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0237349800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.2464695790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6500000000, query time of that 2.4586279600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 74.67999999999984
Index size:  195336.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0330716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042615730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0369630520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2182.9 < 3022.46
  -> Decision False in time 0.1500000000, query time of that 0.1302001830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1256.5 < 1328.06
  -> Decision False in time 0.0000000000, query time of that 0.0039452030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1892.04 < 2177.57
  -> Decision False in time 0.0100000000, query time of that 0.0046819760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
671.929 < 755.893
  -> Decision False in time 0.0400000000, query time of that 0.0204067630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1105.02 < 1256.42
  -> Decision False in time 0.0000000000, query time of that 0.0041923140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1258.67 < 1265.1
  -> Decision False in time 0.1300000000, query time of that 0.0090873610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2162.76 < 2288.48
  -> Decision False in time 0.0800000000, query time of that 0.0064907220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 122.67000000000007
Index size:  195288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0133583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0040591130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0305338610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2098.36 < 2174.59
  -> Decision False in time 0.0800000000, query time of that 0.0734728710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032466580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1183.14 < 1192.41
  -> Decision False in time 0.0700000000, query time of that 0.0339342390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1097.1 < 1104.18
  -> Decision False in time 0.0300000000, query time of that 0.0118222520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1094.45 < 1101.42
  -> Decision False in time 0.0100000000, query time of that 0.0038987360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1791.79 < 1849.74
  -> Decision False in time 0.0200000000, query time of that 0.0038632110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1331.39 < 1333.92
  -> Decision False in time 0.0900000000, query time of that 0.0075428700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 103.88000000000011
Index size:  180248.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0142466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0042116900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0314370390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
941.43 < 961.21
  -> Decision False in time 0.0800000000, query time of that 0.0749853670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034052430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1368.12 < 1387.49
  -> Decision False in time 0.0100000000, query time of that 0.0074348890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1441.06 < 1446.49
  -> Decision False in time 0.0200000000, query time of that 0.0076009620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1227.89 < 1233.21
  -> Decision False in time 0.0100000000, query time of that 0.0037385050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1449.25 < 1450.29
  -> Decision False in time 0.3200000000, query time of that 0.0153962050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1647.33 < 1705.8
  -> Decision False in time 0.0100000000, query time of that 0.0039524000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 278.90999999999985
Index size:  235420.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0080713550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0695053580, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7300000000, query time of that 0.6852999020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075224990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0795079180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1871.34 < 1911.26
  -> Decision False in time 0.5500000000, query time of that 0.5024953240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0076827400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0764476190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1670.46 < 1693.77
  -> Decision False in time 1.7300000000, query time of that 0.1649369610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 280.34000000000015
Index size:  239024.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0071074430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0594111640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6300000000, query time of that 0.5843732360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0067733150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0671569730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1669.94 < 1686.41
  -> Decision False in time 0.3000000000, query time of that 0.2370427800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0072032230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0663587300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1924.16 < 1937.87
  -> Decision False in time 5.0400000000, query time of that 0.4006683260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 122.5300000000002
Index size:  205064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0220516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035164730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0265387230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1212.08 < 1217.88
  -> Decision False in time 0.1500000000, query time of that 0.1286592530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028104900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1277.48 < 1360.06
  -> Decision False in time 0.0000000000, query time of that 0.0031968230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1270.25 < 1299.55
  -> Decision False in time 0.0100000000, query time of that 0.0032842000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1393.72 < 1398.02
  -> Decision False in time 0.0200000000, query time of that 0.0033053790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1201.95 < 1232.93
  -> Decision False in time 0.0400000000, query time of that 0.0033908150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1136.61 < 1142.38
  -> Decision False in time 0.0100000000, query time of that 0.0033983420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 121.72000000000025
Index size:  188780.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082688050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0724411720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6989701360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0083443280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0812325520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1313.05 < 1458.59
  -> Decision False in time 0.6000000000, query time of that 0.5494835510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0080670470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1784.07 < 1896.74
  -> Decision False in time 0.7500000000, query time of that 0.0758015570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
779.105 < 1052.42
  -> Decision False in time 0.8500000000, query time of that 0.0842849040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 286.0300000000002
Index size:  249804.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0216361490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.2044942020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1400000000, query time of that 2.0957120860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0249893990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2481003480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5600000000, query time of that 2.3966671730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0284525990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.2740428390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.9400000000, query time of that 2.9380713080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 103.19999999999982
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0100230210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0887218910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9075409040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0113640470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1061459180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.0576195540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0115467170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1046795920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1050.43 < 1066.22
  -> Decision False in time 0.3800000000, query time of that 0.0551330280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 74.90000000000055
Index size:  177700.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7926683333
  Testing...
|S| = 20
|T| = 283
Reject!
1256.59 < 1268.98
  -> Decision False in time 0.0100000000, query time of that 0.0017859230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1396.16 < 1560.67
  -> Decision False in time 0.0000000000, query time of that 0.0014680420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
870.116 < 1122.07
  -> Decision False in time 0.0000000000, query time of that 0.0014317430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
959.495 < 991.547
  -> Decision False in time 0.0000000000, query time of that 0.0009672900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2225.19 < 2607.98
  -> Decision False in time 0.0000000000, query time of that 0.0010054030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2211.19 < 2453.7
  -> Decision False in time 0.0000000000, query time of that 0.0009519330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1595.97 < 1666.05
  -> Decision False in time 0.0100000000, query time of that 0.0010028640, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1282.6 < 1310.33
  -> Decision False in time 0.0000000000, query time of that 0.0009625400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1451.29 < 1722.04
  -> Decision False in time 0.0000000000, query time of that 0.0009164470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 74.84000000000015
Index size:  186660.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1082100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031432980, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1845.94 < 1893.69
  -> Decision False in time 0.0100000000, query time of that 0.0093955170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1291.44 < 1292.95
  -> Decision False in time 0.0100000000, query time of that 0.0055260880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
878.586 < 901.547
  -> Decision False in time 0.0000000000, query time of that 0.0021113990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1524.3 < 1544.86
  -> Decision False in time 0.0200000000, query time of that 0.0074938000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1061.72 < 1072.1
  -> Decision False in time 0.0100000000, query time of that 0.0027971040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1072.25 < 1122.98
  -> Decision False in time 0.0300000000, query time of that 0.0026402890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1964.02 < 2020.08
  -> Decision False in time 0.0100000000, query time of that 0.0027165680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
975.833 < 987.551
  -> Decision False in time 0.0100000000, query time of that 0.0025288960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 74.75
Index size:  186792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0250566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055012570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1316.46 < 1436.24
  -> Decision False in time 0.0200000000, query time of that 0.0212534520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1133.12 < 1136.62
  -> Decision False in time 0.0900000000, query time of that 0.0853265030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049698870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0518885040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2806.81 < 2827.95
  -> Decision False in time 0.1200000000, query time of that 0.0799580190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2647.83 < 2671.58
  -> Decision False in time 0.0100000000, query time of that 0.0050193880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
552.709 < 1360.93
  -> Decision False in time 0.0100000000, query time of that 0.0050824070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
999.832 < 1004.65
  -> Decision False in time 0.1900000000, query time of that 0.0167163200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 122.45000000000073
Index size:  193184.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1059516667
  Testing...
|S| = 20
|T| = 283
Reject!
973.405 < 996.058
  -> Decision False in time 0.0000000000, query time of that 0.0026078350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1102.89 < 1119.44
  -> Decision False in time 0.0100000000, query time of that 0.0073973180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1490.03 < 1510.27
  -> Decision False in time 0.0000000000, query time of that 0.0027705370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0018979900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1079.98 < 1081.17
  -> Decision False in time 0.0100000000, query time of that 0.0023783320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1448.96 < 1485.95
  -> Decision False in time 0.0000000000, query time of that 0.0022307780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1112.45 < 1122.94
  -> Decision False in time 0.0200000000, query time of that 0.0021096300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1489.67 < 1543.31
  -> Decision False in time 0.0000000000, query time of that 0.0023420190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1047.86 < 1048.28
  -> Decision False in time 0.0100000000, query time of that 0.0020607570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 123.15999999999985
Index size:  185796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0112203950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0927371520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9140574270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0106542010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1029274810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3000000000, query time of that 1.0458086450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0110118660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1039937150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2189.78 < 2211.32
  -> Decision False in time 0.5700000000, query time of that 0.0755062580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 103.28999999999996
Index size:  185732.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0081560320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0766052310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7541710640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0088182370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0856445700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
992.984 < 1066.35
  -> Decision False in time 0.0700000000, query time of that 0.0723813020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1777.97 < 1911.46
  -> Decision False in time 0.0200000000, query time of that 0.0081129010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0862838000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1662.41 < 1680.87
  -> Decision False in time 0.4400000000, query time of that 0.0486626880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 278.28000000000065
Index size:  241008.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1052533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027911170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0193421830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1863.12 < 1918.56
  -> Decision False in time 0.0100000000, query time of that 0.0035548320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
606.618 < 635.043
  -> Decision False in time 0.0000000000, query time of that 0.0022066360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
810.053 < 845.02
  -> Decision False in time 0.0100000000, query time of that 0.0024534190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1311.89 < 1313.22
  -> Decision False in time 0.0000000000, query time of that 0.0023022530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1141.32 < 1179.09
  -> Decision False in time 0.0100000000, query time of that 0.0022745980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1647.22 < 1672.43
  -> Decision False in time 0.0000000000, query time of that 0.0024530800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1276.8 < 1311.96
  -> Decision False in time 0.0400000000, query time of that 0.0021816850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 103.86999999999989
Index size:  199836.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0710616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026991800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1257.41 < 1296.08
  -> Decision False in time 0.0200000000, query time of that 0.0144827660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
934.387 < 993.599
  -> Decision False in time 0.0100000000, query time of that 0.0099302470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0019878620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
745.483 < 968.494
  -> Decision False in time 0.0000000000, query time of that 0.0024678840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1017.9 < 1028.76
  -> Decision False in time 0.0100000000, query time of that 0.0046035640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1153.83 < 1157.66
  -> Decision False in time 0.0100000000, query time of that 0.0023240930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1217.11 < 1233.92
  -> Decision False in time 0.0000000000, query time of that 0.0024454590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1721.1 < 1731.5
  -> Decision False in time 0.0400000000, query time of that 0.0021765730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 278.3900000000003
Index size:  230120.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082854190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0789366850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7761231910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0078974430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0879021680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0900000000, query time of that 0.8973809320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0090002590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0860922390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7400000000, query time of that 0.9340476420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 123.80000000000018
Index size:  203804.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2560533333
  Testing...
|S| = 20
|T| = 283
Reject!
1294.9 < 1316.37
  -> Decision False in time 0.0100000000, query time of that 0.0019715910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1222.19 < 1223.07
  -> Decision False in time 0.0000000000, query time of that 0.0024969140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
727.173 < 855.521
  -> Decision False in time 0.0100000000, query time of that 0.0054304310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1548.05 < 1607.52
  -> Decision False in time 0.0100000000, query time of that 0.0014717020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1101.87 < 1132.75
  -> Decision False in time 0.0100000000, query time of that 0.0014023070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
930.975 < 1056.24
  -> Decision False in time 0.0000000000, query time of that 0.0013914170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1218.31 < 1245.48
  -> Decision False in time 0.0100000000, query time of that 0.0013262500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1490.74 < 1574.35
  -> Decision False in time 0.0000000000, query time of that 0.0013566490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1374.4 < 1427.77
  -> Decision False in time 0.0000000000, query time of that 0.0015423190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 75.39000000000033
Index size:  178112.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0478483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042209550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2120.68 < 2162.15
  -> Decision False in time 0.0300000000, query time of that 0.0269832950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2101.39 < 2115.7
  -> Decision False in time 0.0100000000, query time of that 0.0094279230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0032164810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2090.64 < 2246.39
  -> Decision False in time 0.0300000000, query time of that 0.0104918480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2524.75 < 2549.76
  -> Decision False in time 0.0000000000, query time of that 0.0036261280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1067.64 < 1106.63
  -> Decision False in time 0.0300000000, query time of that 0.0035719320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1862.03 < 1904.82
  -> Decision False in time 0.0000000000, query time of that 0.0039807170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
967.146 < 1007.92
  -> Decision False in time 0.0200000000, query time of that 0.0034622560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 103.76999999999953
Index size:  189068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0044966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063761620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0527239580, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5187936450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0055895940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0591494700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1585.37 < 1604.5
  -> Decision False in time 0.0200000000, query time of that 0.0143342790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061785270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
706.778 < 723.378
  -> Decision False in time 0.0200000000, query time of that 0.0063396230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
998.142 < 1001.37
  -> Decision False in time 0.0500000000, query time of that 0.0059589020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 279.5600000000004
Index size:  233040.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0313691620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2945840840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9300000000, query time of that 2.8815617300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0307560910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.2931898970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.2500000000, query time of that 3.1290292920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0367715210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.4317319950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5700000000, query time of that 4.4471296130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 287.3799999999992
Index size:  255348.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0241633730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2598169300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.6500000000, query time of that 2.6000032680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0298077830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.2850195080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.0400000000, query time of that 2.9237383930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0334796120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.3763413570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5100000000, query time of that 3.9527285300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 104.19999999999982
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0036433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079454890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0648761890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6700000000, query time of that 0.6177107590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0068166020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1681.64 < 1689.46
  -> Decision False in time 0.0400000000, query time of that 0.0273457020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1597.01 < 1604.5
  -> Decision False in time 0.2100000000, query time of that 0.1762895160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0069678240, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1391.61 < 1552.48
  -> Decision False in time 0.0600000000, query time of that 0.0074085800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1068.23 < 1070.8
  -> Decision False in time 0.3900000000, query time of that 0.0369978160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 104.30000000000018
Index size:  183212.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0066133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0051719930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0423786200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4222135550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0047202600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0486113120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1328.53 < 1355.67
  -> Decision False in time 0.3000000000, query time of that 0.1854275590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0047361260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1836.05 < 1839.79
  -> Decision False in time 0.1200000000, query time of that 0.0102110810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1378.08 < 1403.17
  -> Decision False in time 1.0500000000, query time of that 0.0623761270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 286.6900000000005
Index size:  255740.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0108239400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0979178280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9752404460, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0102520570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1133891420, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.1269219920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0111620750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1172358300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8300000000, query time of that 1.1057733980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 279.72000000000116
Index size:  194636.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0135663570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1295306200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3500000000, query time of that 1.2967073750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0153075760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1504048500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.5274963320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0153463790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1653279550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0100000000, query time of that 1.6126967840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 286.6700000000001
Index size:  257912.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0141544690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1223021690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.2170367120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0147329350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1487299940, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5900000000, query time of that 1.4369522300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0135718200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1636081780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8000000000, query time of that 1.4727387360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 122.39999999999964
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0069414280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0618964150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6800000000, query time of that 0.6316684770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0073320290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0734149570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1705.74 < 1814.28
  -> Decision False in time 0.2500000000, query time of that 0.2284310800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0074074860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0721435970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1838.24 < 1880.61
  -> Decision False in time 1.6700000000, query time of that 0.1491217310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 75.36000000000058
Index size:  170792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0175166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064304080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0525296490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1826.55 < 1961.05
  -> Decision False in time 0.4500000000, query time of that 0.4184956560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1083.58 < 1087.8
  -> Decision False in time 0.0100000000, query time of that 0.0060004440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1689.12 < 1760.33
  -> Decision False in time 0.0200000000, query time of that 0.0215314870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1182.95 < 1186.22
  -> Decision False in time 0.0200000000, query time of that 0.0149572300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0059193080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1908.46 < 1933.16
  -> Decision False in time 0.0300000000, query time of that 0.0062787950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1459.29 < 1773.44
  -> Decision False in time 0.1900000000, query time of that 0.0189981010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 287.09000000000015
Index size:  247288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0184292150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1707017990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6900000000, query time of that 1.6375609790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0161589470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1834097750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0000000000, query time of that 1.8705551940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0190035090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2060066110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 2.1179054320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 122.92000000000007
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0028016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058111230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0493803120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5099541410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0055712530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0592604890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1104.01 < 1105.71
  -> Decision False in time 0.0200000000, query time of that 0.0224650280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061873230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1522.56 < 1532.6
  -> Decision False in time 0.1700000000, query time of that 0.0148950580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
738.775 < 791.972
  -> Decision False in time 0.0200000000, query time of that 0.0059234220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 286.6200000000008
Index size:  234760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0199560380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1862072940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8600000000, query time of that 1.8166978260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0246286340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2238124810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2800000000, query time of that 2.0904544110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0246637270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.2224984630, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5200000000, query time of that 2.4331191870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 74.53999999999905
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2868050000
  Testing...
|S| = 20
|T| = 283
Reject!
1433.56 < 1533.45
  -> Decision False in time 0.0000000000, query time of that 0.0024998500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1176.58 < 1260.97
  -> Decision False in time 0.0100000000, query time of that 0.0022417130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1277.58 < 1554.38
  -> Decision False in time 0.0000000000, query time of that 0.0020892650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2361.6 < 2485.7
  -> Decision False in time 0.0100000000, query time of that 0.0017738270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2625.15 < 2672.34
  -> Decision False in time 0.0100000000, query time of that 0.0015970640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1726.44 < 1851.49
  -> Decision False in time 0.0000000000, query time of that 0.0015422520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1721.52 < 1754.03
  -> Decision False in time 0.0100000000, query time of that 0.0015774240, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2113.2 < 2468.71
  -> Decision False in time 0.0000000000, query time of that 0.0015853880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1398.53 < 1859.19
  -> Decision False in time 0.0100000000, query time of that 0.0016378740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 277.09999999999854
Index size:  181884.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0250050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036695000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2560.39 < 2565.91
  -> Decision False in time 0.0100000000, query time of that 0.0055396410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1032.06 < 1084.4
  -> Decision False in time 0.1100000000, query time of that 0.0956901750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027128040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2038.4 < 2083.05
  -> Decision False in time 0.0100000000, query time of that 0.0028688040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1553.18 < 1581.74
  -> Decision False in time 0.0400000000, query time of that 0.0196003420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1026.82 < 1039.17
  -> Decision False in time 0.0500000000, query time of that 0.0028651240, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2136.36 < 2163.29
  -> Decision False in time 0.0000000000, query time of that 0.0029391910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
698.456 < 702.695
  -> Decision False in time 0.0200000000, query time of that 0.0027689650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 122.34000000000015
Index size:  205064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0064800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0049092790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0384714880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2179.87 < 2298.81
  -> Decision False in time 0.0900000000, query time of that 0.0834800700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040743510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1030.7 < 1051.73
  -> Decision False in time 0.0100000000, query time of that 0.0045114920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
976.332 < 982.143
  -> Decision False in time 0.1100000000, query time of that 0.0635777020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0044266950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1415.43 < 1419.37
  -> Decision False in time 0.0400000000, query time of that 0.0047974880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1240.9 < 1527.31
  -> Decision False in time 0.2000000000, query time of that 0.0137039070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 286.15999999999985
Index size:  247812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074519670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0678429560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6565268000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0067074090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0782188100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2145.15 < 2222.78
  -> Decision False in time 0.4800000000, query time of that 0.4421240930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0079863930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0752157290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2013.84 < 2043.77
  -> Decision False in time 1.5400000000, query time of that 0.1378679020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 121.72000000000116
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4940566667
  Testing...
|S| = 20
|T| = 283
Reject!
1142.18 < 1167.65
  -> Decision False in time 0.0000000000, query time of that 0.0023920250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
958.311 < 997.73
  -> Decision False in time 0.0000000000, query time of that 0.0027674240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1243.17 < 1501.77
  -> Decision False in time 0.0100000000, query time of that 0.0022027240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1014.75 < 1083.93
  -> Decision False in time 0.0000000000, query time of that 0.0014552880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1474.02 < 1476.3
  -> Decision False in time 0.0000000000, query time of that 0.0014942220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1862.59 < 1868.53
  -> Decision False in time 0.0000000000, query time of that 0.0014160360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1224.32 < 1225.27
  -> Decision False in time 0.0100000000, query time of that 0.0015382930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1137.36 < 1143.69
  -> Decision False in time 0.0000000000, query time of that 0.0013999620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2048.26 < 2097.43
  -> Decision False in time 0.0000000000, query time of that 0.0015214950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 277.8099999999995
Index size:  207344.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0119684260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1066622380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1000000000, query time of that 1.0427463690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0113306170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1203040470, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3600000000, query time of that 1.1782118190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0125854500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1167758250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7400000000, query time of that 1.1952855470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 278.78999999999905
Index size:  239364.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112200490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1023224230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9721172210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0104219840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1134628800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.1224967960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0119183090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1096529160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7900000000, query time of that 1.0870687310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 287.40999999999985
Index size:  248576.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0353300750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3367241520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.2900000000, query time of that 3.2390048480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0340331270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3436763200, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.6100000000, query time of that 3.5051568490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0375740970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.4741694420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.3700000000, query time of that 4.8607843750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 103.10999999999876
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3294983333
  Testing...
|S| = 20
|T| = 283
Reject!
728.097 < 740.488
  -> Decision False in time 0.0100000000, query time of that 0.0020665580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1017.63 < 1057.16
  -> Decision False in time 0.0000000000, query time of that 0.0023464030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1433.52 < 1465.33
  -> Decision False in time 0.0100000000, query time of that 0.0016033930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
793.679 < 794.487
  -> Decision False in time 0.0000000000, query time of that 0.0013408600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1432.53 < 1568.22
  -> Decision False in time 0.0100000000, query time of that 0.0012477840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
841.336 < 898.143
  -> Decision False in time 0.0000000000, query time of that 0.0012940170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
857.113 < 1157.47
  -> Decision False in time 0.0100000000, query time of that 0.0012781230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1431.11 < 1456.07
  -> Decision False in time 0.0000000000, query time of that 0.0012613390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
916.679 < 1027.82
  -> Decision False in time 0.0100000000, query time of that 0.0011694860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 286.3199999999997
Index size:  247188.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0095417660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0878610750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.8797639850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0100078270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0987494580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2000000000, query time of that 1.0196417260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0104707710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1009215310, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8200000000, query time of that 0.9846770340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 285.7099999999991
Index size:  203636.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0157485860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1424003020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5300000000, query time of that 1.4811614680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0159881540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1641729160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8500000000, query time of that 1.6981676870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0183096960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1812592590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1679.52 < 1693.03
  -> Decision False in time 3.7300000000, query time of that 0.8906948820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 286.2600000000002
Index size:  200652.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089535150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0795551290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7659873330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0098327580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0883721910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1100000000, query time of that 0.8856990600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0091732210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0879609990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1625.61 < 1627.94
  -> Decision False in time 8.4100000000, query time of that 0.8557306240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 278.2399999999998
Index size:  197380.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057235660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0463535430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4571962260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0051212990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0533716340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1557.75 < 1562.24
  -> Decision False in time 0.5600000000, query time of that 0.3709889520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052149160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1923.84 < 1932.82
  -> Decision False in time 0.0600000000, query time of that 0.0053413290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1505.48 < 1517.14
  -> Decision False in time 0.3300000000, query time of that 0.0236176220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 277.4599999999991
Index size:  241748.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0059566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042446060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0325077530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3190362780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0034527010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1248.29 < 1248.9
  -> Decision False in time 0.0200000000, query time of that 0.0110535020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1666.96 < 1677.46
  -> Decision False in time 0.2800000000, query time of that 0.1353221140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1216.73 < 1220.35
  -> Decision False in time 0.0300000000, query time of that 0.0037654620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1527.67 < 1535.92
  -> Decision False in time 0.3300000000, query time of that 0.0174925570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1703.65 < 1722.98
  -> Decision False in time 0.0100000000, query time of that 0.0039099320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 287.65000000000146
Index size:  255312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0133607570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1177352880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2100000000, query time of that 1.1657083590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0125820230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1364838910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4700000000, query time of that 1.3299689770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0130148180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1360000250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.5600000000, query time of that 1.3704286720, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 287.65000000000146
Index size:  203312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056588420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0501111390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5143969370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057659050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0587191630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.5908246740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061132080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1289.78 < 1312.98
  -> Decision False in time 0.2400000000, query time of that 0.0184666210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1881.62 < 1909.38
  -> Decision False in time 3.7400000000, query time of that 0.2638442700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 280.7099999999991
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0049784700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0392918730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1064.45 < 1077.36
  -> Decision False in time 0.0800000000, query time of that 0.0711182790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041781560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1495.02 < 1525.53
  -> Decision False in time 0.0400000000, query time of that 0.0252276160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1097.6 < 1114.64
  -> Decision False in time 0.1000000000, query time of that 0.0573152060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1638.91 < 1645.11
  -> Decision False in time 0.0100000000, query time of that 0.0045801390, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0467783240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1378.43 < 1416.57
  -> Decision False in time 0.0700000000, query time of that 0.0051223570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 123.53000000000247
Index size:  200248.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0038466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055104430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0450987410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1526.36 < 1529.68
  -> Decision False in time 0.4300000000, query time of that 0.3976467190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048036820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2161.91 < 2191.56
  -> Decision False in time 0.0500000000, query time of that 0.0323041900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.5168779350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1401.38 < 1421.77
  -> Decision False in time 0.0300000000, query time of that 0.0051804110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1106.55 < 1119.53
  -> Decision False in time 0.1800000000, query time of that 0.0161785470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1685.76 < 1710.08
  -> Decision False in time 0.5600000000, query time of that 0.0381135940, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 75.64999999999782
Index size:  180032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4654066667
  Testing...
|S| = 20
|T| = 283
Reject!
1578.08 < 2571.31
  -> Decision False in time 0.0000000000, query time of that 0.0022659110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1989.67 < 2044.16
  -> Decision False in time 0.0000000000, query time of that 0.0017779600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2587.82 < 2602.81
  -> Decision False in time 0.0000000000, query time of that 0.0015001500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2294.11 < 2580.21
  -> Decision False in time 0.0100000000, query time of that 0.0014527850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2860.32 < 2887.58
  -> Decision False in time 0.0000000000, query time of that 0.0014794650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1050.55 < 1084.94
  -> Decision False in time 0.0000000000, query time of that 0.0014569010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1246.76 < 2603.89
  -> Decision False in time 0.0000000000, query time of that 0.0014417840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1321.18 < 1355.15
  -> Decision False in time 0.0100000000, query time of that 0.0015152560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1546.4 < 1868.91
  -> Decision False in time 0.0000000000, query time of that 0.0014460620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 75.61000000000058
Index size:  183616.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0832366667
  Testing...
|S| = 20
|T| = 283
Reject!
967.016 < 1023.26
  -> Decision False in time 0.0000000000, query time of that 0.0033406960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2452.02 < 2684.45
  -> Decision False in time 0.0100000000, query time of that 0.0088709670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2466.06 < 2830.21
  -> Decision False in time 0.0200000000, query time of that 0.0212855140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1002.76 < 1016.88
  -> Decision False in time 0.0100000000, query time of that 0.0024991390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2802.54 < 3000.38
  -> Decision False in time 0.0000000000, query time of that 0.0025272770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1202.35 < 1222.66
  -> Decision False in time 0.0500000000, query time of that 0.0208507940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1570.9 < 1598.07
  -> Decision False in time 0.0100000000, query time of that 0.0030269750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1002.08 < 1061.97
  -> Decision False in time 0.0100000000, query time of that 0.0029534770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2454.77 < 2801.62
  -> Decision False in time 0.0000000000, query time of that 0.0026989010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 104.38999999999942
Index size:  188992.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1565716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0024085290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2050.86 < 2055.74
  -> Decision False in time 0.0000000000, query time of that 0.0032119890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1271.8 < 1294.93
  -> Decision False in time 0.0100000000, query time of that 0.0097024940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1107.05 < 1242.07
  -> Decision False in time 0.0100000000, query time of that 0.0017202160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
959.139 < 1026.51
  -> Decision False in time 0.0000000000, query time of that 0.0017681460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1585.37 < 1604.26
  -> Decision False in time 0.0000000000, query time of that 0.0017543980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1255.39 < 1358.47
  -> Decision False in time 0.0000000000, query time of that 0.0018445700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1250.21 < 1251.08
  -> Decision False in time 0.0100000000, query time of that 0.0018991420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1396.08 < 1405.55
  -> Decision False in time 0.0000000000, query time of that 0.0019071760, with c1=5.0000000000, c2=0.1000000000
