copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 274.8
Index size:  457588.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0152401510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1472823240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4800000000, query time of that 1.4235222350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0153500990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1482500270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7500000000, query time of that 1.5794326100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0175005460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1596173410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2600000000, query time of that 1.6397884350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 102.38
Index size:  206432.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3312950000
  Testing...
|S| = 20
|T| = 283
Reject!
845.628 < 989.317
  -> Decision False in time 0.0100000000, query time of that 0.0037909570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
697.554 < 771.269
  -> Decision False in time 0.0100000000, query time of that 0.0012942030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
677.174 < 732.725
  -> Decision False in time 0.0000000000, query time of that 0.0025523870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1134.37 < 1155.68
  -> Decision False in time 0.0100000000, query time of that 0.0010901160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
734.044 < 766.521
  -> Decision False in time 0.0100000000, query time of that 0.0010297550, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1368.29 < 1369.93
  -> Decision False in time 0.0000000000, query time of that 0.0010985290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
604.608 < 688.692
  -> Decision False in time 0.0000000000, query time of that 0.0011279440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2225.93 < 2310.27
  -> Decision False in time 0.0100000000, query time of that 0.0010721450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1600.05 < 1663.87
  -> Decision False in time 0.0100000000, query time of that 0.0010463080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 284.76
Index size:  260932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0172829190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1754677300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8500000000, query time of that 1.8002227510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0218838820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2110879190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2400000000, query time of that 2.0920619950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0229935970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.2307146240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7000000000, query time of that 2.2498372110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 283.54999999999995
Index size:  203488.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0088919810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0793469750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7687345870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0081286160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0873210790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.8881709510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0087323500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.0898642930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1679.52 < 1693.03
  -> Decision False in time 0.8900000000, query time of that 0.0985362950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 274.95000000000005
Index size:  197688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076446950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0682398960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7200000000, query time of that 0.6736345870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0073570990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0785211780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.7654781140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0077398690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1787.35 < 1981.44
  -> Decision False in time 0.5500000000, query time of that 0.0549970040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1202.4 < 1208.29
  -> Decision False in time 2.7200000000, query time of that 0.2516773700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 275.8700000000001
Index size:  247224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0256350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0034764880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1729.42 < 1731.07
  -> Decision False in time 0.0100000000, query time of that 0.0045949590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1322.63 < 1325.35
  -> Decision False in time 0.0100000000, query time of that 0.0127530870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1055.48 < 1069.05
  -> Decision False in time 0.0100000000, query time of that 0.0026064050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1240.69 < 1294.48
  -> Decision False in time 0.0100000000, query time of that 0.0057912770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1345.39 < 1350.63
  -> Decision False in time 0.0000000000, query time of that 0.0027722230, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
708.832 < 743.292
  -> Decision False in time 0.0300000000, query time of that 0.0030680690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1400.47 < 1402.76
  -> Decision False in time 0.0100000000, query time of that 0.0030794410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1267.76 < 1279.29
  -> Decision False in time 0.0000000000, query time of that 0.0026630750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 121.63999999999987
Index size:  206412.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0025033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0061432760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0523458240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.5135753920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0058044210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0592262290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1679.16 < 1689.46
  -> Decision False in time 0.2100000000, query time of that 0.1534302600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056297560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0591395130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1096.03 < 1153.23
  -> Decision False in time 0.1800000000, query time of that 0.0148065000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 276.6700000000001
Index size:  233636.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0215554250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1852045120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9400000000, query time of that 1.8738183670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0218914780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2103883750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3300000000, query time of that 2.1363721640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0241469910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2349726540, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7300000000, query time of that 2.4270871180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 285.30999999999995
Index size:  259532.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0244137340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2472710710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7200000000, query time of that 2.6685045430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0341000320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3600000000, query time of that 0.3204817120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1939.74 < 1958.57
  -> Decision False in time 0.6500000000, query time of that 0.6305160850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0318408370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.3759966930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3600000000, query time of that 3.9154066030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 102.25
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0276400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035672200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0256020020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
933.299 < 976.177
  -> Decision False in time 0.0400000000, query time of that 0.0295927050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027194660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1068.06 < 1116.2
  -> Decision False in time 0.0200000000, query time of that 0.0089945480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1494.08 < 1497.94
  -> Decision False in time 0.0200000000, query time of that 0.0120242550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1152.72 < 1160.24
  -> Decision False in time 0.0100000000, query time of that 0.0029181250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1639.63 < 1748.47
  -> Decision False in time 0.0000000000, query time of that 0.0031359600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1289.03 < 1297.15
  -> Decision False in time 0.0100000000, query time of that 0.0028209590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 73.86999999999989
Index size:  183812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5878466667
  Testing...
|S| = 20
|T| = 283
Reject!
1539.17 < 1602.02
  -> Decision False in time 0.0000000000, query time of that 0.0017992190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1052.01 < 1782.99
  -> Decision False in time 0.0100000000, query time of that 0.0012328510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1776.84 < 1920.5
  -> Decision False in time 0.0000000000, query time of that 0.0011731290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1074.31 < 1086.89
  -> Decision False in time 0.0000000000, query time of that 0.0011715070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1117.24 < 1213.54
  -> Decision False in time 0.0000000000, query time of that 0.0012293590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1644.43 < 1670.72
  -> Decision False in time 0.0000000000, query time of that 0.0011482600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1620.19 < 1667.15
  -> Decision False in time 0.0000000000, query time of that 0.0011410150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1213.78 < 1293.7
  -> Decision False in time 0.0100000000, query time of that 0.0011418830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1138.46 < 1202.15
  -> Decision False in time 0.0000000000, query time of that 0.0011761430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 102.51999999999998
Index size:  183276.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0023600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0105156200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0925908740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9044503500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0103930790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1043239620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2200000000, query time of that 1.0435901740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0099410120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1027938620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1116 < 1129.75
  -> Decision False in time 0.2800000000, query time of that 0.0439787730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 121.57999999999993
Index size:  190096.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0020800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0073015810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0653708900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6700000000, query time of that 0.6250442510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0071457820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0712798450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1541.53 < 1604.03
  -> Decision False in time 0.2000000000, query time of that 0.1852270620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0075894320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1229.8 < 1248.68
  -> Decision False in time 0.3700000000, query time of that 0.0367314920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1178.23 < 1197.53
  -> Decision False in time 0.2500000000, query time of that 0.0257858020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 102.77999999999975
Index size:  188552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0045750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0061728770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0518854260, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5198302930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057744530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0588300490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1238.14 < 1267.89
  -> Decision False in time 0.3400000000, query time of that 0.2557916430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060287820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1586.31 < 1586.32
  -> Decision False in time 0.1200000000, query time of that 0.0122480860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1470.16 < 1470.68
  -> Decision False in time 0.4200000000, query time of that 0.0302136510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 74.68000000000029
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1162833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0029339890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1443.06 < 1476.28
  -> Decision False in time 0.0100000000, query time of that 0.0053620850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1543.83 < 1693.8
  -> Decision False in time 0.0100000000, query time of that 0.0068129740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0021132570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1654.11 < 1672.43
  -> Decision False in time 0.0000000000, query time of that 0.0027675050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1407.04 < 1547.61
  -> Decision False in time 0.0100000000, query time of that 0.0027481430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1223.67 < 1338.83
  -> Decision False in time 0.0000000000, query time of that 0.0026419350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1860.07 < 2537.2
  -> Decision False in time 0.0100000000, query time of that 0.0023335460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1518.44 < 1739.46
  -> Decision False in time 0.0200000000, query time of that 0.0025341980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 73.98999999999978
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0302216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049353730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1050.64 < 1084.15
  -> Decision False in time 0.0300000000, query time of that 0.0315472210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2258.89 < 2309.17
  -> Decision False in time 0.0400000000, query time of that 0.0345573560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039330600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0419803910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1526.32 < 1723.52
  -> Decision False in time 0.0300000000, query time of that 0.0138023090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1194.51 < 1239.5
  -> Decision False in time 0.0200000000, query time of that 0.0042326070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1390.1 < 1399.36
  -> Decision False in time 0.0100000000, query time of that 0.0045373030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1857.81 < 1904.88
  -> Decision False in time 0.0000000000, query time of that 0.0040224400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 102.75999999999931
Index size:  188548.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1576416667
  Testing...
|S| = 20
|T| = 283
Reject!
1598.82 < 1737.78
  -> Decision False in time 0.0000000000, query time of that 0.0023676990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1017.33 < 1057.24
  -> Decision False in time 0.0000000000, query time of that 0.0019713640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1441.93 < 1534.35
  -> Decision False in time 0.0100000000, query time of that 0.0031977510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1042.92 < 1091.69
  -> Decision False in time 0.0000000000, query time of that 0.0016421120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1347.3 < 1358.37
  -> Decision False in time 0.0000000000, query time of that 0.0017723680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1924.05 < 1934.78
  -> Decision False in time 0.0100000000, query time of that 0.0019458400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1246.44 < 1271.89
  -> Decision False in time 0.0000000000, query time of that 0.0018454320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
913.567 < 918.271
  -> Decision False in time 0.0000000000, query time of that 0.0017593670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1285.46 < 1288.54
  -> Decision False in time 0.0100000000, query time of that 0.0017071300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 74.11999999999989
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0187483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064734550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0520416310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2004.36 < 2065.16
  -> Decision False in time 0.1400000000, query time of that 0.1334337240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0053193370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1198.11 < 1239.62
  -> Decision False in time 0.0900000000, query time of that 0.0587989920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1326.65 < 1342.76
  -> Decision False in time 0.1100000000, query time of that 0.0844895680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0065638410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1807.51 < 1808.37
  -> Decision False in time 0.1700000000, query time of that 0.0152704140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1163.25 < 1247.07
  -> Decision False in time 0.0100000000, query time of that 0.0061780230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 121.80000000000018
Index size:  191536.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0232966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0035750220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1709.21 < 1760.94
  -> Decision False in time 0.0300000000, query time of that 0.0229086870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1370.92 < 1373.15
  -> Decision False in time 0.1400000000, query time of that 0.1261438930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028910420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
611.098 < 643.034
  -> Decision False in time 0.0300000000, query time of that 0.0124068240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
766.347 < 794.223
  -> Decision False in time 0.0700000000, query time of that 0.0290704900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2306.86 < 2318.79
  -> Decision False in time 0.0200000000, query time of that 0.0032390790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1247.1 < 1259.24
  -> Decision False in time 0.0700000000, query time of that 0.0032457120, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1171.88 < 1193.96
  -> Decision False in time 0.2000000000, query time of that 0.0096583210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 278.2400000000007
Index size:  239916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056831080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0458466400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4517896320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0048942170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1941.18 < 1944.6
  -> Decision False in time 0.0600000000, query time of that 0.0398459160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1316.84 < 1317.72
  -> Decision False in time 0.5900000000, query time of that 0.3796145710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0052989890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0516775910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1994.53 < 2004.63
  -> Decision False in time 1.4000000000, query time of that 0.0889189010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 283.78999999999996
Index size:  256192.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058908350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0513680300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5146893420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0059129810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1441.63 < 1464.87
  -> Decision False in time 0.0200000000, query time of that 0.0106927380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.5857470290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0059042960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1965.03 < 2022.31
  -> Decision False in time 0.6500000000, query time of that 0.0486647060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1983.75 < 1986.11
  -> Decision False in time 0.4500000000, query time of that 0.0352725740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 284.77000000000044
Index size:  203176.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0071232790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0652469510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6428741080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0072353410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0733327680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1818 < 1820.73
  -> Decision False in time 0.3900000000, query time of that 0.3532108630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0074288510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1259.44 < 1276.16
  -> Decision False in time 0.2000000000, query time of that 0.0222773350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1319.05 < 1319.93
  -> Decision False in time 0.5500000000, query time of that 0.0533665910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 121.23000000000047
Index size:  192328.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4939933333
  Testing...
|S| = 20
|T| = 283
Reject!
937.67 < 982.448
  -> Decision False in time 0.0100000000, query time of that 0.0022018040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1617.63 < 1796.96
  -> Decision False in time 0.0000000000, query time of that 0.0039704440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1029.48 < 1064.15
  -> Decision False in time 0.0000000000, query time of that 0.0012846190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
757.609 < 814.817
  -> Decision False in time 0.0000000000, query time of that 0.0013630570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
999.138 < 1021.17
  -> Decision False in time 0.0000000000, query time of that 0.0013142900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
934.922 < 981.593
  -> Decision False in time 0.0000000000, query time of that 0.0014534190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1129.99 < 1150.1
  -> Decision False in time 0.0000000000, query time of that 0.0013931060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1363.54 < 1368.99
  -> Decision False in time 0.0000000000, query time of that 0.0013146170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1200.13 < 1267.5
  -> Decision False in time 0.0100000000, query time of that 0.0015616490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 74.22000000000025
Index size:  183704.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0722083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0032727480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0246354460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2555.52 < 2624.42
  -> Decision False in time 0.0200000000, query time of that 0.0165593350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025252960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
931.281 < 932.109
  -> Decision False in time 0.0100000000, query time of that 0.0064026460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1949.05 < 1950.8
  -> Decision False in time 0.0200000000, query time of that 0.0087826730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1343.23 < 1354.52
  -> Decision False in time 0.0100000000, query time of that 0.0029171490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2077.74 < 2088.16
  -> Decision False in time 0.0000000000, query time of that 0.0031808600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1125.76 < 1129.61
  -> Decision False in time 0.0300000000, query time of that 0.0030828480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 121.22999999999956
Index size:  188632.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0040666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055485180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0444536210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4800000000, query time of that 0.4423209270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0052083100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0519061490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1079.79 < 1094.55
  -> Decision False in time 0.2700000000, query time of that 0.1774493160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0052209560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1429.77 < 1482.84
  -> Decision False in time 0.2500000000, query time of that 0.0154144540, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1651.32 < 1672.63
  -> Decision False in time 0.4800000000, query time of that 0.0315920050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 277.0199999999995
Index size:  235192.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0302934110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2893514210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9400000000, query time of that 2.8939319880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0304104840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.3081906560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.5000000000, query time of that 3.2204450170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0356690740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.3936316580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4700000000, query time of that 4.0998778390, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 102.35999999999967
Index size:  200008.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084638070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0735683310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7900000000, query time of that 0.7397018540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0082056550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0853138110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.8602479290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0087296060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1017.2 < 1034.41
  -> Decision False in time 0.1300000000, query time of that 0.0173106240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1696.11 < 1727.87
  -> Decision False in time 1.0000000000, query time of that 0.1069877110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 284.9899999999998
Index size:  246900.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0094566900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0874892060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.8705153390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101165680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0984671540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2100000000, query time of that 1.0049112650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0103041100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.1000929000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6800000000, query time of that 0.9854206670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 73.22000000000025
Index size:  183408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7921300000
  Testing...
|S| = 20
|T| = 283
Reject!
996.991 < 1328.49
  -> Decision False in time 0.0100000000, query time of that 0.0015981790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1008.56 < 1043.01
  -> Decision False in time 0.0000000000, query time of that 0.0010367360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2284.46 < 2416.01
  -> Decision False in time 0.0100000000, query time of that 0.0009837270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
983.169 < 1173.57
  -> Decision False in time 0.0000000000, query time of that 0.0009422500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
845.056 < 1082.09
  -> Decision False in time 0.0000000000, query time of that 0.0009667500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
931.232 < 1014.62
  -> Decision False in time 0.0100000000, query time of that 0.0010251780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1054.48 < 1173.22
  -> Decision False in time 0.0000000000, query time of that 0.0009664450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1133.67 < 1296.39
  -> Decision False in time 0.0100000000, query time of that 0.0009265300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2313.38 < 2387.76
  -> Decision False in time 0.0000000000, query time of that 0.0009421050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 275.7399999999998
Index size:  186312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072338140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0588665920, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6100000000, query time of that 0.5703427340, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065166690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0641334790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.6468145360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0067091620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1838.33 < 1875.25
  -> Decision False in time 0.5800000000, query time of that 0.0502956220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1701.46 < 1773.05
  -> Decision False in time 1.2700000000, query time of that 0.1006582400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 120.31999999999971
Index size:  199944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0099432830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0911975830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.8909692460, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0103158360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1014627570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1900000000, query time of that 1.0242489960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0111199050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1003394520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1642.78 < 1651.75
  -> Decision False in time 2.0600000000, query time of that 0.2525632200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 285.1700000000001
Index size:  245624.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0150513120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1348701570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4400000000, query time of that 1.3901399440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0138498820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1502260410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.5423430690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0168612070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1589085490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6200000000, query time of that 1.6423475560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 101.14999999999964
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5988366667
  Testing...
|S| = 20
|T| = 283
Reject!
2179.97 < 2241.66
  -> Decision False in time 0.0000000000, query time of that 0.0012836710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1179.53 < 1252.75
  -> Decision False in time 0.0100000000, query time of that 0.0020687120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
666.349 < 669.886
  -> Decision False in time 0.0000000000, query time of that 0.0012573680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1500.72 < 1570.36
  -> Decision False in time 0.0100000000, query time of that 0.0010284550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1964.85 < 2071.89
  -> Decision False in time 0.0000000000, query time of that 0.0010737950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1046.53 < 1061.4
  -> Decision False in time 0.0100000000, query time of that 0.0009490430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1597.14 < 1603.96
  -> Decision False in time 0.0000000000, query time of that 0.0009608080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1499.92 < 1567.42
  -> Decision False in time 0.0100000000, query time of that 0.0008899060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2238.87 < 2241.97
  -> Decision False in time 0.0000000000, query time of that 0.0009162940, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 277.34000000000015
Index size:  236600.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0107778010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0953602850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.9553021580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0110235660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1129678330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.1112789400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0121265210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1097921580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8500000000, query time of that 1.1078431600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 284.8099999999995
Index size:  259936.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0125142400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1255472320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2000000000, query time of that 1.1496810970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0144717640, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1334562580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4800000000, query time of that 1.3226399340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0126029160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1370091550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 1.3308456130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 73.64999999999964
Index size:  184064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0495216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0041940600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2168.62 < 2344.56
  -> Decision False in time 0.0100000000, query time of that 0.0059083960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2280.9 < 2926.6
  -> Decision False in time 0.0300000000, query time of that 0.0287275740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031434410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
870.765 < 900.664
  -> Decision False in time 0.0100000000, query time of that 0.0036988130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1321.4 < 1385.36
  -> Decision False in time 0.0100000000, query time of that 0.0073973850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
971.638 < 972.42
  -> Decision False in time 0.0300000000, query time of that 0.0036119860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1624.27 < 1629.32
  -> Decision False in time 0.0200000000, query time of that 0.0037802980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1426.55 < 1426.66
  -> Decision False in time 0.0000000000, query time of that 0.0037484310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 73.42999999999847
Index size:  139076.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2186750000
  Testing...
|S| = 20
|T| = 283
Reject!
2194.54 < 2345.54
  -> Decision False in time 0.0100000000, query time of that 0.0022834910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1356.06 < 1375.93
  -> Decision False in time 0.0100000000, query time of that 0.0102003590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1731.08 < 1942.34
  -> Decision False in time 0.0000000000, query time of that 0.0026693570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1241.97 < 1263.47
  -> Decision False in time 0.0100000000, query time of that 0.0016105860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1133.25 < 1158.2
  -> Decision False in time 0.0000000000, query time of that 0.0017479110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1094.06 < 1100.54
  -> Decision False in time 0.0000000000, query time of that 0.0018892150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1810.2 < 1986.33
  -> Decision False in time 0.0100000000, query time of that 0.0017138370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1533.69 < 1693.46
  -> Decision False in time 0.0000000000, query time of that 0.0016556830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2330.39 < 2430.19
  -> Decision False in time 0.0000000000, query time of that 0.0018205120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 121.21999999999935
Index size:  194400.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0077833330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0699397710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7200000000, query time of that 0.6819750100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0071705080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
890.584 < 899.393
  -> Decision False in time 0.0700000000, query time of that 0.0588465660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1603.69 < 1609.2
  -> Decision False in time 0.7700000000, query time of that 0.7118091440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0076292480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.0775846170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1642.66 < 1661.57
  -> Decision False in time 0.2500000000, query time of that 0.0244409990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 121.48999999999978
Index size:  185924.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0139483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039755380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0301825540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2330.68 < 2473.55
  -> Decision False in time 0.3000000000, query time of that 0.2659428780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034441840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1159.26 < 1172.25
  -> Decision False in time 0.0600000000, query time of that 0.0301264220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1536.34 < 1590.24
  -> Decision False in time 0.1500000000, query time of that 0.0726487880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0033031350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1866.78 < 1869.88
  -> Decision False in time 0.0900000000, query time of that 0.0070881500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1462.29 < 1515.59
  -> Decision False in time 0.0600000000, query time of that 0.0036447470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 73.72999999999956
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3581716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0020081140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
884.817 < 887.283
  -> Decision False in time 0.0000000000, query time of that 0.0016206850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2272.47 < 2840.38
  -> Decision False in time 0.0100000000, query time of that 0.0013475390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1450.23 < 1535.17
  -> Decision False in time 0.0000000000, query time of that 0.0014212850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1142.16 < 1255.57
  -> Decision False in time 0.0000000000, query time of that 0.0013661560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2037.75 < 2065.73
  -> Decision False in time 0.0000000000, query time of that 0.0013632300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1385.37 < 1500.35
  -> Decision False in time 0.0000000000, query time of that 0.0013122170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1264.28 < 1465.92
  -> Decision False in time 0.0100000000, query time of that 0.0013807740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1471.34 < 1513.23
  -> Decision False in time 0.0000000000, query time of that 0.0014757580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 121.38000000000102
Index size:  191040.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2557683333
  Testing...
|S| = 20
|T| = 283
Reject!
2357.84 < 2486.64
  -> Decision False in time 0.0000000000, query time of that 0.0023999880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
899.812 < 1016.2
  -> Decision False in time 0.0100000000, query time of that 0.0027072530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1199.34 < 1242.95
  -> Decision False in time 0.0000000000, query time of that 0.0032646840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1695.85 < 1719.67
  -> Decision False in time 0.0000000000, query time of that 0.0017128970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1656.09 < 1660.73
  -> Decision False in time 0.0100000000, query time of that 0.0017167190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1589.34 < 1600.56
  -> Decision False in time 0.0000000000, query time of that 0.0016444380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1417.5 < 1423.87
  -> Decision False in time 0.0000000000, query time of that 0.0016102920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1208.05 < 1403.91
  -> Decision False in time 0.0100000000, query time of that 0.0016710350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
728.962 < 812.279
  -> Decision False in time 0.0000000000, query time of that 0.0017044050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 284.2999999999993
Index size:  253032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0136946790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1265636700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.2399447390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0140180770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1475695160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6100000000, query time of that 1.4244793200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0137455990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1436262030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1757.54 < 1828.04
  -> Decision False in time 5.9300000000, query time of that 1.0703610130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 284.47000000000116
Index size:  203496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0123735290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1081228220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1400000000, query time of that 1.0946768930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0122141530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1207010870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4400000000, query time of that 1.2465260160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0149162090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1255104670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0700000000, query time of that 1.2435543510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 101.94000000000051
Index size:  186908.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0145883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039815410, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0301594630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3067535030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0035286300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1304.13 < 1322.59
  -> Decision False in time 0.0500000000, query time of that 0.0227789700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
856.335 < 911.82
  -> Decision False in time 0.0600000000, query time of that 0.0298298050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0034289980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1010.81 < 1016.48
  -> Decision False in time 0.0200000000, query time of that 0.0036760890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1652.78 < 1657.65
  -> Decision False in time 0.1400000000, query time of that 0.0074452950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 277.2399999999998
Index size:  240944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0060466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0043529760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0324961650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2141.16 < 2258.82
  -> Decision False in time 0.0700000000, query time of that 0.0684760000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034837210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1354.35 < 1371.07
  -> Decision False in time 0.0300000000, query time of that 0.0152663150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1790.1 < 1827.79
  -> Decision False in time 0.0400000000, query time of that 0.0187839690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0036897040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1172.88 < 1173
  -> Decision False in time 0.1400000000, query time of that 0.0081560590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1497.42 < 1504.06
  -> Decision False in time 0.1600000000, query time of that 0.0078821430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 284.72999999999956
Index size:  259532.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0347264310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3200000000, query time of that 0.3236114640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.3100000000, query time of that 3.2432631180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0389224320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3747093670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.7600000000, query time of that 3.5870553470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0438676720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.4632622390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.1900000000, query time of that 4.8363690640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 277.4399999999987
Index size:  194516.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046385480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0390583500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.3843892200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042981180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0440128480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1190.81 < 1239.49
  -> Decision False in time 0.3000000000, query time of that 0.1757371160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0046608870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2111.28 < 2230.27
  -> Decision False in time 0.0000000000, query time of that 0.0047242190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1601.03 < 1621.03
  -> Decision False in time 0.9000000000, query time of that 0.0495968670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 275.8099999999995
Index size:  236664.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0090889120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0788392370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7781838940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0084294980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0907268860, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1200000000, query time of that 0.8937726880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0092401270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0892839180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1988.31 < 2066.35
  -> Decision False in time 2.9700000000, query time of that 0.3151567770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 102.6299999999992
Index size:  199796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0721633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028271600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1016.83 < 1024.16
  -> Decision False in time 0.0100000000, query time of that 0.0075114730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
701.474 < 703.896
  -> Decision False in time 0.0100000000, query time of that 0.0106698960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1077.07 < 1183.51
  -> Decision False in time 0.0000000000, query time of that 0.0019974900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1403.54 < 1431.71
  -> Decision False in time 0.0100000000, query time of that 0.0044838300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
949.287 < 950.485
  -> Decision False in time 0.0100000000, query time of that 0.0023067790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1400.03 < 1521.51
  -> Decision False in time 0.0000000000, query time of that 0.0022496670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
862.53 < 871.396
  -> Decision False in time 0.0100000000, query time of that 0.0022666070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1443.77 < 1449.07
  -> Decision False in time 0.0000000000, query time of that 0.0023581040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 283.4499999999989
Index size:  247200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0104642250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1028718090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.9942087210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112093310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1108146320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.1459544760, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0105304850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1122723370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8800000000, query time of that 1.1565205020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 102.05999999999949
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0034200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0059710720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0577642930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6500000000, query time of that 0.6079047720, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0071161400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0702287100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1502.42 < 1525.86
  -> Decision False in time 0.5300000000, query time of that 0.4504479720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0069523810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1969.6 < 1980.34
  -> Decision False in time 0.1900000000, query time of that 0.0218898650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1636.46 < 1645.16
  -> Decision False in time 0.7800000000, query time of that 0.0674992650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 275.64999999999964
Index size:  219648.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1073733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0029390790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1125.31 < 1191.84
  -> Decision False in time 0.0200000000, query time of that 0.0130453720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1868.78 < 1897.98
  -> Decision False in time 0.0300000000, query time of that 0.0281307310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
743.468 < 756.463
  -> Decision False in time 0.0000000000, query time of that 0.0020869910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1505.68 < 1531.61
  -> Decision False in time 0.0000000000, query time of that 0.0023409490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1400.86 < 1417.8
  -> Decision False in time 0.0100000000, query time of that 0.0022194640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
993.95 < 1023.94
  -> Decision False in time 0.0100000000, query time of that 0.0023177490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
933.407 < 952.625
  -> Decision False in time 0.0100000000, query time of that 0.0025606540, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1229.7 < 1241.74
  -> Decision False in time 0.0200000000, query time of that 0.0023242640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 121.32999999999993
Index size:  204184.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1053283333
  Testing...
|S| = 20
|T| = 283
Reject!
1236.87 < 1267.76
  -> Decision False in time 0.0000000000, query time of that 0.0027160830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1152.16 < 1241.58
  -> Decision False in time 0.0100000000, query time of that 0.0020932910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
828.117 < 874.978
  -> Decision False in time 0.0100000000, query time of that 0.0126361350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1118.4 < 1119.63
  -> Decision False in time 0.0000000000, query time of that 0.0018165820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1738.53 < 1807.13
  -> Decision False in time 0.0100000000, query time of that 0.0020504620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1045.06 < 1059.5
  -> Decision False in time 0.0000000000, query time of that 0.0019769240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1252.21 < 1262.83
  -> Decision False in time 0.0100000000, query time of that 0.0019432310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1279.19 < 1293.87
  -> Decision False in time 0.0000000000, query time of that 0.0022246140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1653.52 < 1660.92
  -> Decision False in time 0.0100000000, query time of that 0.0020529300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 121.76000000000022
Index size:  176992.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0064750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047914110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0378628190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4200000000, query time of that 0.3737053060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0041297440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0434532270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1307.8 < 1333.17
  -> Decision False in time 0.0900000000, query time of that 0.0536524360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0044066230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1465.41 < 1474.54
  -> Decision False in time 0.2300000000, query time of that 0.0136842410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
713.89 < 723.655
  -> Decision False in time 0.0100000000, query time of that 0.0046668850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 102.28000000000065
Index size:  188564.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0068183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0052750010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0427432380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1169.68 < 1193.76
  -> Decision False in time 0.0900000000, query time of that 0.0837584430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0045443780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0485287770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1609.75 < 1624.37
  -> Decision False in time 0.0900000000, query time of that 0.0601751390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1959.31 < 2020.74
  -> Decision False in time 0.0100000000, query time of that 0.0048486760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1444.72 < 1474.16
  -> Decision False in time 0.0400000000, query time of that 0.0049104680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1590.93 < 1593.78
  -> Decision False in time 0.1800000000, query time of that 0.0121600430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 285.10000000000036
Index size:  258208.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0187960530, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1772346680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8000000000, query time of that 1.7505122330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0210763330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2021070230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1700000000, query time of that 2.0013094480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0224204780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1757.54 < 1828.04
  -> Decision False in time 0.0200000000, query time of that 0.0188856240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 2.2510423070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 276.52000000000044
Index size:  193240.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0121182700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1067429690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0700000000, query time of that 1.0267970180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0121833230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1168951450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.1783389450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0124449590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1215937240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1953.02 < 1992.1
  -> Decision False in time 8.2100000000, query time of that 1.1785528470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 283.1999999999989
Index size:  253984.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0229858930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2169619840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1500000000, query time of that 2.1038818260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0228370850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2439051570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5000000000, query time of that 2.3888968100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0266364960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2694386400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 2.8037832140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 283.9900000000016
Index size:  203104.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0159232940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1421802020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5700000000, query time of that 1.5138409150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0181153810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1691464950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9300000000, query time of that 1.7198284790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0187458100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1806042410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7200000000, query time of that 1.8082414110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 73.52000000000044
Index size:  182772.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0239500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052502740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0429948070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2144.61 < 2215.26
  -> Decision False in time 0.0700000000, query time of that 0.0645015980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048975780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1195.74 < 1204.92
  -> Decision False in time 0.0500000000, query time of that 0.0365818620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2151.26 < 2497.43
  -> Decision False in time 0.0100000000, query time of that 0.0049378120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1461.32 < 1487.1
  -> Decision False in time 0.0100000000, query time of that 0.0049758550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
983.836 < 1046.51
  -> Decision False in time 0.0700000000, query time of that 0.0053242070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1205.73 < 1224.73
  -> Decision False in time 0.0400000000, query time of that 0.0055018380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 121.15000000000146
Index size:  135780.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0412600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030913540, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1378.14 < 1401.06
  -> Decision False in time 0.0100000000, query time of that 0.0158045160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
842.845 < 859.781
  -> Decision False in time 0.1200000000, query time of that 0.0977321680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0022868550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1765.4 < 1794.33
  -> Decision False in time 0.0100000000, query time of that 0.0080457510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1021.6 < 1032.15
  -> Decision False in time 0.0100000000, query time of that 0.0027380670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1074.12 < 1170.74
  -> Decision False in time 0.0200000000, query time of that 0.0027049770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1188.23 < 1242.83
  -> Decision False in time 0.0500000000, query time of that 0.0028596840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1810.09 < 1970.49
  -> Decision False in time 0.0100000000, query time of that 0.0029220100, with c1=5.0000000000, c2=0.1000000000
