copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 385.54
Index size:  466232.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0069132780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0558191840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5198059670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0062099460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0598464700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1302.21 < 1345.99
  -> Decision False in time 0.1200000000, query time of that 0.0946369970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0059458210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0587464390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1917.88 < 1966.1
  -> Decision False in time 0.7100000000, query time of that 0.0522800110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 151.42999999999995
Index size:  211824.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0122091880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0706368660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.6977881670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0079012630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1537.7 < 1557.77
  -> Decision False in time 0.0300000000, query time of that 0.0228263610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.8240051410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0084500100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0803386690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1060.66 < 1318.8
  -> Decision False in time 0.7300000000, query time of that 0.0695680100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 406.2599999999999
Index size:  257528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0441870900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4458570860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.5700000000, query time of that 4.5004506290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0472303010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4783757700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 5.0500000000, query time of that 4.9472632660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0638417920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.6968707810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 11.0000000000, query time of that 7.1487941120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 407.0999999999999
Index size:  206700.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0176009560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1669841870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7400000000, query time of that 1.6942391210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0198940350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2019249360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1900000000, query time of that 1.9924432310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0242281960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.2330610640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3900000000, query time of that 2.2549411600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 384.3499999999999
Index size:  213432.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0830900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031653870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1796.57 < 2023.41
  -> Decision False in time 0.0100000000, query time of that 0.0094968280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1873.42 < 2172
  -> Decision False in time 0.0400000000, query time of that 0.0254542220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1055.27 < 1061.25
  -> Decision False in time 0.0100000000, query time of that 0.0021792000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1602.07 < 1607.64
  -> Decision False in time 0.0100000000, query time of that 0.0025137260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1061.56 < 1104.43
  -> Decision False in time 0.0100000000, query time of that 0.0041666420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
592.944 < 594.39
  -> Decision False in time 0.0200000000, query time of that 0.0024811540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
484.926 < 492.23
  -> Decision False in time 0.0100000000, query time of that 0.0023406480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1542.03 < 1544.91
  -> Decision False in time 0.0000000000, query time of that 0.0020482970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 150.4699999999998
Index size:  202044.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0748150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0027750870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1618.35 < 2258.48
  -> Decision False in time 0.0100000000, query time of that 0.0039677370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1274.62 < 1309.12
  -> Decision False in time 0.0100000000, query time of that 0.0079695570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0020119890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1573.03 < 1594.61
  -> Decision False in time 0.0200000000, query time of that 0.0044859170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1993.42 < 1994.66
  -> Decision False in time 0.0000000000, query time of that 0.0021294410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1218.75 < 1285.05
  -> Decision False in time 0.0100000000, query time of that 0.0021156330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1309.53 < 1317.43
  -> Decision False in time 0.0100000000, query time of that 0.0020820600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1529.18 < 1566.31
  -> Decision False in time 0.0000000000, query time of that 0.0022694220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 79.65999999999985
Index size:  180436.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0332650000
  Testing...
|S| = 20
|T| = 283
Reject!
2086.06 < 2206.94
  -> Decision False in time 0.0000000000, query time of that 0.0051427330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2179.45 < 2218.42
  -> Decision False in time 0.0100000000, query time of that 0.0110257730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2165.7 < 2191.44
  -> Decision False in time 0.0200000000, query time of that 0.0115544060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041886520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1478.06 < 1496.24
  -> Decision False in time 0.0500000000, query time of that 0.0333115700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1648.42 < 2023.29
  -> Decision False in time 0.0200000000, query time of that 0.0094380840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1453.91 < 1476.46
  -> Decision False in time 0.0600000000, query time of that 0.0051709570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1706.03 < 1719.74
  -> Decision False in time 0.0100000000, query time of that 0.0046054770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1238.9 < 1336.21
  -> Decision False in time 0.1200000000, query time of that 0.0095050480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 115.13000000000011
Index size:  182620.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1270183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0024623900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1753.19 < 2114.63
  -> Decision False in time 0.0100000000, query time of that 0.0098652320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1952.32 < 2092.35
  -> Decision False in time 0.0100000000, query time of that 0.0017191500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1830.64 < 1884.29
  -> Decision False in time 0.0000000000, query time of that 0.0018952980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1530.15 < 1666.23
  -> Decision False in time 0.0000000000, query time of that 0.0020656530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1945.97 < 2015.28
  -> Decision False in time 0.0100000000, query time of that 0.0018665170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1842.79 < 2000.85
  -> Decision False in time 0.0000000000, query time of that 0.0018467090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1371.19 < 1869.83
  -> Decision False in time 0.0000000000, query time of that 0.0019565000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2159.01 < 2250.77
  -> Decision False in time 0.0100000000, query time of that 0.0017773200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 382.80999999999995
Index size:  250640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0155116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039346810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0272476720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1313.64 < 1324.26
  -> Decision False in time 0.1200000000, query time of that 0.1041270120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028170330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
871.176 < 889.971
  -> Decision False in time 0.0100000000, query time of that 0.0032915500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1442.86 < 1443.87
  -> Decision False in time 0.2000000000, query time of that 0.0855876340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1659.06 < 1670.4
  -> Decision False in time 0.0200000000, query time of that 0.0032433280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2337.48 < 2341.98
  -> Decision False in time 0.0100000000, query time of that 0.0033340070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1550.89 < 1568.73
  -> Decision False in time 0.0600000000, query time of that 0.0032204670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 115.57999999999993
Index size:  201272.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0096766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047809990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0330550600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1656.65 < 1706.25
  -> Decision False in time 0.0700000000, query time of that 0.0648640040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036121450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1860.84 < 2026.27
  -> Decision False in time 0.0300000000, query time of that 0.0169935100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1364.19 < 1368.31
  -> Decision False in time 0.0500000000, query time of that 0.0280523280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0037913940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1680.21 < 1731.55
  -> Decision False in time 0.0100000000, query time of that 0.0043386780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1334.33 < 1412.58
  -> Decision False in time 0.0200000000, query time of that 0.0039220060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 80.59000000000015
Index size:  180944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8132633333
  Testing...
|S| = 20
|T| = 283
Reject!
1660.98 < 1680.87
  -> Decision False in time 0.0000000000, query time of that 0.0016112060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1579.38 < 2168.44
  -> Decision False in time 0.0000000000, query time of that 0.0011441060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2462.65 < 2479.9
  -> Decision False in time 0.0000000000, query time of that 0.0010230260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2088.44 < 2093.77
  -> Decision False in time 0.0100000000, query time of that 0.0009448230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1544.64 < 1551.24
  -> Decision False in time 0.0000000000, query time of that 0.0009577810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2513.19 < 2529.78
  -> Decision False in time 0.0000000000, query time of that 0.0009159150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1767.77 < 1852.02
  -> Decision False in time 0.0000000000, query time of that 0.0008856500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2316.47 < 2458.2
  -> Decision False in time 0.0000000000, query time of that 0.0009462550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1625.96 < 1731.39
  -> Decision False in time 0.0000000000, query time of that 0.0009430770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 116.09999999999991
Index size:  186552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2899983333
  Testing...
|S| = 20
|T| = 283
Reject!
1820.95 < 1836.55
  -> Decision False in time 0.0000000000, query time of that 0.0025045460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1403.98 < 1565.04
  -> Decision False in time 0.0000000000, query time of that 0.0019822900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1865.69 < 2201.57
  -> Decision False in time 0.0000000000, query time of that 0.0017633270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1823.57 < 1865.63
  -> Decision False in time 0.0100000000, query time of that 0.0016129090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1473.39 < 1478.94
  -> Decision False in time 0.0000000000, query time of that 0.0016314690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2106.95 < 2170.11
  -> Decision False in time 0.0000000000, query time of that 0.0015380880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1873.22 < 1888.33
  -> Decision False in time 0.0000000000, query time of that 0.0015323900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1634.5 < 1651.5
  -> Decision False in time 0.0100000000, query time of that 0.0015378760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1580.27 < 1617.83
  -> Decision False in time 0.0000000000, query time of that 0.0016173320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 80.23000000000002
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4165483333
  Testing...
|S| = 20
|T| = 283
Reject!
1200.06 < 1550.83
  -> Decision False in time 0.0100000000, query time of that 0.0021589120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2066.19 < 2115.69
  -> Decision False in time 0.0000000000, query time of that 0.0019339830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1848.5 < 1866.74
  -> Decision False in time 0.0000000000, query time of that 0.0014492830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1506.66 < 2042.86
  -> Decision False in time 0.0000000000, query time of that 0.0014125020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1834.24 < 2051.83
  -> Decision False in time 0.0000000000, query time of that 0.0014715730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1624.1 < 2090.65
  -> Decision False in time 0.0100000000, query time of that 0.0015876920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2314.16 < 2385.52
  -> Decision False in time 0.0000000000, query time of that 0.0014319460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2328.72 < 2596.61
  -> Decision False in time 0.0000000000, query time of that 0.0013798590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2257.33 < 2271.79
  -> Decision False in time 0.0000000000, query time of that 0.0013763640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 405.3800000000001
Index size:  263536.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0376581440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3682519560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.7600000000, query time of that 3.7063977430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0468610020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4485750670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.2900000000, query time of that 4.1628733880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0434800610, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.5512810280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.7400000000, query time of that 5.9078265490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 386.40999999999985
Index size:  206796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0096542360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0821987850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7765663770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0093181720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0922223720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1100000000, query time of that 0.8999869920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0087181930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.0931602390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8400000000, query time of that 0.8735292620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 115.92000000000007
Index size:  196780.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0181400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0039080290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1622.42 < 1661.49
  -> Decision False in time 0.0300000000, query time of that 0.0230318140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1382.33 < 1396.62
  -> Decision False in time 0.0700000000, query time of that 0.0576955700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1210.17 < 1250.43
  -> Decision False in time 0.0000000000, query time of that 0.0027944370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1689.94 < 1698.62
  -> Decision False in time 0.0500000000, query time of that 0.0225833680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1491.73 < 1540.65
  -> Decision False in time 0.0300000000, query time of that 0.0138811420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1642.69 < 1651.11
  -> Decision False in time 0.0400000000, query time of that 0.0031870740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1635.45 < 1640.2
  -> Decision False in time 0.0900000000, query time of that 0.0049454190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1821.19 < 1869.61
  -> Decision False in time 0.0700000000, query time of that 0.0033479190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 80.28000000000065
Index size:  183836.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0228200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0057058930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0460562780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2144.58 < 2203.58
  -> Decision False in time 0.0100000000, query time of that 0.0142968010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1950.36 < 1951.69
  -> Decision False in time 0.0100000000, query time of that 0.0050793020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1669.91 < 1687.91
  -> Decision False in time 0.0000000000, query time of that 0.0054963100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1401.85 < 1439.54
  -> Decision False in time 0.0400000000, query time of that 0.0272922930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1675.89 < 1862.92
  -> Decision False in time 0.0100000000, query time of that 0.0054037400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2155.82 < 2168.56
  -> Decision False in time 0.0800000000, query time of that 0.0080590370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1240.09 < 1265.41
  -> Decision False in time 0.0100000000, query time of that 0.0052924150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 151.44999999999982
Index size:  192212.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0089166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0047284340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0334197900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1709.07 < 1714.09
  -> Decision False in time 0.1700000000, query time of that 0.1500346580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036113500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1233.68 < 1317.7
  -> Decision False in time 0.0100000000, query time of that 0.0043198800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1719.2 < 1734.85
  -> Decision False in time 0.0700000000, query time of that 0.0363590500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2043.77 < 2050
  -> Decision False in time 0.0200000000, query time of that 0.0039906970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1747.07 < 1750.75
  -> Decision False in time 0.2000000000, query time of that 0.0121409160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1730.69 < 1731.7
  -> Decision False in time 0.1900000000, query time of that 0.0124833300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 80.28999999999996
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0489883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044574690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2099.55 < 2123.26
  -> Decision False in time 0.0100000000, query time of that 0.0159647540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1689.38 < 1693.39
  -> Decision False in time 0.0200000000, query time of that 0.0128625210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1674.94 < 1789.07
  -> Decision False in time 0.0000000000, query time of that 0.0034003390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2117.82 < 2126.77
  -> Decision False in time 0.0100000000, query time of that 0.0034001170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1949.19 < 2114.14
  -> Decision False in time 0.0300000000, query time of that 0.0174342220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1787.51 < 1788.15
  -> Decision False in time 0.0000000000, query time of that 0.0039048490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1430.5 < 1476.62
  -> Decision False in time 0.0300000000, query time of that 0.0037812090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1798.63 < 1822.42
  -> Decision False in time 0.0100000000, query time of that 0.0039931400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 405.33000000000084
Index size:  254260.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0213585180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1975294000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.8771796920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0222447260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2131570770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3200000000, query time of that 2.1323280830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0235276410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.2665417390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0500000000, query time of that 2.7539385260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 115.51000000000022
Index size:  192644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5596600000
  Testing...
|S| = 20
|T| = 283
Reject!
1622.03 < 1818.22
  -> Decision False in time 0.0100000000, query time of that 0.0014813680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1971.89 < 2012.21
  -> Decision False in time 0.0000000000, query time of that 0.0015811390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2182.9 < 2214.35
  -> Decision False in time 0.0100000000, query time of that 0.0015074530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1860.74 < 2026.41
  -> Decision False in time 0.0000000000, query time of that 0.0012091050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1701.85 < 1799.14
  -> Decision False in time 0.0100000000, query time of that 0.0011702670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2605.4 < 2632.97
  -> Decision False in time 0.0000000000, query time of that 0.0012973280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1957.64 < 1963.66
  -> Decision False in time 0.0000000000, query time of that 0.0012048580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1770.27 < 1778.08
  -> Decision False in time 0.0100000000, query time of that 0.0012231250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1756.94 < 1936.28
  -> Decision False in time 0.0000000000, query time of that 0.0011891080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 406.3599999999997
Index size:  259916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0122076110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1109297180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1600000000, query time of that 1.1129489990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0124973500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1330139230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4000000000, query time of that 1.2919881670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0120893800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1362269620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 1.2996207770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 386.0
Index size:  199088.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092708570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0880832870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.9092009480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0099044640, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1041821160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.0382146470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0105909030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1058432490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1752.86 < 1756.59
  -> Decision False in time 1.5900000000, query time of that 0.1960183790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 117.07000000000062
Index size:  198188.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0034833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056613550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0458593960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1662.67 < 1694.47
  -> Decision False in time 0.0800000000, query time of that 0.0675725000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051513100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1631.14 < 1654.02
  -> Decision False in time 0.0300000000, query time of that 0.0233220650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1856.45 < 1875.67
  -> Decision False in time 0.0300000000, query time of that 0.0210705970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0050609430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1470.01 < 1542.51
  -> Decision False in time 0.0100000000, query time of that 0.0052285350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1351.91 < 1366.88
  -> Decision False in time 0.1600000000, query time of that 0.0103690030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 116.38000000000011
Index size:  183152.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076254250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0653461600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1754.28 < 1910.97
  -> Decision False in time 0.0800000000, query time of that 0.0674467750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075341290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1444.61 < 1598.44
  -> Decision False in time 0.0600000000, query time of that 0.0559259710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1005.42 < 1043.08
  -> Decision False in time 0.2100000000, query time of that 0.1926235950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0078598270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0754884580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1346.42 < 1361.7
  -> Decision False in time 1.1800000000, query time of that 0.1086076910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 406.7600000000002
Index size:  262148.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0075723150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0600934010, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1807.64 < 1885.19
  -> Decision False in time 0.2400000000, query time of that 0.2271926550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061408240, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0686606770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.6916507410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0071409940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0709259360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8900000000, query time of that 0.6826064950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 385.02000000000044
Index size:  206512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0126149650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1116252170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1600000000, query time of that 1.1137061850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0131080800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1323111350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5300000000, query time of that 1.2924663600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0143864940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1289253940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1900000000, query time of that 1.3135924440, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 151.84999999999854
Index size:  204248.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4523050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0020989170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1708.06 < 1844.92
  -> Decision False in time 0.0100000000, query time of that 0.0031716310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1508.36 < 1564.54
  -> Decision False in time 0.0100000000, query time of that 0.0026740190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1308.55 < 1451.4
  -> Decision False in time 0.0000000000, query time of that 0.0011197620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1380.11 < 1424.51
  -> Decision False in time 0.0100000000, query time of that 0.0012086600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1423.91 < 1445.02
  -> Decision False in time 0.0000000000, query time of that 0.0011682050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1527.68 < 1599.44
  -> Decision False in time 0.0100000000, query time of that 0.0012108210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1488.74 < 1557.67
  -> Decision False in time 0.0000000000, query time of that 0.0011705690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1715.3 < 1958.71
  -> Decision False in time 0.0100000000, query time of that 0.0013048950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 116.30000000000109
Index size:  182588.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0098926590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0842410220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.8068796640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0096243510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0938197010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1577.66 < 1588.16
  -> Decision False in time 0.5900000000, query time of that 0.5660130450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0091172430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1691.34 < 1729.42
  -> Decision False in time 0.4600000000, query time of that 0.0565430590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2107.43 < 2158.99
  -> Decision False in time 1.3800000000, query time of that 0.1571511320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 116.39999999999964
Index size:  188496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066225280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0554400320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5506087560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0059984430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0625534800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1231.51 < 1269.71
  -> Decision False in time 0.4100000000, query time of that 0.3146973200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0067861870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0626719120, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
630.473 < 659.01
  -> Decision False in time 0.4900000000, query time of that 0.0386971810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 405.4400000000005
Index size:  257468.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0252057440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2822392390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7700000000, query time of that 2.7214449780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0281675350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2901358980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1400000000, query time of that 2.9663113100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0338367920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.4104668180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6500000000, query time of that 4.2599162630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 385.1399999999994
Index size:  205844.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0254540470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2389220760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.4300000000, query time of that 2.3801745110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0251578510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2699530140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.8600000000, query time of that 2.6681501200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0307959710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.3576882560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3700000000, query time of that 3.6369063720, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 407.53000000000065
Index size:  252408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0202570220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.2062540350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1100000000, query time of that 2.0545764240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0251757930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2285867260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5700000000, query time of that 2.3632590090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0233570760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.3112480970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1165.73 < 1257.39
  -> Decision False in time 0.6900000000, query time of that 0.2670565580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 150.89000000000124
Index size:  195884.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0268500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036259050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0239298250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1994.85 < 2060.95
  -> Decision False in time 0.0100000000, query time of that 0.0113453570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1018.91 < 1027.11
  -> Decision False in time 0.0100000000, query time of that 0.0024473430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1669.05 < 1671.33
  -> Decision False in time 0.0100000000, query time of that 0.0054116080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1785.55 < 1802.84
  -> Decision False in time 0.0200000000, query time of that 0.0085640400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1506.86 < 1525.15
  -> Decision False in time 0.0300000000, query time of that 0.0030149170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1192.49 < 1197.71
  -> Decision False in time 0.0800000000, query time of that 0.0045514330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1801.33 < 1877.35
  -> Decision False in time 0.0700000000, query time of that 0.0029685390, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 405.65999999999985
Index size:  234720.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0187500050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1573908550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6200000000, query time of that 1.5568451580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0182209940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1795216050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9600000000, query time of that 1.7929658310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0202698920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1810506420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5600000000, query time of that 2.1191770500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 151.17000000000007
Index size:  195228.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0041366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0046499930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0407239090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1594.88 < 1613.68
  -> Decision False in time 0.4300000000, query time of that 0.3840780120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047348390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1827.33 < 1874.8
  -> Decision False in time 0.0000000000, query time of that 0.0050585440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1341.64 < 1341.69
  -> Decision False in time 0.0500000000, query time of that 0.0261321250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1604.86 < 1627.16
  -> Decision False in time 0.0300000000, query time of that 0.0050536400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1900.61 < 1933.43
  -> Decision False in time 0.5600000000, query time of that 0.0360136740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1147.58 < 1210.12
  -> Decision False in time 0.7400000000, query time of that 0.0461747740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 386.03999999999905
Index size:  235512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0077834440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0661223660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6599551920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0074811920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0761724170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1717.49 < 1717.68
  -> Decision False in time 0.6200000000, query time of that 0.5453901720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0077284940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0767439350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1752.86 < 1756.59
  -> Decision False in time 0.4700000000, query time of that 0.0466999590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 406.3299999999999
Index size:  258148.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0152449920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1402566590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.3436637280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0161980340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1557798220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7400000000, query time of that 1.5625928010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0172751290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1542261840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2600000000, query time of that 1.7061000930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 384.96000000000095
Index size:  212916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0044580850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0351687420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3900000000, query time of that 0.3527129840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0036506170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0415622970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.4157700990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0043977710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1381.79 < 1408.58
  -> Decision False in time 0.7800000000, query time of that 0.0407995470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1548.32 < 1630.68
  -> Decision False in time 0.3500000000, query time of that 0.0192981500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 406.5699999999997
Index size:  253464.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0162593010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1493723670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5200000000, query time of that 1.4587449350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0179158320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1699231170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8700000000, query time of that 1.6796336360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0194333840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1851911430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5500000000, query time of that 1.9929318200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 79.54000000000087
Index size:  189088.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0887066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030148270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2149.53 < 2167.56
  -> Decision False in time 0.0100000000, query time of that 0.0114582600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2168.37 < 2188.67
  -> Decision False in time 0.0200000000, query time of that 0.0087760290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0027433700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1900.52 < 1965.17
  -> Decision False in time 0.0000000000, query time of that 0.0029071030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
959.702 < 1020.82
  -> Decision False in time 0.0200000000, query time of that 0.0066178400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1114.2 < 1186.09
  -> Decision False in time 0.0200000000, query time of that 0.0031773030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1490.55 < 1528.1
  -> Decision False in time 0.1000000000, query time of that 0.0060487180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2144.74 < 2183.09
  -> Decision False in time 0.0100000000, query time of that 0.0030515380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 79.77999999999884
Index size:  136984.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5853650000
  Testing...
|S| = 20
|T| = 283
Reject!
1959.21 < 2039.88
  -> Decision False in time 0.0000000000, query time of that 0.0018786650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1483.22 < 1536.53
  -> Decision False in time 0.0100000000, query time of that 0.0016172710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2095.49 < 2133.03
  -> Decision False in time 0.0000000000, query time of that 0.0013985920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1132.56 < 1175.9
  -> Decision False in time 0.0000000000, query time of that 0.0012726440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1656.02 < 1900.12
  -> Decision False in time 0.0000000000, query time of that 0.0011406330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1586.89 < 1634.08
  -> Decision False in time 0.0000000000, query time of that 0.0012088570, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1213.49 < 1389.83
  -> Decision False in time 0.0000000000, query time of that 0.0012092860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1902.83 < 2145.73
  -> Decision False in time 0.0100000000, query time of that 0.0011846810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1641.81 < 1692.35
  -> Decision False in time 0.0000000000, query time of that 0.0011717200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 385.03000000000065
Index size:  252856.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0383637110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3919443370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.9100000000, query time of that 3.8449644110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0466714410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4600000000, query time of that 0.4387826490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.3600000000, query time of that 4.2305700660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0524226860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1100000000, query time of that 0.5945394150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.6900000000, query time of that 5.9952020670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 152.7599999999984
Index size:  205256.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0007000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0117953030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1084701370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0700000000, query time of that 1.0223952020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0109026600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1187693480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1543.55 < 1670.68
  -> Decision False in time 0.8100000000, query time of that 0.7757363990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0125823770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1186169950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1677.87 < 1697.92
  -> Decision False in time 3.2900000000, query time of that 0.4687701410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 152.1800000000003
Index size:  176872.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2089450000
  Testing...
|S| = 20
|T| = 283
Reject!
1141.76 < 1197.86
  -> Decision False in time 0.0000000000, query time of that 0.0025371010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1738.23 < 1739.53
  -> Decision False in time 0.0000000000, query time of that 0.0028721210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1954.63 < 2082.66
  -> Decision False in time 0.0100000000, query time of that 0.0049573980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1196.45 < 1206.88
  -> Decision False in time 0.0000000000, query time of that 0.0016433650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1826.55 < 1867.48
  -> Decision False in time 0.0100000000, query time of that 0.0036093870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2180.53 < 2364.76
  -> Decision False in time 0.0100000000, query time of that 0.0019627650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1891.26 < 1904.46
  -> Decision False in time 0.0000000000, query time of that 0.0019003050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1351.71 < 1444.19
  -> Decision False in time 0.0000000000, query time of that 0.0017346160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1983.75 < 2012.63
  -> Decision False in time 0.0100000000, query time of that 0.0016970850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 404.7800000000025
Index size:  260660.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0140061890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1209632170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1870244590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0118696040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1370392240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5100000000, query time of that 1.3765575160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0157347670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1398518590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7500000000, query time of that 1.3805304710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 116.10000000000218
Index size:  191896.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101541140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0958500480, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.9797808210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0110010420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1154097050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1384.87 < 1395.08
  -> Decision False in time 1.1600000000, query time of that 1.0608141480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0117751130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1917.94 < 1932.49
  -> Decision False in time 0.0600000000, query time of that 0.0123823090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1709.28 < 1713.37
  -> Decision False in time 1.4000000000, query time of that 0.1958320640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 152.8100000000013
Index size:  187252.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067169990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0560938630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5588465370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0058801510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0653791180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1908.64 < 1928.71
  -> Decision False in time 0.3700000000, query time of that 0.3049378100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0065253450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0656575790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1824.59 < 1841.08
  -> Decision False in time 0.1900000000, query time of that 0.0198580100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 81.56999999999971
Index size:  183592.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2958800000
  Testing...
|S| = 20
|T| = 283
Reject!
1899.52 < 1996.94
  -> Decision False in time 0.0100000000, query time of that 0.0025512610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2280.22 < 2416.9
  -> Decision False in time 0.0000000000, query time of that 0.0026398060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1741.48 < 2151.99
  -> Decision False in time 0.0000000000, query time of that 0.0018581390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1493.4 < 1552.75
  -> Decision False in time 0.0000000000, query time of that 0.0016700070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1704.67 < 1751.94
  -> Decision False in time 0.0100000000, query time of that 0.0018157820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1777.68 < 1886.66
  -> Decision False in time 0.0000000000, query time of that 0.0018487200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2578.56 < 2610.94
  -> Decision False in time 0.0000000000, query time of that 0.0016577470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2965.23 < 2992.9
  -> Decision False in time 0.0000000000, query time of that 0.0016245790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1718.87 < 1732.17
  -> Decision False in time 0.0000000000, query time of that 0.0018477300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 406.630000000001
Index size:  260632.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089957370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0773822050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7591578640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086423040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0874000980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0900000000, query time of that 0.8803101430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0092327140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0885368100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1761.23 < 1765.01
  -> Decision False in time 2.8300000000, query time of that 0.2919579450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 80.56000000000131
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0151216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067621910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1943.86 < 1979.01
  -> Decision False in time 0.0100000000, query time of that 0.0157531380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2389.86 < 2426.3
  -> Decision False in time 0.1300000000, query time of that 0.1216524580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1824.89 < 1972.88
  -> Decision False in time 0.0100000000, query time of that 0.0060897270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2055.49 < 2056.21
  -> Decision False in time 0.0200000000, query time of that 0.0162359300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2216.41 < 2348.06
  -> Decision False in time 0.0300000000, query time of that 0.0289480420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1766.21 < 1801.8
  -> Decision False in time 0.0100000000, query time of that 0.0065764850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1549.58 < 2426.3
  -> Decision False in time 0.2800000000, query time of that 0.0271761490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1529.56 < 1610.61
  -> Decision False in time 0.1800000000, query time of that 0.0168030270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 404.3199999999997
Index size:  199948.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0256441740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2330899110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3700000000, query time of that 2.3256824980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0279770410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2517798690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7000000000, query time of that 2.5959374040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0248431230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.3321938980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.9400000000, query time of that 3.4632791880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 404.4800000000032
Index size:  209704.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0110616190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0965964630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.9549903980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0102305020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1109663320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.1124529170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0111860020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1160317370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9400000000, query time of that 1.0991355960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 382.59000000000015
Index size:  220936.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0169246060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1576377950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6100000000, query time of that 1.5572989490, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0187460840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1833467500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9900000000, query time of that 1.8346767240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0193208190, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1914959350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7900000000, query time of that 2.0599852960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 115.79999999999927
Index size:  196332.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0521883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0030412950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1814.54 < 1842.27
  -> Decision False in time 0.0200000000, query time of that 0.0094293680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1098.18 < 1107.41
  -> Decision False in time 0.0200000000, query time of that 0.0203523680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0021489430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2160.57 < 2308.14
  -> Decision False in time 0.0100000000, query time of that 0.0022031540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1506.02 < 1541.91
  -> Decision False in time 0.0200000000, query time of that 0.0058739820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1600.4 < 1623.98
  -> Decision False in time 0.0500000000, query time of that 0.0025207180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1643.09 < 1655.69
  -> Decision False in time 0.0200000000, query time of that 0.0025850690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2013.36 < 2019.19
  -> Decision False in time 0.0100000000, query time of that 0.0026866510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 151.20000000000073
Index size:  190052.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0143266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039594370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2002.54 < 2101.89
  -> Decision False in time 0.0200000000, query time of that 0.0172536100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.3200000000, query time of that 0.2808837000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1794.05 < 1796.95
  -> Decision False in time 0.0100000000, query time of that 0.0030933270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1522.73 < 1584.14
  -> Decision False in time 0.0400000000, query time of that 0.0203361410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1671.83 < 1676.35
  -> Decision False in time 0.0200000000, query time of that 0.0069277970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0033460050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1684.22 < 1714.66
  -> Decision False in time 0.1600000000, query time of that 0.0073795050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1395.62 < 1429.32
  -> Decision False in time 0.1500000000, query time of that 0.0073372610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 151.54000000000087
Index size:  185732.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064627270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0497470550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5300000000, query time of that 0.4868062910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0056782920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0571667380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1666.03 < 1732.14
  -> Decision False in time 0.3000000000, query time of that 0.2136043940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0053739180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0569730400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1019.58 < 1035.61
  -> Decision False in time 0.3200000000, query time of that 0.0236097730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 151.45999999999913
Index size:  191008.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084322400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0775679370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7641486650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
960.454 < 1074.46
  -> Decision False in time 0.0100000000, query time of that 0.0076007450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0873485870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1099.41 < 1325.03
  -> Decision False in time 0.8500000000, query time of that 0.7905899250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0093284330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0857625440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1174.27 < 1230.97
  -> Decision False in time 0.6900000000, query time of that 0.0771790920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 384.130000000001
Index size:  248164.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0139099120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1269632270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.2186308230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0136248440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1443927700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5800000000, query time of that 1.4076495450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0143759460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1449904110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 1.4201726060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 80.36999999999898
Index size:  196944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1245500000
  Testing...
|S| = 20
|T| = 283
Reject!
1642.45 < 2199.34
  -> Decision False in time 0.0000000000, query time of that 0.0025311040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1823.57 < 2281.03
  -> Decision False in time 0.0100000000, query time of that 0.0086844890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1947.7 < 2057.11
  -> Decision False in time 0.0100000000, query time of that 0.0029849370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2088.58 < 2128.84
  -> Decision False in time 0.0100000000, query time of that 0.0019448920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1309.2 < 1323.85
  -> Decision False in time 0.0000000000, query time of that 0.0018799650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1664.5 < 1693.13
  -> Decision False in time 0.0100000000, query time of that 0.0021848790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1840.26 < 1919.1
  -> Decision False in time 0.0100000000, query time of that 0.0024159550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1807.05 < 1911.79
  -> Decision False in time 0.0100000000, query time of that 0.0020512420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1952.48 < 1998.84
  -> Decision False in time 0.0000000000, query time of that 0.0020956610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 384.1200000000026
Index size:  245384.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0055163330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0447125820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4343881720, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052231570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0507909700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1651.97 < 1741.29
  -> Decision False in time 0.2100000000, query time of that 0.1399077720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0055257920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1753.77 < 1787.59
  -> Decision False in time 0.1300000000, query time of that 0.0108668260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1665.25 < 1667.34
  -> Decision False in time 1.0100000000, query time of that 0.0652172390, with c1=5.0000000000, c2=0.1000000000
