copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 300.0
Index size:  474916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0163467800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1466751090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4900000000, query time of that 1.4374717470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0161382300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1603404220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8100000000, query time of that 1.6295552450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0174644120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1686146390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6500000000, query time of that 1.6712931530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 300.5999999999999
Index size:  277980.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0225168820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0919559040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.8882273890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0089631910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1025448110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2100000000, query time of that 1.0120729000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0094999470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0986438400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0400000000, query time of that 1.0087874410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 301.7900000000002
Index size:  203180.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0125587350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1187131600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1961094790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0148056050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1401974740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6300000000, query time of that 1.4015169980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0166856430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1386057250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9500000000, query time of that 1.4195671630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 293.03999999999996
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0084058810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0763109380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.7971932240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086548150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0947085530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2310.12 < 2364.08
  -> Decision False in time 0.4400000000, query time of that 0.4126668830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0088021280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0929319990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2900000000, query time of that 0.9987107090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 107.80999999999995
Index size:  199480.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5943283333
  Testing...
|S| = 20
|T| = 283
Reject!
1049.63 < 1121.94
  -> Decision False in time 0.0100000000, query time of that 0.0015457140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1779.98 < 1866.07
  -> Decision False in time 0.0000000000, query time of that 0.0014968030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1484.3 < 1495.92
  -> Decision False in time 0.0100000000, query time of that 0.0031580290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1073.48 < 1433.35
  -> Decision False in time 0.0000000000, query time of that 0.0012000220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1523.98 < 1828.79
  -> Decision False in time 0.0100000000, query time of that 0.0011492600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
920.169 < 953.732
  -> Decision False in time 0.0000000000, query time of that 0.0011487390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1593.34 < 1594.28
  -> Decision False in time 0.0100000000, query time of that 0.0011796810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1309.22 < 1343.03
  -> Decision False in time 0.0000000000, query time of that 0.0013360150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
992.364 < 1091.78
  -> Decision False in time 0.0100000000, query time of that 0.0012892240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 301.17999999999984
Index size:  261396.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0142344640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1337053100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.2741108650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0147539620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1476855000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6400000000, query time of that 1.4822947850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0142902260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1530686270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0200000000, query time of that 1.5602175340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 292.1999999999998
Index size:  194528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0146186020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1324069200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3600000000, query time of that 1.3059310630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0143981750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1569491890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.5527742420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0169037190, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1698343120, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9900000000, query time of that 1.6223662150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 294.55999999999995
Index size:  245260.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1075316667
  Testing...
|S| = 20
|T| = 283
Reject!
638.653 < 641.101
  -> Decision False in time 0.0100000000, query time of that 0.0024418060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0199558160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1926.64 < 1952.26
  -> Decision False in time 0.0500000000, query time of that 0.0350888760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1091 < 1152.41
  -> Decision False in time 0.0100000000, query time of that 0.0020234490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1077.64 < 1114.4
  -> Decision False in time 0.0100000000, query time of that 0.0022826340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1688.26 < 1721.91
  -> Decision False in time 0.0100000000, query time of that 0.0025401980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1271.81 < 1283.34
  -> Decision False in time 0.0000000000, query time of that 0.0022409960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2026.09 < 2063.89
  -> Decision False in time 0.0200000000, query time of that 0.0023071360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
937.756 < 974.1
  -> Decision False in time 0.0100000000, query time of that 0.0024573710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 300.82000000000016
Index size:  255424.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0374128520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3338078970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.2500000000, query time of that 3.2071517130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0356174590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3559184820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.8600000000, query time of that 3.6120286890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0423220630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.4941502500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.5300000000, query time of that 5.0643637560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 109.01999999999953
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3365483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0021933620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1529.5 < 1542.27
  -> Decision False in time 0.0000000000, query time of that 0.0015542110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
849.812 < 884.754
  -> Decision False in time 0.0100000000, query time of that 0.0015490490, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1254.61 < 1326.61
  -> Decision False in time 0.0000000000, query time of that 0.0013836690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1242.04 < 1312.34
  -> Decision False in time 0.0100000000, query time of that 0.0013562220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1036.75 < 1059.35
  -> Decision False in time 0.0000000000, query time of that 0.0013751220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1360.65 < 1392.74
  -> Decision False in time 0.0100000000, query time of that 0.0014073660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1443.24 < 1486.69
  -> Decision False in time 0.0000000000, query time of that 0.0012844260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
793.86 < 890.048
  -> Decision False in time 0.0100000000, query time of that 0.0013456800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 301.0100000000002
Index size:  241708.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0192364760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1891267150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9500000000, query time of that 1.8904676580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226826060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2154138230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2800000000, query time of that 2.1305963380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0248263410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.2770862050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1787.35 < 1981.44
  -> Decision False in time 6.5400000000, query time of that 1.9983700270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 293.9499999999998
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0117910220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1065403230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0900000000, query time of that 1.0424522840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115067640, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1228706900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.2257557060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0132571530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1251610520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 1.1877964660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 108.89000000000033
Index size:  199624.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084590790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0735324680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7513157070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0087981140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0889089180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1422.72 < 1500.17
  -> Decision False in time 0.0400000000, query time of that 0.0414702610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0088426240, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1517.96 < 1520.42
  -> Decision False in time 0.0300000000, query time of that 0.0092024940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1032.1 < 1040.9
  -> Decision False in time 0.0100000000, query time of that 0.0086598230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 294.34999999999945
Index size:  239688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0059466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0045718510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0326071840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1721.14 < 1812.93
  -> Decision False in time 0.3500000000, query time of that 0.3188465550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0036785570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0386082360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
682.501 < 685.006
  -> Decision False in time 0.1200000000, query time of that 0.0612956490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0036902030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1449.9 < 1456.33
  -> Decision False in time 0.0900000000, query time of that 0.0056868620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1635.82 < 1660.62
  -> Decision False in time 0.4300000000, query time of that 0.0217963610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 78.53999999999996
Index size:  195428.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0200016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063593570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0555527620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1858.83 < 1872.88
  -> Decision False in time 0.1800000000, query time of that 0.1609465380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1456.52 < 1618.99
  -> Decision False in time 0.0000000000, query time of that 0.0057926930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0632327700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1937.6 < 1997.44
  -> Decision False in time 0.0800000000, query time of that 0.0676314070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0067246910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1313.12 < 1349.25
  -> Decision False in time 0.1200000000, query time of that 0.0130827690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1147.84 < 1190.18
  -> Decision False in time 0.2200000000, query time of that 0.0196736640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 107.60000000000036
Index size:  190940.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0065833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0054873660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0431365450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4600000000, query time of that 0.4232410100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0046842030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1335.79 < 1362.24
  -> Decision False in time 0.0300000000, query time of that 0.0169570990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1213.8 < 1228.28
  -> Decision False in time 0.0000000000, query time of that 0.0053269960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1684.4 < 1686.98
  -> Decision False in time 0.0500000000, query time of that 0.0052581900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1358.7 < 1365.59
  -> Decision False in time 0.4100000000, query time of that 0.0262630630, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
963.021 < 969.712
  -> Decision False in time 1.0300000000, query time of that 0.0637356120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 129.4399999999996
Index size:  185368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0137783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039422540, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0307620890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1795.67 < 1847.86
  -> Decision False in time 0.0600000000, query time of that 0.0492473550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033717830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1689.95 < 1692.74
  -> Decision False in time 0.0100000000, query time of that 0.0075954140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1980.5 < 2003.42
  -> Decision False in time 0.0200000000, query time of that 0.0083901810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2053.3 < 2086.05
  -> Decision False in time 0.0400000000, query time of that 0.0036003110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1073.8 < 1080.48
  -> Decision False in time 0.0400000000, query time of that 0.0039653610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1048.81 < 1055.73
  -> Decision False in time 0.1300000000, query time of that 0.0079060570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 128.88999999999942
Index size:  191484.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0406550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032581160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0225733170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1181.3 < 1204.7
  -> Decision False in time 0.0900000000, query time of that 0.0774728060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0023571620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1381.74 < 1391.86
  -> Decision False in time 0.0000000000, query time of that 0.0027200950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1799.17 < 1835.12
  -> Decision False in time 0.0100000000, query time of that 0.0050253770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1389.3 < 1389.65
  -> Decision False in time 0.0100000000, query time of that 0.0026896140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1420.76 < 1441.94
  -> Decision False in time 0.0100000000, query time of that 0.0026156390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1987.91 < 2047.6
  -> Decision False in time 0.0000000000, query time of that 0.0031165300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 108.67999999999938
Index size:  183224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0737950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0029398450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1072.97 < 1084.1
  -> Decision False in time 0.0100000000, query time of that 0.0094538210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1277.48 < 1360.06
  -> Decision False in time 0.0200000000, query time of that 0.0165119750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020750990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1263.68 < 1288.81
  -> Decision False in time 0.0100000000, query time of that 0.0025813920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1281.8 < 1316.38
  -> Decision False in time 0.0000000000, query time of that 0.0023819200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1201.69 < 1246.28
  -> Decision False in time 0.0300000000, query time of that 0.0023151090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2337.07 < 2355.17
  -> Decision False in time 0.0000000000, query time of that 0.0026522220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1126.29 < 1169.88
  -> Decision False in time 0.0100000000, query time of that 0.0022532960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 109.04999999999927
Index size:  188828.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1582850000
  Testing...
|S| = 20
|T| = 283
Reject!
1214.29 < 1216.19
  -> Decision False in time 0.0000000000, query time of that 0.0023443260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1281.39 < 1808.41
  -> Decision False in time 0.0100000000, query time of that 0.0038130880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1435.35 < 1453.93
  -> Decision False in time 0.0000000000, query time of that 0.0031542990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1741.87 < 1914.2
  -> Decision False in time 0.0100000000, query time of that 0.0017187120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1374.21 < 1437.42
  -> Decision False in time 0.0000000000, query time of that 0.0018320620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1252.17 < 1332.52
  -> Decision False in time 0.0000000000, query time of that 0.0019921820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1759.04 < 1765.35
  -> Decision False in time 0.0100000000, query time of that 0.0019078670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
853.071 < 859.782
  -> Decision False in time 0.0000000000, query time of that 0.0018494450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1193.24 < 1206.91
  -> Decision False in time 0.0100000000, query time of that 0.0020615330, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 292.7999999999993
Index size:  238836.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0196354190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1959250700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8700000000, query time of that 1.8308903300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0198602150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2056382090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2100000000, query time of that 2.0792064480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0234973170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.2530026590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4400000000, query time of that 2.5251838010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 293.77000000000044
Index size:  245932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058477390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0454249000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4589904620, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0051417090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0543762210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2176.49 < 2302.28
  -> Decision False in time 0.0300000000, query time of that 0.0186239990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1382.15 < 1398.11
  -> Decision False in time 0.0100000000, query time of that 0.0053232230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0536611960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1824.75 < 1857.9
  -> Decision False in time 0.9100000000, query time of that 0.0610718890, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 128.84000000000015
Index size:  205056.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0080356020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0664395220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6402946960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074250120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1695.12 < 1749.28
  -> Decision False in time 0.0600000000, query time of that 0.0550039410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.7311044240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0077897540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0736562450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1209.26 < 1243.54
  -> Decision False in time 0.6100000000, query time of that 0.0571521340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 293.1200000000008
Index size:  230528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0048055690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0405110430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.3987792000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0046591320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1606.23 < 1615.07
  -> Decision False in time 0.0300000000, query time of that 0.0183380060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1482.26 < 1512.87
  -> Decision False in time 0.0800000000, query time of that 0.0465350670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0047420890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0473247410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1173.33 < 1185.55
  -> Decision False in time 0.3700000000, query time of that 0.0244752600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.13999999999942
Index size:  196100.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5764933333
  Testing...
|S| = 20
|T| = 283
Reject!
1454.81 < 1505.67
  -> Decision False in time 0.0000000000, query time of that 0.0019604460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1046.5 < 1088.54
  -> Decision False in time 0.0100000000, query time of that 0.0015745820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
631.513 < 670.352
  -> Decision False in time 0.0000000000, query time of that 0.0015947390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1704.68 < 1723.1
  -> Decision False in time 0.0000000000, query time of that 0.0012314570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1652 < 1770.25
  -> Decision False in time 0.0000000000, query time of that 0.0012039630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
786.253 < 787.221
  -> Decision False in time 0.0000000000, query time of that 0.0012672390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1198.97 < 1224.56
  -> Decision False in time 0.0100000000, query time of that 0.0012057950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1699.67 < 1800.02
  -> Decision False in time 0.0000000000, query time of that 0.0012289130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1193.64 < 1348.01
  -> Decision False in time 0.0000000000, query time of that 0.0012155620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 128.40999999999985
Index size:  195368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4944950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0020903290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2103.7 < 2124.33
  -> Decision False in time 0.0000000000, query time of that 0.0033749160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1759.23 < 1854.12
  -> Decision False in time 0.0100000000, query time of that 0.0030312190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
921.233 < 956.582
  -> Decision False in time 0.0000000000, query time of that 0.0014988890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1052.93 < 1066.52
  -> Decision False in time 0.0000000000, query time of that 0.0016505850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1176.82 < 1211.16
  -> Decision False in time 0.0000000000, query time of that 0.0014945720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2196.43 < 2503.34
  -> Decision False in time 0.0100000000, query time of that 0.0014948000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2212.5 < 2460.41
  -> Decision False in time 0.0000000000, query time of that 0.0013718690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1413.74 < 1667.87
  -> Decision False in time 0.0000000000, query time of that 0.0015088400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 108.30999999999949
Index size:  177976.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0272416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034730370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0260462410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1288.43 < 1313.64
  -> Decision False in time 0.0200000000, query time of that 0.0195552170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029492750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1180.68 < 1183.39
  -> Decision False in time 0.0400000000, query time of that 0.0157670460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1711.5 < 1722.55
  -> Decision False in time 0.0200000000, query time of that 0.0094902700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1064.48 < 1093.18
  -> Decision False in time 0.0400000000, query time of that 0.0031834350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1980.5 < 2003.42
  -> Decision False in time 0.1500000000, query time of that 0.0065814730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1017.55 < 1089.57
  -> Decision False in time 0.0200000000, query time of that 0.0032298660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 292.2399999999998
Index size:  240528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0110860650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0978113910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.9737008450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0118051000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1128378660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.1358214210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0126862420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1133704100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9200000000, query time of that 1.1244834650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 294.35000000000036
Index size:  241916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0006116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0080182840, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0632063180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6500000000, query time of that 0.6024063850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065564690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0715472210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1403.79 < 1691.22
  -> Decision False in time 0.0400000000, query time of that 0.0347741100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0075100310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0730208300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1481.77 < 1489.66
  -> Decision False in time 3.2700000000, query time of that 0.2752861600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 294.880000000001
Index size:  238152.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079695930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0686210230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6876248050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076762980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0826219150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.8045182070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0081120180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0782013530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1632.83 < 1645.32
  -> Decision False in time 0.6900000000, query time of that 0.0698925690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 109.18999999999869
Index size:  199768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0034900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075719960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0632894390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1713.29 < 1719.28
  -> Decision False in time 0.1700000000, query time of that 0.1649616270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0074356460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0729694130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1660.05 < 1680.53
  -> Decision False in time 0.6700000000, query time of that 0.5981761950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0071681360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1143.32 < 1172.35
  -> Decision False in time 0.2700000000, query time of that 0.0254990360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1624.9 < 1640.04
  -> Decision False in time 0.0100000000, query time of that 0.0079181120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 129.92000000000007
Index size:  183412.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0223066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0037888270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0269870420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2285.25 < 2289.71
  -> Decision False in time 0.0500000000, query time of that 0.0497339700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029258550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1323.46 < 1373.15
  -> Decision False in time 0.0200000000, query time of that 0.0074367580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1069.79 < 1070.16
  -> Decision False in time 0.0300000000, query time of that 0.0159305280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1056.3 < 1069.43
  -> Decision False in time 0.0200000000, query time of that 0.0032522830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
893.872 < 896.541
  -> Decision False in time 0.0200000000, query time of that 0.0035208940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
971.056 < 992.648
  -> Decision False in time 0.0600000000, query time of that 0.0035382100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.61000000000058
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7871383333
  Testing...
|S| = 20
|T| = 283
Reject!
1101.97 < 1322.81
  -> Decision False in time 0.0000000000, query time of that 0.0016077230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1480.81 < 1488.76
  -> Decision False in time 0.0000000000, query time of that 0.0011279990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
870.671 < 943.251
  -> Decision False in time 0.0000000000, query time of that 0.0010615350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1935.35 < 2009.73
  -> Decision False in time 0.0000000000, query time of that 0.0009540010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1220.08 < 1391.86
  -> Decision False in time 0.0100000000, query time of that 0.0009022010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1328.09 < 1720.89
  -> Decision False in time 0.0000000000, query time of that 0.0010735610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1321.43 < 1370.05
  -> Decision False in time 0.0000000000, query time of that 0.0010103750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1909.53 < 2556.61
  -> Decision False in time 0.0000000000, query time of that 0.0009326990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1648 < 1692.07
  -> Decision False in time 0.0000000000, query time of that 0.0009351540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 129.53999999999905
Index size:  191240.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0065550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0049880770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0387068860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4200000000, query time of that 0.3811958110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0044744300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1603.69 < 1609.2
  -> Decision False in time 0.0200000000, query time of that 0.0108504510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1505.17 < 1542.38
  -> Decision False in time 0.0800000000, query time of that 0.0459284840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0043712470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0461995340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
856.043 < 891.534
  -> Decision False in time 0.0100000000, query time of that 0.0043857410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 302.8700000000008
Index size:  253304.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117318920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.1013051240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.9869950950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101670090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1184709330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.1644595210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0110423060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1194337750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1636.94 < 1658.97
  -> Decision False in time 7.5800000000, query time of that 1.0327230920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 109.7400000000016
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0147983333
  Testing...
|S| = 20
|T| = 283
Reject!
973.104 < 1132.07
  -> Decision False in time 0.0100000000, query time of that 0.0044577710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0321981170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1655.9 < 1663.83
  -> Decision False in time 0.2500000000, query time of that 0.2258135070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034883150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0366535090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1955.85 < 2018.89
  -> Decision False in time 0.0100000000, query time of that 0.0079105720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0038123790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1550.03 < 1566.27
  -> Decision False in time 0.2600000000, query time of that 0.0135378810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1372.38 < 1373.78
  -> Decision False in time 0.0100000000, query time of that 0.0039723660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 130.42000000000007
Index size:  183764.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0015666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0081359590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0718223210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7600000000, query time of that 0.6968186810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080064520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0788180380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1618.77 < 1619.5
  -> Decision False in time 0.6600000000, query time of that 0.6198550040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0085169950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1676.69 < 1727.87
  -> Decision False in time 0.5700000000, query time of that 0.0623995530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1398.45 < 1439.76
  -> Decision False in time 1.1300000000, query time of that 0.1093354240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 131.1800000000003
Index size:  182352.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0039200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056224810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0467674720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4519868680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0051147430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0524171370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1333.42 < 1343.23
  -> Decision False in time 0.4100000000, query time of that 0.2716216310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1587.1 < 1602.91
  -> Decision False in time 0.0300000000, query time of that 0.0054702250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1206.12 < 1222.56
  -> Decision False in time 0.6000000000, query time of that 0.0409050830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
894.229 < 916.801
  -> Decision False in time 0.5300000000, query time of that 0.0357512160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 131.0699999999997
Index size:  185216.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0028433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063175990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0533012940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5206994390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058651340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0597954580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1598.42 < 1601
  -> Decision False in time 0.1400000000, query time of that 0.1032768460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0056588170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0608965470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
665.489 < 753.867
  -> Decision False in time 2.8700000000, query time of that 0.2114255710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 79.6299999999992
Index size:  183784.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0752350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0033375990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2430.61 < 2842.68
  -> Decision False in time 0.0100000000, query time of that 0.0043642790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1240.06 < 1416.11
  -> Decision False in time 0.0100000000, query time of that 0.0109798400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1716.9 < 1753.43
  -> Decision False in time 0.0100000000, query time of that 0.0024708840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
909.091 < 927.606
  -> Decision False in time 0.0100000000, query time of that 0.0057971760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1397.16 < 1420.4
  -> Decision False in time 0.0100000000, query time of that 0.0030327020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
975.277 < 976.114
  -> Decision False in time 0.0000000000, query time of that 0.0028195100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1537.86 < 1580.65
  -> Decision False in time 0.0100000000, query time of that 0.0029659340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1024.01 < 1379.83
  -> Decision False in time 0.0100000000, query time of that 0.0029123580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 295.2900000000009
Index size:  240892.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0254833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034197720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0248440850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1166.14 < 1224.74
  -> Decision False in time 0.0200000000, query time of that 0.0166184770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027984460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1040.42 < 1048.67
  -> Decision False in time 0.0100000000, query time of that 0.0060879840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1420.03 < 1524.99
  -> Decision False in time 0.0100000000, query time of that 0.0029891320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1180.51 < 1213.06
  -> Decision False in time 0.0200000000, query time of that 0.0030965510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1525.79 < 1536.92
  -> Decision False in time 0.0200000000, query time of that 0.0033632370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1832.05 < 1842.05
  -> Decision False in time 0.0000000000, query time of that 0.0030401230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 301.0799999999999
Index size:  255812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0176786350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1699000180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7500000000, query time of that 1.6995719670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0198607610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.1998003490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1700000000, query time of that 1.9688160650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0231771300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2238915980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 2.1862781060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 301.0199999999986
Index size:  204056.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089664360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0832351520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.7801226740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0087876940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0934680260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.9127957320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0089386380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0878009100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1820.45 < 1859.29
  -> Decision False in time 6.6200000000, query time of that 0.7056069850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 301.1800000000003
Index size:  205108.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0165469210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1576942960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6000000000, query time of that 1.5575947240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0178741320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1780798070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0000000000, query time of that 1.7980036020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2363.76 < 2394.91
  -> Decision False in time 0.0500000000, query time of that 0.0208088280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.1915790280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5200000000, query time of that 2.0050240960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 300.9500000000007
Index size:  204540.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0247441440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2136347700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1500000000, query time of that 2.0926862340, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0230317620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2324024610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4600000000, query time of that 2.3541398210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0258247460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.3096344950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1734.97 < 1769.38
  -> Decision False in time 5.0100000000, query time of that 1.8004465970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 78.43000000000029
Index size:  189088.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0482900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042447240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2674.87 < 2736.4
  -> Decision False in time 0.0000000000, query time of that 0.0046112450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1804.05 < 2010.35
  -> Decision False in time 0.0300000000, query time of that 0.0229472320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1375.15 < 1515.01
  -> Decision False in time 0.0000000000, query time of that 0.0031219990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1084.18 < 1146.95
  -> Decision False in time 0.0200000000, query time of that 0.0098899190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2186.02 < 2386.57
  -> Decision False in time 0.0100000000, query time of that 0.0035712950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1795.96 < 2105.91
  -> Decision False in time 0.0000000000, query time of that 0.0036163980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1338.32 < 1371.48
  -> Decision False in time 0.0100000000, query time of that 0.0035733920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2034.17 < 2040.69
  -> Decision False in time 0.0600000000, query time of that 0.0040074680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 129.0
Index size:  139872.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1064016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0030310650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1133.95 < 1218.22
  -> Decision False in time 0.0200000000, query time of that 0.0145876150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1970.06 < 2039.67
  -> Decision False in time 0.0200000000, query time of that 0.0120164130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1130.59 < 1135.85
  -> Decision False in time 0.0000000000, query time of that 0.0018473390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1051.39 < 1097.32
  -> Decision False in time 0.0000000000, query time of that 0.0020116790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
795.975 < 798.826
  -> Decision False in time 0.0100000000, query time of that 0.0021050040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
641.072 < 680.405
  -> Decision False in time 0.0000000000, query time of that 0.0021463400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2288.72 < 2288.85
  -> Decision False in time 0.0100000000, query time of that 0.0024063810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1763.44 < 1798.9
  -> Decision False in time 0.0100000000, query time of that 0.0023411600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 108.63000000000102
Index size:  188572.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0099673200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0947468800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9113690950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0096765480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1040122240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2100000000, query time of that 1.0384919730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0105494880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1041708630, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1709.24 < 1735.81
  -> Decision False in time 0.5500000000, query time of that 0.0755889470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 128.3100000000013
Index size:  191644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2563950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0023598770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
841.598 < 881.048
  -> Decision False in time 0.0100000000, query time of that 0.0078750360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1706.78 < 1765.12
  -> Decision False in time 0.0100000000, query time of that 0.0015837810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2087.98 < 2112.25
  -> Decision False in time 0.0000000000, query time of that 0.0015846120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
872.885 < 953.742
  -> Decision False in time 0.0000000000, query time of that 0.0016491990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1163.58 < 1179.11
  -> Decision False in time 0.0000000000, query time of that 0.0016837450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1600.54 < 1611.76
  -> Decision False in time 0.0000000000, query time of that 0.0016321450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1354.89 < 1356.91
  -> Decision False in time 0.0100000000, query time of that 0.0016562780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1768.72 < 1799.87
  -> Decision False in time 0.0000000000, query time of that 0.0017202230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.6200000000008
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0345466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046983730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2683.59 < 2706.31
  -> Decision False in time 0.0300000000, query time of that 0.0275651410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2383.07 < 2619.19
  -> Decision False in time 0.0400000000, query time of that 0.0386939760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039478130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2798.89 < 2800.9
  -> Decision False in time 0.0100000000, query time of that 0.0045914120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1101.73 < 1143.43
  -> Decision False in time 0.0100000000, query time of that 0.0088396280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1088.19 < 1145.65
  -> Decision False in time 0.0100000000, query time of that 0.0048289950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1295.08 < 1349.5
  -> Decision False in time 0.0100000000, query time of that 0.0041379440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1474.17 < 1582.38
  -> Decision False in time 0.1200000000, query time of that 0.0087290960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 78.25
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0251816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0053240230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1883.18 < 2121.16
  -> Decision False in time 0.0400000000, query time of that 0.0342181150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1300.64 < 1310.07
  -> Decision False in time 0.1000000000, query time of that 0.0921633720, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1269.31 < 1297.39
  -> Decision False in time 0.0100000000, query time of that 0.0046691240, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1167.91 < 1190.98
  -> Decision False in time 0.0500000000, query time of that 0.0332836910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1222.01 < 1230.72
  -> Decision False in time 0.0800000000, query time of that 0.0590424600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052265310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1400.02 < 1423.93
  -> Decision False in time 0.0800000000, query time of that 0.0055010330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1360.41 < 1364.45
  -> Decision False in time 0.2500000000, query time of that 0.0184287410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 78.21999999999935
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1184083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0032057270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2311.44 < 2543.03
  -> Decision False in time 0.0100000000, query time of that 0.0055908380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1706.74 < 1709.68
  -> Decision False in time 0.0100000000, query time of that 0.0083055200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020686640, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
814.871 < 846.379
  -> Decision False in time 0.0000000000, query time of that 0.0026284450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
868.306 < 883.895
  -> Decision False in time 0.0100000000, query time of that 0.0024658070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1423.8 < 1455.27
  -> Decision False in time 0.0100000000, query time of that 0.0025429510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1536.33 < 1570.93
  -> Decision False in time 0.0100000000, query time of that 0.0025446690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1164.89 < 1197.38
  -> Decision False in time 0.0000000000, query time of that 0.0024087230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 293.10000000000036
Index size:  240412.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0323216460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2958078240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9500000000, query time of that 2.8936100850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0331531920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3182258870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.4400000000, query time of that 3.2219754890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0334050290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.4191160070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.7900000000, query time of that 4.7140080170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 302.1200000000026
Index size:  265932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127658650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1058663040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1300000000, query time of that 1.0746176150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0132639460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1252691000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.2733013800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0122721500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1310629380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8300000000, query time of that 1.2632321860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 79.04999999999927
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2704366667
  Testing...
|S| = 20
|T| = 283
Reject!
1442.75 < 1530.18
  -> Decision False in time 0.0000000000, query time of that 0.0019235250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1708.11 < 2407.17
  -> Decision False in time 0.0100000000, query time of that 0.0060706420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1928.86 < 1971.28
  -> Decision False in time 0.0100000000, query time of that 0.0024662060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2022.2 < 2347.74
  -> Decision False in time 0.0000000000, query time of that 0.0014809310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1243.98 < 2550.14
  -> Decision False in time 0.0100000000, query time of that 0.0014917990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2201.87 < 2222.3
  -> Decision False in time 0.0000000000, query time of that 0.0016264860, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1000.17 < 1062.27
  -> Decision False in time 0.0100000000, query time of that 0.0015572710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1157.74 < 1158.94
  -> Decision False in time 0.0000000000, query time of that 0.0015987000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2138.99 < 2498.42
  -> Decision False in time 0.0100000000, query time of that 0.0015765160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 129.36000000000058
Index size:  143888.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0111839620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0941738520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9178889640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0110705170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1097421850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2800000000, query time of that 1.0690032670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0116572150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1081929200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1465.12 < 1492.38
  -> Decision False in time 1.5200000000, query time of that 0.1895770420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 108.85000000000218
Index size:  182968.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0066539860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0526164750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5272215450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059273990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0609999660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1188.52 < 1209.23
  -> Decision False in time 0.3000000000, query time of that 0.2277283440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060128870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1482.27 < 1547.87
  -> Decision False in time 0.0600000000, query time of that 0.0066413790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1400.47 < 1405.8
  -> Decision False in time 1.2100000000, query time of that 0.0896020340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 300.4599999999991
Index size:  251952.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064884820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0520635490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.5161617440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0055587980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0616919310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1592.05 < 1874.47
  -> Decision False in time 0.0100000000, query time of that 0.0139339910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061040160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0618701670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1540.23 < 1557.62
  -> Decision False in time 0.0500000000, query time of that 0.0065900320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 301.3099999999977
Index size:  203108.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072892770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0660820440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6527230060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0068715300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0760085180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.7679062260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0072732030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0777549450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8900000000, query time of that 0.7505275170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 79.0
Index size:  183100.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4213150000
  Testing...
|S| = 20
|T| = 283
Reject!
1926.51 < 2695.51
  -> Decision False in time 0.0000000000, query time of that 0.0018870360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2745.2 < 3259.53
  -> Decision False in time 0.0100000000, query time of that 0.0017604810, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1857.73 < 1894.24
  -> Decision False in time 0.0000000000, query time of that 0.0014495370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1246.75 < 1273.41
  -> Decision False in time 0.0100000000, query time of that 0.0013033020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2570.89 < 2648.94
  -> Decision False in time 0.0000000000, query time of that 0.0012453080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1437.65 < 1869.66
  -> Decision False in time 0.0100000000, query time of that 0.0012459730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1288.37 < 2313.39
  -> Decision False in time 0.0100000000, query time of that 0.0014423100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2442.88 < 2516.21
  -> Decision False in time 0.0000000000, query time of that 0.0012436130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1825.63 < 2416.41
  -> Decision False in time 0.0100000000, query time of that 0.0012483080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 302.77000000000044
Index size:  200300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0298431240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2646813870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.6800000000, query time of that 2.6249428310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0293661230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.2983266300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.0600000000, query time of that 2.9708856320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0321056890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.4146778620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.5900000000, query time of that 4.2509287970, with c1=5.0000000000, c2=0.1000000000
