copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 154.32
Index size:  406036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4513583333
  Testing...
|S| = 20
|T| = 283
Reject!
2088.28 < 2224.64
  -> Decision False in time 0.0100000000, query time of that 0.0024871500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2006.01 < 2072.73
  -> Decision False in time 0.0100000000, query time of that 0.0027463450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1969.62 < 2015.69
  -> Decision False in time 0.0000000000, query time of that 0.0033204950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1361.24 < 1368.47
  -> Decision False in time 0.0100000000, query time of that 0.0013262820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1442.45 < 1494.1
  -> Decision False in time 0.0000000000, query time of that 0.0014217570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1508.29 < 1526.63
  -> Decision False in time 0.0100000000, query time of that 0.0014341570, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1646.83 < 1727.58
  -> Decision False in time 0.0100000000, query time of that 0.0014771620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1959.43 < 2270.76
  -> Decision False in time 0.0000000000, query time of that 0.0013587290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1464.42 < 1466.11
  -> Decision False in time 0.0100000000, query time of that 0.0013288610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 116.79000000000002
Index size:  206684.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0023500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064489840, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1741.5 < 1751.42
  -> Decision False in time 0.0500000000, query time of that 0.0463295770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6100000000, query time of that 0.5628134150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0063501940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0677992050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1281.38 < 1385.09
  -> Decision False in time 0.4400000000, query time of that 0.3320657420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0064449150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1443.94 < 1493.03
  -> Decision False in time 0.1300000000, query time of that 0.0133353740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1672.61 < 1684.06
  -> Decision False in time 0.4800000000, query time of that 0.0408068850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 410.4800000000001
Index size:  264972.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0173005760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1497651410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5300000000, query time of that 1.4743610880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0175283010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1733081920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7900000000, query time of that 1.6812494640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0195850490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1756820460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1600000000, query time of that 1.8686044870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 413.0
Index size:  214188.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0341579840, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2951231860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.8000000000, query time of that 2.7517937360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0298218830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3200000000, query time of that 0.2944394910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1800000000, query time of that 2.9958125380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0338057860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.4062766760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4400000000, query time of that 4.1407029480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 118.32000000000016
Index size:  193048.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0086800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040930440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0323210690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1903.29 < 2052.45
  -> Decision False in time 0.0200000000, query time of that 0.0110991450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036045900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0386607150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1959.31 < 1980.55
  -> Decision False in time 0.0500000000, query time of that 0.0299879170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0039073600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1358.27 < 1362.44
  -> Decision False in time 0.0700000000, query time of that 0.0042688900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1546.65 < 1563.63
  -> Decision False in time 0.0200000000, query time of that 0.0042710500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 118.01999999999998
Index size:  186020.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092270160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0810876430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.8007690510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0093931540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0927267880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1090.9 < 1119.73
  -> Decision False in time 0.1500000000, query time of that 0.1502924910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0096421750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0907832900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1726.54 < 1736.11
  -> Decision False in time 0.5900000000, query time of that 0.0713243680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 409.7099999999996
Index size:  262068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0070361430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0607782850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6500000000, query time of that 0.5979236810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065209050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0689962990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.6745274860, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0070224780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0691045370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1448.32 < 1461.57
  -> Decision False in time 0.9900000000, query time of that 0.0827898550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 81.23000000000002
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5984466667
  Testing...
|S| = 20
|T| = 283
Reject!
2290.02 < 2376.7
  -> Decision False in time 0.0000000000, query time of that 0.0019477710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1377.35 < 1480.03
  -> Decision False in time 0.0000000000, query time of that 0.0013376670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2099.55 < 2131.77
  -> Decision False in time 0.0100000000, query time of that 0.0012845410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1470.08 < 1554.68
  -> Decision False in time 0.0000000000, query time of that 0.0012751330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2121.73 < 2130.62
  -> Decision False in time 0.0000000000, query time of that 0.0010994500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2352.93 < 2486.21
  -> Decision False in time 0.0000000000, query time of that 0.0011920740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1536.17 < 1655.15
  -> Decision False in time 0.0000000000, query time of that 0.0011772440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2359.17 < 2436.6
  -> Decision False in time 0.0100000000, query time of that 0.0011823490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1984 < 2006.87
  -> Decision False in time 0.0000000000, query time of that 0.0011224160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 154.70000000000027
Index size:  137904.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0144516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0037879950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0280948160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1591.43 < 1593.15
  -> Decision False in time 0.2300000000, query time of that 0.2066756540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030526910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
530.848 < 579.958
  -> Decision False in time 0.0300000000, query time of that 0.0132465820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1204.63 < 1210.96
  -> Decision False in time 0.0300000000, query time of that 0.0150874300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1301.31 < 1306.76
  -> Decision False in time 0.0200000000, query time of that 0.0032879580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1493.75 < 1517.35
  -> Decision False in time 0.0100000000, query time of that 0.0035847710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1623.66 < 1814.07
  -> Decision False in time 0.0400000000, query time of that 0.0033726010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 80.71000000000004
Index size:  177544.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8163050000
  Testing...
|S| = 20
|T| = 283
Reject!
1692.96 < 1784.8
  -> Decision False in time 0.0000000000, query time of that 0.0017650450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1454.76 < 1679.87
  -> Decision False in time 0.0000000000, query time of that 0.0009649020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1656.76 < 1831.04
  -> Decision False in time 0.0100000000, query time of that 0.0008669730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2085.66 < 2242.02
  -> Decision False in time 0.0000000000, query time of that 0.0010783080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2820.71 < 2874.44
  -> Decision False in time 0.0000000000, query time of that 0.0008910580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1991.84 < 2276.58
  -> Decision False in time 0.0000000000, query time of that 0.0009368670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1950.18 < 1980.9
  -> Decision False in time 0.0000000000, query time of that 0.0009812450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2118.64 < 2286.29
  -> Decision False in time 0.0000000000, query time of that 0.0008895030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1897.94 < 1916.99
  -> Decision False in time 0.0100000000, query time of that 0.0009098870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 80.94000000000005
Index size:  186788.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0965316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033638580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1918.26 < 2034.55
  -> Decision False in time 0.0000000000, query time of that 0.0043120340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2169.68 < 2197.26
  -> Decision False in time 0.0100000000, query time of that 0.0067285760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1425.86 < 1468.38
  -> Decision False in time 0.0000000000, query time of that 0.0026302870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1795.23 < 1951.73
  -> Decision False in time 0.0100000000, query time of that 0.0027051650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1715.96 < 1752.03
  -> Decision False in time 0.0000000000, query time of that 0.0026672890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2263.28 < 2264.93
  -> Decision False in time 0.0000000000, query time of that 0.0027704940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1113.58 < 1120.58
  -> Decision False in time 0.0100000000, query time of that 0.0029353150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2104.49 < 2163.61
  -> Decision False in time 0.0100000000, query time of that 0.0031569710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 409.5400000000004
Index size:  261600.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083974740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0768254910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7718584060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0091749480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0902117320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.8873920500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0094451200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0859613490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7300000000, query time of that 0.8566538810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 389.21000000000004
Index size:  199596.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0822016667
  Testing...
|S| = 20
|T| = 283
Reject!
941.372 < 1026.98
  -> Decision False in time 0.0100000000, query time of that 0.0027982890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1353.59 < 1406.99
  -> Decision False in time 0.0100000000, query time of that 0.0087187400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1488.06 < 1494.98
  -> Decision False in time 0.1000000000, query time of that 0.0825576600, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0022668860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1083.4 < 1122.48
  -> Decision False in time 0.0100000000, query time of that 0.0025580780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1343.74 < 1372.38
  -> Decision False in time 0.0100000000, query time of that 0.0046998680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1078.13 < 1124.35
  -> Decision False in time 0.0100000000, query time of that 0.0025068890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1215.03 < 1296.83
  -> Decision False in time 0.0100000000, query time of that 0.0024177020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1162.32 < 1263.76
  -> Decision False in time 0.0000000000, query time of that 0.0025945170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 386.7699999999995
Index size:  250368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0081594930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0677475380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6553771120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0070237480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0760825310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.7500867700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0080851250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1285.9 < 1289.22
  -> Decision False in time 0.2600000000, query time of that 0.0264482740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1815.5 < 1818.8
  -> Decision False in time 3.6800000000, query time of that 0.3293056000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 81.10999999999967
Index size:  196472.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0233383333
  Testing...
|S| = 20
|T| = 283
Reject!
2082.67 < 2233.38
  -> Decision False in time 0.0100000000, query time of that 0.0056427320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1632.81 < 1704.91
  -> Decision False in time 0.0200000000, query time of that 0.0182007400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1928.14 < 1997.01
  -> Decision False in time 0.0200000000, query time of that 0.0195811210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051975120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2197.18 < 2318.23
  -> Decision False in time 0.0100000000, query time of that 0.0056344240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1533.51 < 1674.16
  -> Decision False in time 0.0300000000, query time of that 0.0211882030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1035.08 < 1252.44
  -> Decision False in time 0.0200000000, query time of that 0.0054103620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1560.95 < 1580.74
  -> Decision False in time 0.0100000000, query time of that 0.0056624690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2399.43 < 2399.96
  -> Decision False in time 0.0100000000, query time of that 0.0055486970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 388.9499999999998
Index size:  241404.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052829620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0453503640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4800000000, query time of that 0.4365468050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0050862250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1649.88 < 1651.02
  -> Decision False in time 0.0700000000, query time of that 0.0492959220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1475.8 < 1514.7
  -> Decision False in time 0.3200000000, query time of that 0.2112876610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0053287930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1612.17 < 1622.34
  -> Decision False in time 0.4600000000, query time of that 0.0317577670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1649.68 < 1651.76
  -> Decision False in time 0.1500000000, query time of that 0.0101857700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 409.09999999999945
Index size:  258124.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0263768010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2378116540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.4000000000, query time of that 2.3362029930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0244142740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2631751850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7500000000, query time of that 2.6222020240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0271176750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.3396020080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7100000000, query time of that 3.3368277200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 154.9900000000007
Index size:  193400.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0272816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034466220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0235283620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1440.75 < 1458.84
  -> Decision False in time 0.0000000000, query time of that 0.0031885750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0027108560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1203.92 < 1209.97
  -> Decision False in time 0.0200000000, query time of that 0.0053609050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1352.48 < 1355.8
  -> Decision False in time 0.1200000000, query time of that 0.0446178020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1413.06 < 1419.6
  -> Decision False in time 0.0000000000, query time of that 0.0028956370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1396.36 < 1431.01
  -> Decision False in time 0.1000000000, query time of that 0.0058716570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1296.31 < 1306.58
  -> Decision False in time 0.0200000000, query time of that 0.0029608660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 389.59999999999945
Index size:  232768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0020300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0045642480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0359084970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1680.91 < 1706.66
  -> Decision False in time 0.1000000000, query time of that 0.0835670760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038618790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0417752710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1567 < 1592.12
  -> Decision False in time 0.1700000000, query time of that 0.0910409580, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0040656070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1811.91 < 1819.94
  -> Decision False in time 0.2900000000, query time of that 0.0172836600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1137.47 < 1157.45
  -> Decision False in time 1.4700000000, query time of that 0.0770917160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 80.57999999999993
Index size:  196104.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063976440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0540723820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2240.82 < 2311.74
  -> Decision False in time 0.1800000000, query time of that 0.1733298470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062408500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2309.91 < 2379.05
  -> Decision False in time 0.0100000000, query time of that 0.0141780360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1663.9 < 1674.73
  -> Decision False in time 0.0400000000, query time of that 0.0290096220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0064773800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1471.57 < 1471.88
  -> Decision False in time 0.0200000000, query time of that 0.0068469090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1319.53 < 1323.08
  -> Decision False in time 0.2200000000, query time of that 0.0194508770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 80.78999999999996
Index size:  174328.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3780666667
  Testing...
|S| = 20
|T| = 283
Reject!
2053.58 < 2164.28
  -> Decision False in time 0.0000000000, query time of that 0.0024183710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1127.89 < 1144.58
  -> Decision False in time 0.0000000000, query time of that 0.0015635750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1504.37 < 1611.64
  -> Decision False in time 0.0100000000, query time of that 0.0018870810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1926.62 < 2046.46
  -> Decision False in time 0.0000000000, query time of that 0.0014219220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1563.73 < 1704.55
  -> Decision False in time 0.0000000000, query time of that 0.0014387800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1918.14 < 2024.76
  -> Decision False in time 0.0000000000, query time of that 0.0014268710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1300.52 < 1374.75
  -> Decision False in time 0.0000000000, query time of that 0.0014739090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2393.98 < 2489.08
  -> Decision False in time 0.0100000000, query time of that 0.0014235400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2286.83 < 2353.07
  -> Decision False in time 0.0000000000, query time of that 0.0015086090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 387.47999999999956
Index size:  253312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0114398740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0957714960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.9019917860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0098971920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1063913850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2200000000, query time of that 1.0429385730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0108420070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1058653930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8200000000, query time of that 1.0214452860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 155.1900000000005
Index size:  206488.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0088518910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0703337410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.7028558880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0081684250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0801998180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
350.03 < 370.385
  -> Decision False in time 0.0400000000, query time of that 0.0367519610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0084772760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1372.32 < 1407.46
  -> Decision False in time 0.5100000000, query time of that 0.0525988260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1596.29 < 1633.37
  -> Decision False in time 0.4400000000, query time of that 0.0450038460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 410.8000000000002
Index size:  252112.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0465495400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4659382660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.5500000000, query time of that 4.4847397440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0462782030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5200000000, query time of that 0.4933121230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.9300000000, query time of that 4.8168560160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0526909260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.5567275450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4600000000, query time of that 5.3871848620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 411.22999999999956
Index size:  211016.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0166018570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1577786780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7100000000, query time of that 1.6660599330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0186900960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1807116120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0300000000, query time of that 1.9136996520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0185520010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.2139791560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6500000000, query time of that 2.1484304180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 412.1800000000003
Index size:  222364.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0214679230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.2066658190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1000000000, query time of that 2.0509784370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0227659330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2390882890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5300000000, query time of that 2.3941352730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0241896260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.3074548860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9400000000, query time of that 2.9760365510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 119.43000000000029
Index size:  194752.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0036750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056245420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0471121270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4464751420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0051079670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0512877010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2110.13 < 2139.86
  -> Decision False in time 0.3000000000, query time of that 0.1986913460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049435790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2219.44 < 2259
  -> Decision False in time 0.2600000000, query time of that 0.0187156750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2139.34 < 2192.45
  -> Decision False in time 0.2800000000, query time of that 0.0209264870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 156.26000000000022
Index size:  190224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0050140280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0420607330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1745.81 < 1777.23
  -> Decision False in time 0.2200000000, query time of that 0.1964741430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047461790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0485944570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1538.79 < 1581.79
  -> Decision False in time 0.6900000000, query time of that 0.4186115060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0048714070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1740.27 < 1924.58
  -> Decision False in time 0.1900000000, query time of that 0.0147017460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1663.62 < 1684.31
  -> Decision False in time 0.2000000000, query time of that 0.0144205700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 412.3700000000008
Index size:  259792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0203562780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1948822590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9100000000, query time of that 1.8501643900, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0192568560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2106633010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2900000000, query time of that 2.1642863470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0228593830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.2258454480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 2.6379828970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 119.14999999999964
Index size:  189948.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0098438690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0974322880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9704406300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0113301580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1149930350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3100000000, query time of that 1.1213689250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0114536930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1145389250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1189.85 < 1204.86
  -> Decision False in time 1.4700000000, query time of that 0.2132215370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 408.89000000000124
Index size:  248344.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0381521830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3900000000, query time of that 0.3752759140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.7200000000, query time of that 3.6742151700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0379220180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.3893137560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.1400000000, query time of that 3.9635311320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0410758730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.5528954370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.4500000000, query time of that 5.5852809700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 389.85000000000036
Index size:  203164.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0146916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0036795480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0280472580, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1748.21 < 1785.22
  -> Decision False in time 0.0200000000, query time of that 0.0185524250, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0030371560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1355.31 < 1365.74
  -> Decision False in time 0.0300000000, query time of that 0.0129353760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1158.43 < 1187.53
  -> Decision False in time 0.0200000000, query time of that 0.0092946690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0032224260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1286.18 < 1308.24
  -> Decision False in time 0.1100000000, query time of that 0.0067954770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1294.66 < 1333.65
  -> Decision False in time 0.0200000000, query time of that 0.0034618060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 118.92000000000007
Index size:  199068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2833283333
  Testing...
|S| = 20
|T| = 283
Reject!
1226.59 < 1264.32
  -> Decision False in time 0.0100000000, query time of that 0.0023538580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1853.18 < 1874
  -> Decision False in time 0.0000000000, query time of that 0.0027260830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1804 < 1968.94
  -> Decision False in time 0.0000000000, query time of that 0.0017978680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1988.48 < 2022.16
  -> Decision False in time 0.0000000000, query time of that 0.0014165080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1771.93 < 1790.31
  -> Decision False in time 0.0100000000, query time of that 0.0015211880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1122.5 < 1248.8
  -> Decision False in time 0.0000000000, query time of that 0.0014682370, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1724.93 < 1740.15
  -> Decision False in time 0.0000000000, query time of that 0.0014814590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1226.81 < 1471.47
  -> Decision False in time 0.0100000000, query time of that 0.0016866760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1962.58 < 1964.04
  -> Decision False in time 0.0000000000, query time of that 0.0015504870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 81.59000000000015
Index size:  183368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0475750000
  Testing...
|S| = 20
|T| = 283
Reject!
1697.9 < 1819.67
  -> Decision False in time 0.0100000000, query time of that 0.0042842400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1533.41 < 1577.59
  -> Decision False in time 0.0100000000, query time of that 0.0141484320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1568.04 < 1597.75
  -> Decision False in time 0.0200000000, query time of that 0.0174609740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037892330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1789.11 < 1953.34
  -> Decision False in time 0.0100000000, query time of that 0.0036853580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1959.46 < 1981.44
  -> Decision False in time 0.0300000000, query time of that 0.0193285540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1999.53 < 2071.06
  -> Decision False in time 0.0100000000, query time of that 0.0039685890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1541.47 < 1620.09
  -> Decision False in time 0.0300000000, query time of that 0.0038516740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1992.13 < 1997.82
  -> Decision False in time 0.0100000000, query time of that 0.0041364050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 118.39999999999964
Index size:  189276.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5595800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0021137540, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1894.93 < 1902.14
  -> Decision False in time 0.0000000000, query time of that 0.0019836110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1873.28 < 1875.34
  -> Decision False in time 0.0100000000, query time of that 0.0014394890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
963.418 < 973.842
  -> Decision False in time 0.0000000000, query time of that 0.0013758920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1188.08 < 1321.01
  -> Decision False in time 0.0100000000, query time of that 0.0013449040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2044.01 < 2048.52
  -> Decision False in time 0.0000000000, query time of that 0.0013318880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1848.27 < 1916.28
  -> Decision False in time 0.0100000000, query time of that 0.0012907270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2022.76 < 2049.34
  -> Decision False in time 0.0000000000, query time of that 0.0012020440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2263.81 < 2311.18
  -> Decision False in time 0.0100000000, query time of that 0.0013114660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 410.5599999999995
Index size:  261612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0186363070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1628851070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6500000000, query time of that 1.6040293620, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0175527800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1907186830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9600000000, query time of that 1.8357071080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0226410420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1974838260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2300000000, query time of that 2.1374699840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 410.39999999999964
Index size:  211600.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0108469280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0917026450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.9291428140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112995790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1083342920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.0721529340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0114443860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1093175110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 1.0323454300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 388.77000000000044
Index size:  217992.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0103856920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0801428320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7843017070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0085709400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0893335560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.9021191870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0096570070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0868535590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1516.65 < 1520.86
  -> Decision False in time 5.8400000000, query time of that 0.6103601780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 154.98000000000138
Index size:  206200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2097583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028637400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1927.57 < 1928.13
  -> Decision False in time 0.0100000000, query time of that 0.0060078940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
590.125 < 767.355
  -> Decision False in time 0.0000000000, query time of that 0.0041499870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1507.9 < 1663.72
  -> Decision False in time 0.0000000000, query time of that 0.0015605740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1444.57 < 1517.51
  -> Decision False in time 0.0100000000, query time of that 0.0017651480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1899.25 < 1903
  -> Decision False in time 0.0000000000, query time of that 0.0017807680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1605.05 < 1606.95
  -> Decision False in time 0.0000000000, query time of that 0.0017358340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2083.51 < 2150.72
  -> Decision False in time 0.0100000000, query time of that 0.0018336890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1939.96 < 1958.31
  -> Decision False in time 0.0000000000, query time of that 0.0018355610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 411.7600000000002
Index size:  257312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0130298470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1204248490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2500000000, query time of that 1.2033329960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0147133900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1422620810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5600000000, query time of that 1.3943086060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0145473320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.1512647560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 1.4393793180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 155.27000000000044
Index size:  191224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0025083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056003060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0460765540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5300000000, query time of that 0.4834285020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0053933830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1162.02 < 1179.41
  -> Decision False in time 0.0200000000, query time of that 0.0165936030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1816.41 < 1831.64
  -> Decision False in time 0.6900000000, query time of that 0.4691533630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1621.39 < 1626.66
  -> Decision False in time 0.0600000000, query time of that 0.0056950570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0565384200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1572.1 < 1599.27
  -> Decision False in time 0.1100000000, query time of that 0.0122113120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 118.55000000000109
Index size:  158816.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076796590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0666853430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6585405440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0078469650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0750159130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.7509337220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0077638180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1990.36 < 2062.52
  -> Decision False in time 0.0200000000, query time of that 0.0074820450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1677.87 < 1697.92
  -> Decision False in time 0.3600000000, query time of that 0.0346058980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 408.1100000000006
Index size:  259572.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0131084710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1080156270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1200000000, query time of that 1.0687204930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127839600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1242901930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.2336609750, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0121619130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1234167940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2152.01 < 2182.18
  -> Decision False in time 5.4200000000, query time of that 0.7945298270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 389.27999999999884
Index size:  199384.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0068635210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0511667100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.5068754820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0058488680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1602.49 < 1606.41
  -> Decision False in time 0.0400000000, query time of that 0.0295713610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.5849553150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0062785780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0607047950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1389.73 < 1444.81
  -> Decision False in time 3.1100000000, query time of that 0.2187313190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 118.29000000000087
Index size:  200508.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0518900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0028934130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1908.03 < 2046.71
  -> Decision False in time 0.0000000000, query time of that 0.0056866730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1823.49 < 1844.67
  -> Decision False in time 0.0200000000, query time of that 0.0130109800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020732890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1655.99 < 1663
  -> Decision False in time 0.0000000000, query time of that 0.0024088710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1797.03 < 1896.15
  -> Decision False in time 0.0000000000, query time of that 0.0022127290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1434.45 < 1517.22
  -> Decision False in time 0.0200000000, query time of that 0.0022435000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2235.59 < 2268.91
  -> Decision False in time 0.0000000000, query time of that 0.0026088990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1241.93 < 1242.03
  -> Decision False in time 0.0100000000, query time of that 0.0022509010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 154.9300000000003
Index size:  193692.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0018750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0069985940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0577885120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2120.05 < 2138.49
  -> Decision False in time 0.2600000000, query time of that 0.2448285850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061327290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0647872890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1734.46 < 1739.36
  -> Decision False in time 0.1900000000, query time of that 0.1632862810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0065687000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1038.31 < 1047.38
  -> Decision False in time 0.5100000000, query time of that 0.0425861960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
941.111 < 1003.87
  -> Decision False in time 0.6000000000, query time of that 0.0510720680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 81.81000000000131
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1624733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032823280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1825.87 < 1836.57
  -> Decision False in time 0.0000000000, query time of that 0.0042653440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1310.02 < 1523.54
  -> Decision False in time 0.0100000000, query time of that 0.0024998960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1445.57 < 1704.33
  -> Decision False in time 0.0000000000, query time of that 0.0021114470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1864.72 < 1922.05
  -> Decision False in time 0.0000000000, query time of that 0.0023107700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1520.3 < 1666.04
  -> Decision False in time 0.0000000000, query time of that 0.0023112340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1492.45 < 1628.78
  -> Decision False in time 0.0100000000, query time of that 0.0021586030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1468.44 < 1659.81
  -> Decision False in time 0.0000000000, query time of that 0.0022218840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1739.9 < 1754.14
  -> Decision False in time 0.0100000000, query time of that 0.0024432910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 117.72999999999956
Index size:  188552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0194533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0035642270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1459.73 < 1605.28
  -> Decision False in time 0.0100000000, query time of that 0.0093360500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1558.12 < 1702.62
  -> Decision False in time 0.1300000000, query time of that 0.1076491970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1816.55 < 1866.99
  -> Decision False in time 0.0000000000, query time of that 0.0029087620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
996.551 < 1001.26
  -> Decision False in time 0.0400000000, query time of that 0.0161477550, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1732.73 < 1844.2
  -> Decision False in time 0.0100000000, query time of that 0.0069518950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1004.3 < 1009.33
  -> Decision False in time 0.0100000000, query time of that 0.0033137570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2218.3 < 2246.68
  -> Decision False in time 0.0100000000, query time of that 0.0033996430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1697.96 < 1699.21
  -> Decision False in time 0.0200000000, query time of that 0.0031873780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 411.4300000000003
Index size:  257296.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0155033740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1345574140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.3258945970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0140541730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1542625480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7900000000, query time of that 1.5579701610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0168638350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1596326070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9500000000, query time of that 1.6435200170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 388.7900000000009
Index size:  206668.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0249637770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2221432790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3700000000, query time of that 2.3277819190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0297774300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2807868650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.8500000000, query time of that 2.6578253950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0354572490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.3279456920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.2100000000, query time of that 3.5280893690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 153.91999999999825
Index size:  205132.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0087780940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0764387110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7733209290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0093237540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0939179290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1321.01 < 1332.94
  -> Decision False in time 0.6000000000, query time of that 0.5720092690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0090460490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0913030840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1876.88 < 1884.8
  -> Decision False in time 0.3300000000, query time of that 0.0411654020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 154.5799999999981
Index size:  186936.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0102428100, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1037521210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0800000000, query time of that 1.0330651820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117970100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1217941110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4600000000, query time of that 1.2027169110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0125228420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1225384590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
941.294 < 1253.42
  -> Decision False in time 1.3100000000, query time of that 0.1918446430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 117.77000000000044
Index size:  185556.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1217850000
  Testing...
|S| = 20
|T| = 283
Reject!
2211.31 < 2298.29
  -> Decision False in time 0.0000000000, query time of that 0.0026073600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1529.55 < 1673.05
  -> Decision False in time 0.0100000000, query time of that 0.0029900870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1545.52 < 1569.25
  -> Decision False in time 0.0000000000, query time of that 0.0033985240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1423.96 < 1463.67
  -> Decision False in time 0.0100000000, query time of that 0.0018543270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1867.2 < 1881.23
  -> Decision False in time 0.0000000000, query time of that 0.0018022930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1513.88 < 1536.05
  -> Decision False in time 0.0000000000, query time of that 0.0018989340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1512.59 < 1554.04
  -> Decision False in time 0.0300000000, query time of that 0.0018907800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1825.73 < 1840.49
  -> Decision False in time 0.0000000000, query time of that 0.0022837580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1826.31 < 1830.8
  -> Decision False in time 0.0200000000, query time of that 0.0020189380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 154.3199999999997
Index size:  190736.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0760416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030657920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1612.28 < 1621.76
  -> Decision False in time 0.0100000000, query time of that 0.0150315630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2408.95 < 2441.68
  -> Decision False in time 0.0100000000, query time of that 0.0029411910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0022114860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1590.01 < 1633.17
  -> Decision False in time 0.0100000000, query time of that 0.0060953930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1676.35 < 1677.25
  -> Decision False in time 0.0300000000, query time of that 0.0102630940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1380.91 < 1422.03
  -> Decision False in time 0.0400000000, query time of that 0.0022925270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1752.56 < 1868.17
  -> Decision False in time 0.0000000000, query time of that 0.0025037250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1372.07 < 1374.27
  -> Decision False in time 0.0200000000, query time of that 0.0022285610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 389.1800000000003
Index size:  248048.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0121100320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1138717530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1600000000, query time of that 1.1186506070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0113143790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1253133840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5000000000, query time of that 1.2702607310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0124803670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1234375580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0400000000, query time of that 1.2982431830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 387.40000000000146
Index size:  237760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0130905060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1211320900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2500000000, query time of that 1.2076403560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0129804510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1401645520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5700000000, query time of that 1.4189471430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0139551620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1477544300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8000000000, query time of that 1.4489796870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 389.869999999999
Index size:  255904.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0154701310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1507114600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6200000000, query time of that 1.5653056420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0190413750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.1843275700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9900000000, query time of that 1.8382100770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0201874920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.2148024360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4900000000, query time of that 2.0704229620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 387.1600000000035
Index size:  243968.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0388197110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3566050540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.6200000000, query time of that 3.5685847290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0385932790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.3962564990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.2600000000, query time of that 4.1104256950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0441909010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.5560806720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.3600000000, query time of that 5.8326708560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 82.2300000000032
Index size:  194432.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2726016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0022823500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2093.72 < 2173.3
  -> Decision False in time 0.0200000000, query time of that 0.0057014110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1525.45 < 1970.78
  -> Decision False in time 0.0100000000, query time of that 0.0031592700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1568.16 < 2190.41
  -> Decision False in time 0.0000000000, query time of that 0.0012573600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2455.13 < 2588.02
  -> Decision False in time 0.0100000000, query time of that 0.0012166710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1169.2 < 1231.94
  -> Decision False in time 0.0000000000, query time of that 0.0013292080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1475.87 < 1509.61
  -> Decision False in time 0.0200000000, query time of that 0.0019314700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1953.96 < 2212.16
  -> Decision False in time 0.0100000000, query time of that 0.0020479280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1361.77 < 1362.28
  -> Decision False in time 0.0100000000, query time of that 0.0013545360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 155.45000000000073
Index size:  170616.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0088350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0042434720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0331195010, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1698.7 < 1725.81
  -> Decision False in time 0.0100000000, query time of that 0.0089351100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1470.13 < 1674.98
  -> Decision False in time 0.0100000000, query time of that 0.0036685770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0384228560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1908.55 < 1922.34
  -> Decision False in time 0.1300000000, query time of that 0.0642860810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0038602130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1452.9 < 1477.33
  -> Decision False in time 0.0900000000, query time of that 0.0062688600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1320.44 < 1329.07
  -> Decision False in time 0.2600000000, query time of that 0.0140476960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 81.56000000000131
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0273666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047236730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2196.6 < 2224.92
  -> Decision False in time 0.0200000000, query time of that 0.0215854700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1786.68 < 1936.02
  -> Decision False in time 0.0100000000, query time of that 0.0098864960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044872470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1515 < 1526.71
  -> Decision False in time 0.0100000000, query time of that 0.0047897320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1422.15 < 1544.59
  -> Decision False in time 0.0100000000, query time of that 0.0044968740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1243.66 < 1248.01
  -> Decision False in time 0.0100000000, query time of that 0.0045919130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1613.33 < 1882.97
  -> Decision False in time 0.0000000000, query time of that 0.0051717970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1471.91 < 1480.97
  -> Decision False in time 0.0500000000, query time of that 0.0046083960, with c1=5.0000000000, c2=0.1000000000
