Solver Isomap for AUFDTLIA
In this diagram two solvers are close if they are similar with respect to their
solving times at the competitions. See below for a detailed explanation.
The trail connects the annual versions of a solver.
- Fetch all the competition results for the given logic.
- If requested (it is),
remove the solvers that have less than 100
benchmarks in common with 50% of the other solvers.
- Compute the distance between each solver pair.
It is the cosine distance between the wall-clock time of the common benchmarks.
More precisely, when if two solvers have n benchmarks in common,
we use an n-dimensional space.
The coordinate of each solver is the wall-clock time for each benchmarks regardless of the result.
The cosine distance is then the angle between the two solvers at the origin.
- Compute a standard Isomap from the cosine distances.