Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.1139496.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size92451
Compressed Size15962
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 92443
Compressed Size15973
Max. Term Depth13
Asserts 517
Declared Functions278
Declared Constants236
Declared Sorts 262
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false30 ite35 not95
or14 and60 =>245 =1028
forall579 exists38 let112 Int213
div2 mod2 +18 -17
*11 <13 <=3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.04172 0.03299
CVC4 CVC4 f7118b2 default unsat ✅ 0.63632 0.62590
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 928.95500 929.17900
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.05992 0.05899
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.22318 0.21997
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.22529 0.22296
Z3 z3 4.4.0 default unknown ❌ 284.03400 284.04400
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.25257 0.25297
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 4.07329 4.09047
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 6.54240 25.80000
Z3 z3-4.4.1 default unknown ❌ 0.09122 0.09247
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26450 0.25586
Vampire vampire4.2-smt vampire unsat ✅ 109.23800 434.28000
Z3 z3-4.5.0 default unknown ❌ 346.51600 346.42300
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27994 0.28014
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 104.54500 415.40000
Z3 z3-4.7.1_default unknown ❌ 583.14800 583.07600
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.50075 0.49983
CVC4 CVC4-sq-final_default unsat ✅ 0.33059 0.33087
Par4 Par4-wrapped-sq_default unsat ✅ 0.30920 0.00869
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.70461 3.94934
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 2.79541 10.82000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 91.56350 362.74000
Z3 z3-4.8.8_default unknown ❌ 202.97400 202.95500
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.32704 0.32732
cvc5 cvc5-fixed_default unsat ✅ 0.28367 0.28428
Par4 Par4-wrapped-sq_default unsat ✅ 0.30989 0.00612
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.55976 1.16800
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.42139 10.88840
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 7.09255 27.40000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 3.17066 12.22000
Z3 z3-4.8.11_default unknown ❌ 186.91800 186.88800
SMT-COMP 2022 0.40 (3/5) CVC4 CVC4-sq-final_default unsat ✅ 0.32968 0.32993
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.35930 0.35985
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.06769 5.18842
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 3.96066 15.46000
Z3 z3-4.8.17_default unknown ❌ 204.54400 204.53900
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.41903 0.30150
iProver iProver v3.9.3 unknown ❌ 1201.79098 4770.89688
SMTInterpol SMTInterpol unknown ❌ 976.54900 3704.28985
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.06996 4.53113