Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.1175996.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size86102
Compressed Size14406
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 86094
Compressed Size14439
Max. Term Depth13
Asserts 507
Declared Functions213
Declared Constants194
Declared Sorts 199
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false27 ite31 not92
or26 and85 =>229 =1101
forall558 exists37 let121 Int196
div2 mod2 +15 -14
*11 <14 <=5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.04442 0.01800
CVC4 CVC4 f7118b2 default unsat ✅ 20.72910 20.72880
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.61000 2400.08000
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02298 0.02200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.34732 0.34495
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.34704 0.34395
Z3 z3 4.4.0 default unknown ❌ 1380.23000 1380.74000
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.45698 0.45770
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 5.52536 5.55244
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.46876 0.46759
Z3 z3-4.4.1 default unknown ❌ 0.09239 0.09368
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.39476 0.39456
Vampire vampire4.2-smt vampire unsat ✅ 3.15157 12.25000
Z3 z3-4.5.0 default unknown ❌ 600.06700 599.78000
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.38216 0.38237
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 187.44900 745.22000
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1199.98000
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 1.44348 5.40000
CVC4 CVC4-sq-final_default unsat ✅ 0.42109 0.42138
Par4 Par4-wrapped-sq_default unsat ✅ 0.40882 0.00761
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.38695 3.99888
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.91362 7.33000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 243.54500 966.59000
Z3 z3-4.8.8_default unknown ❌ 824.19000 824.06400
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 0.53971 0.44024
iProver iProver v3.9 unsat ✅ 808.77472 3192.98294
SMTInterpol SMTInterpol unknown ❌ 1201.71939 1312.06980