Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.1053697.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size67576
Compressed Size11812
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 67568
Compressed Size11817
Max. Term Depth13
Asserts 384
Declared Functions215
Declared Constants175
Declared Sorts 191
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false20 ite24 not91
or8 and55 =>179 =791
forall434 exists23 let78 Int158
div2 mod2 +9 -5
*5 <11 <=5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.03581 0.02799
CVC4 CVC4 f7118b2 default unsat ✅ 20.66990 20.66890
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.17885 0.17097
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 0.04911 0.04899
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.42318 0.42094
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.43254 0.42993
Z3 z3 4.4.0 default unsat ✅ 0.19538 0.19397
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.35404 0.35477
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.81989 1.82795
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.34102 0.34100
Z3 z3-4.4.1 default unknown ❌ 0.07796 0.07918
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.30107 0.30065
Vampire vampire4.2-smt vampire unsat ✅ 0.11127 0.10848
Z3 z3-4.5.0 default unsat ✅ 0.21174 0.21128
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.33132 0.33153
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.08679 4.17000
Z3 z3-4.7.1_default unsat ✅ 0.24478 0.24474
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.55443 0.55434
CVC4 CVC4-sq-final_default unsat ✅ 0.34072 0.34105
Par4 Par4-wrapped-sq_default unsat ✅ 0.21843 0.01169
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.53054 3.87725
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.54198 1.96000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.39144 0.44087
Z3 z3-4.8.8_default unsat ✅ 0.18904 0.18899