Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.678990.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size2282
Compressed Size700
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2274
Compressed Size691
Max. Term Depth6
Asserts 15
Declared Functions11
Declared Constants15
Declared Sorts 9
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false2 not2 and3
=31 forall10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01512 0.00600
CVC4 CVC4 f7118b2 default sat ✅ 0.04873 0.03599
veriT veriT-smtcomp2014 default unknown ❌ 0.01333 0.00300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.03039 0.02000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00806 0.00600
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.03119 0.02700
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.03126 0.02700
veriT veriT default unknown ❌ 0.00824 0.00200
Z3 z3 4.4.0 default sat ✅ 0.04269 0.04299
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.17162 0.17312
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.69930 9.74863
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.04447 0.04388
veriT veriT-dev default unknown ❌ 0.06070 0.06725
Z3 z3-4.4.1 default sat ✅ 0.04312 0.04435
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 0.24585 0.24728
Vampire vampire4.2-smt vampire sat ✅ 0.04226 0.03941
veriT veriT-2017-06-17 default unknown ❌ 0.09840 0.11144
Z3 z3-4.5.0 default sat ✅ 0.05048 0.04950
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.26104 0.26236
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.10505 0.06504
veriT veriT_default unknown ❌ 0.09077 0.09830
Z3 z3-4.7.1_default sat ✅ 0.05336 0.05331
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 0.05070 0.14458
CVC4 CVC4-sq-final_default sat ✅ 0.31727 0.31969
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.30338 0.30552
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 0.49221 0.92687
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.78375 3.37377
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.07245 0.08293
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.24815 0.24924
veriT veriT_default unknown ❌ 1200.08000 1199.96000
veriT+vite_default unknown ❌ 1200.04000 1199.96000
Z3 z3-4.8.8_default sat ✅ 0.05527 0.05522
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default sat ✅ 0.34545 0.33596
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.79365 0.50200
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 0.51472 0.92606
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.86402 4.67731
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.05638 0.05592
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.04998 0.04759
veriT veriT_default unknown ❌ 0.09947 0.10399
Z3 z3-4.8.11_default sat ✅ 0.03560 0.03556