Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.781306.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size83084
Compressed Size11216
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 83076
Compressed Size11223
Max. Term Depth13
Asserts 468
Declared Functions83
Declared Constants102
Declared Sorts 93
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false73 ite25 not146 or28
and150 =>430 =1233 forall536
exists110 let141

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.14027 0.13198
CVC4 CVC4 f7118b2 default unsat ✅ 0.18781 0.17697
veriT veriT-smtcomp2014 default unsat ✅ 0.06545 0.05699
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.06000
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.13188 0.13098
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.17175 0.16897
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.17123 0.16897
veriT veriT default unsat ✅ 0.08117 0.07999
Z3 z3 4.4.0 default unknown ❌ 2400.02000 2400.82000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.23964 0.24005
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.17145 2.18281
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.13480 4.16000
veriT veriT-dev default unsat ✅ 0.04822 0.04854
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.61000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.24411 0.24338
Vampire vampire4.2-smt vampire unsat ✅ 5.34553 20.91000
veriT veriT-2017-06-17 default unsat ✅ 0.05495 0.05468
Z3 z3-4.5.0 default unknown ❌ 600.02000 599.83000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.25868 0.25881
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 97.11930 386.04000
veriT veriT_default unsat ✅ 0.06288 0.06312
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1200.01000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.16550 0.16685
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26082 0.26106
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26449 0.26477
Par4 Par4-wrapped-sq_default unsat ✅ 0.07831 0.00967
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2843.61000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.39374 3.72041
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.10053 3.35398
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39465 3.73995
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 3.62648 13.83830
vampire-4.3-smt_vampire_smtcomp unsat ✅ 129.84000 515.77000
veriT veriT-wrapped-sq_default unsat ✅ 0.06537 0.06573
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 673.86200 673.77200
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.18434 0.18378
CVC4 CVC4-sq-final_default unsat ✅ 0.30396 0.30418
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26187 0.26221
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1385.90000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.38244 3.77057
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.18607 4.52000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 166.74600 659.14000
veriT veriT_default unsat ✅ 0.05955 0.05992
veriT+vite_default unsat ✅ 0.05783 0.05817
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.66000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.30750 0.30771
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 4.80910 17.80390
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 4220.02000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.13760 5.17174
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 18.96180 75.00000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.05425 3.86000
veriT veriT_default unsat ✅ 0.05233 0.05275
Z3 z3-4.8.11_default unknown ❌ 1200.10000 1199.96000
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.30677 0.30712
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.29059 0.29117
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.95731 5.01808
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 15.69800 62.01000
veriT veriT_default unsat ✅ 0.05253 0.05288
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1199.89000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.82000
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.34828 0.24847
iProver iProver v3.9 unsat ✅ 2.33301 6.69435
SMTInterpol SMTInterpol unsat ✅ 13.66159 30.44567
Yices2 Yices2 unknown ❌ 1201.48434 1201.34647