Benchmark

non-incremental/UF/sledgehammer/QEpres/smtlib.1255501.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size3032
Compressed Size719
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 3024
Compressed Size713
Max. Term Depth7
Asserts 33
Declared Functions5
Declared Constants14
Declared Sorts 6
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false1 not22 and2
=>5 =52 forall27

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 727.26200 727.21600
CVC4 CVC4 f7118b2 default sat ✅ 40.11380 40.11390
veriT veriT-smtcomp2014 default unknown ❌ 73.49050 73.49380
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.51000 2400.08000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 433.49600 433.67500
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.15540 20.15490
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.15520 20.15690
veriT veriT default unknown ❌ 1458.06000 1458.68000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.66000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 300.44300 300.59000
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.72942 9.77548
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.06404 0.06402
veriT veriT-dev default unknown ❌ 2400.03000 2401.53000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.32000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 450.54500 450.51800
Vampire vampire4.2-smt vampire sat ✅ 0.04434 0.04289
veriT veriT-2017-06-17 default unknown ❌ 600.05300 599.93000
Z3 z3-4.5.0 default unknown ❌ 600.05300 600.00000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 483.45500 480.84900
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.18096 0.08797
veriT veriT_default unknown ❌ 1200.02000 1199.97000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.84000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 1866.39000 7414.88000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 963.67500 960.97600
master-2018-06-10-b19c840-competition-default_default sat ✅ 482.78200 480.86000
Par4 Par4-wrapped-sq_default sat ✅ 484.17800 1448.69000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2406.63000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.22300 6.64506
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.20081 3.34360
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.29994 3.23090
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.11476 0.07240
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.17363 0.09077
veriT veriT-wrapped-sq_default unknown ❌ 2400.04000 2399.53000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.77000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 498.34700 482.54600
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.77054 1.75000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.02000 1233.39000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.77688 4.60742
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.05672 0.05524
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.07303 0.07155
veriT veriT_default unknown ❌ 1200.03000 1199.95000
Z3 z3-4.8.11_default unknown ❌ 1200.07000 1199.88000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 498.46500 482.49900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 530.45000 512.53700
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.79969 4.57732
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.05770 0.05433
veriT veriT_default unknown ❌ 1200.11000 1199.94000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.04000 1199.88000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.80000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 526.52800 512.48000
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 512.15800 510.78300
iProver iProver-3.8-fix_iprover_SMT sat ✅ 339.92000 1336.83000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1235.49000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.74286 4.69746
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.05497 0.05460
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.93000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.46425 540.23286
iProver iProver v3.9 sat ✅ 0.92309 2.10105
SMTInterpol SMTInterpol unknown ❌ 1201.71308 1233.09971
Yices2 Yices2 unknown ❌ 1201.23534 1200.71655