Benchmark

non-incremental/UFNIA/sledgehammer/QEpres/z3.631896.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size22293
Compressed Size4016
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22285
Compressed Size4033
Max. Term Depth13
Asserts 143
Declared Functions39
Declared Constants35
Declared Sorts 35
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false10 ite12 not28
or10 and31 =>89 =249
forall142 exists8 let47 Int210
div2 mod3 +36 -33
*23 <52 <=34

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.02102 0.01300
CVC4 CVC4 f7118b2 default unknown ❌ 2400.01000 2400.00000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 2.21539 2.20866
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 0.01290 0.01200
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.55000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.58000
Z3 z3 4.4.0 default unsat ✅ 0.90627 0.90686
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.03000 2377.96000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.37804 0.37980
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.80859 3.08000
Z3 z3-4.4.1 default unsat ✅ 1.47687 1.47920
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03800 568.85000
Vampire vampire4.2-smt vampire unsat ✅ 0.30043 0.29744
Z3 z3-4.5.0 default unsat ✅ 1.03193 1.03149
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1206.25000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.96993 3.50000
Z3 z3-4.7.1_default unsat ✅ 0.98445 0.98428
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.10000 1183.41000
cvc5 cvc5-fixed_default unknown ❌ 1200.02000 60.07730
Par4 Par4-wrapped-sq_default unsat ✅ 1.03403 1.93000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.39397 0.60677
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.83465 4.69825
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.56190 2.03000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.78635 2.99000
Z3 z3-4.8.11_default unsat ✅ 1.06004 1.06002
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1187.36000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.01000 1192.75000
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 7.67394 28.26730
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 4.23364 9.50271
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 1.02970 3.87000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unknown ❌ 1201.71581 1200.78399
iProver iProver v3.9 unsat ✅ 53.45352 202.11579
SMTInterpol SMTInterpol unknown ❌ 1202.71869 1565.62002