Benchmark

non-incremental/UFNIA/sledgehammer/FFT/z3.601420.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6443
Compressed Size1264
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 6435
Compressed Size1262
Max. Term Depth9
Asserts 42
Declared Functions6
Declared Constants10
Declared Sorts 7
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite3 not4 or3 and2
=>37 =61 forall43 let21
Int8 +8 -6 *43
<29 <=19

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unsat ✅ 0.03410 0.02300
CVC4 CVC4 f7118b2 default unsat ✅ 26.97330 26.96990
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.05000
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unsat ✅ 0.02317 0.02300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07421 0.07099
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07577 0.07299
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.56000
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.08000 0.08016
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 353.62600 355.73300
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 9.38267 36.99000
Z3 z3-4.4.1 default unknown ❌ 2400.09000 2401.29000
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.04765 0.04736
Vampire vampire4.2-smt vampire unsat ✅ 3.62679 14.29000
Z3 z3-4.5.0 default unknown ❌ 600.01600 599.78000
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.04856 0.04876
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 53.22990 211.35600
Z3 z3-4.7.1_default unknown ❌ 1099.63000 741.16800
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 526.93600 2085.66000
CVC4 CVC4-sq-final_default unsat ✅ 0.05767 0.05797
Par4 Par4-wrapped-sq_default unsat ✅ 0.05696 0.00577
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.26924 3.46654
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.88792 3.21000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.06446 3.95000
Z3 z3-4.8.8_default unknown ❌ 483.53300 483.39100
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.05924 0.05955
cvc5 cvc5-fixed_default unsat ✅ 0.07247 0.07301
Par4 Par4-wrapped-sq_default unsat ✅ 0.06265 0.00647
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.28978 0.36591
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.05515 5.35655
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.63126 2.38000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.23994 0.18674
Z3 z3-4.8.11_default unknown ❌ 1200.10000 1199.95000
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.07103 0.07157
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.11421 0.11481
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.12000 4745.16000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.74624 4.70979
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 10.67930 40.77000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.29297 0.19344
iProver iProver v3.9 unknown ❌ 1201.72702 4756.12516
SMTInterpol SMTInterpol unknown ❌ 1201.74331 1297.20307