Benchmark

non-incremental/UF/sledgehammer/FFT/uf.670593.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size63357
Compressed Size7940
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 63349
Compressed Size7945
Max. Term Depth11
Asserts 462
Declared Functions40
Declared Constants39
Declared Sorts 35
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false10 ite10 not57
or27 and40 =>439 =1130
forall451 exists4 let121

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.25427 0.24596
CVC4 CVC4 f7118b2 default unsat ✅ 0.24671 0.23196
veriT veriT-smtcomp2014 default unsat ✅ 0.07309 0.06399
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.37177 0.36394
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.23751 0.23696
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.20585 0.20297
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.20200 0.19897
veriT veriT default unsat ✅ 0.11023 0.10898
Z3 z3 4.4.0 default unsat ✅ 0.78884 0.78888
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.24328 0.24365
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.44145 0.44330
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.95101 3.52000
veriT veriT-dev default unsat ✅ 0.04712 0.04759
Z3 z3-4.4.1 default unsat ✅ 0.35733 0.35874
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.24647 0.24617
Vampire vampire4.2-smt vampire unsat ✅ 6.41489 25.01000
veriT veriT-2017-06-17 default unsat ✅ 0.08879 0.08838
Z3 z3-4.5.0 default unsat ✅ 0.36891 0.36792
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26833 0.26853
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 709.42000 2820.43000
veriT veriT_default unsat ✅ 0.08576 0.08603
Z3 z3-4.7.1_default unsat ✅ 0.11470 0.11463
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 23.02100 91.15000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26464 0.26503
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27396 0.27426
Par4 Par4-wrapped-sq_default unsat ✅ 0.09868 0.00583
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.09000 2405.50000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.31018 3.47251
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.06177 3.33637
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.35137 3.38564
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 75.53380 299.66000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 709.53800 2818.79000
veriT veriT-wrapped-sq_default unsat ✅ 0.09240 0.09278
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.11893 0.11893
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 13.39940 52.85000
CVC4 CVC4-sq-final_default unsat ✅ 0.29798 0.29832
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26239 0.26274
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1244.27000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.35176 3.47177
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 101.02700 401.04000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 705.42000 2798.58000
veriT veriT_default unsat ✅ 0.05353 0.05387
veriT+vite_default unsat ✅ 0.07050 0.07082
Z3 z3-4.8.8_default unsat ✅ 0.12248 0.12241
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.29722 0.29749
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.09000 4751.28000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.12000 4241.27000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.93509 4.81025
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 24.16520 95.67000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 103.70800 411.30000
veriT veriT_default unsat ✅ 0.04783 0.04819
Z3 z3-4.8.11_default unsat ✅ 0.28593 0.28575
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.29983 0.30013
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.26768 0.26814
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 4.00755 4.61435
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 22.36070 88.45000
veriT veriT_default unsat ✅ 0.04802 0.04840
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 33.56750 33.56390
Z3 z3-4.8.17_default unsat ✅ 0.59293 0.59475
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.25427 0.25481
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.26673 0.26659
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 34.19090 131.78400
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.07000 4312.65000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.95406 4.70714
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 19.57120 77.28000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.92971 0.92961