Benchmark

non-incremental/AUFNIRA/FFT/smtlib.810979.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size70838
Compressed Size9828
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 70830
Compressed Size9833
Max. Term Depth12
Asserts 391
Declared Functions60
Declared Constants92
Declared Sorts 61
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite5 not28 or6 and6
=>110 =477 forall402 let237
Int121 Real194 +226 -47
*45 <42 <=43

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 5.40982 5.40418
CVC4 CVC4 f7118b2 default unsat ✅ 62.53080 62.49250
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.63544 0.62690
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 5.33225 5.33419
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 70.69530 70.69230
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 70.67360 70.68230
Z3 z3 4.4.0 default unsat ✅ 0.62727 0.62790
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 64.14180 61.51540
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 19.07340 19.16310
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 2.27490 8.71000
Z3 z3-4.4.1 default unsat ✅ 0.67174 0.67326
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.30839 0.30718
Vampire vampire4.2-smt vampire unsat ✅ 4.21959 16.36000
Z3 z3-4.5.0 default unsat ✅ 0.65797 0.65306
SMT-COMP 2018 0.25 (3/4) Alt-Ergo Alt-Ergo-SMTComp-2018_default unsat ✅ 564.63700 2047.81000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.34081 0.34092
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.08000 4771.73000
Z3 z3-4.7.1_default unsat ✅ 0.60795 0.60779
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.10000 9533.04000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.34422 0.34456
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.34880 0.34908
Par4 Par4-wrapped-sq_default unsat ✅ 0.36185 0.00580
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.54116 3.35569
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.35486 3.27755
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 161.51400 640.20000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.61265 0.61264
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4757.56000
CVC4 CVC4-sq-final_default unsat ✅ 0.38896 0.38915
Par4 Par4-wrapped-sq_default unsat ✅ 0.37080 0.00882
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.31779 3.53607
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1041.09000 4094.32000
Z3 z3-4.8.8_default unsat ✅ 0.59344 0.59335
SMT-COMP 2021 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.39557 0.39594
cvc5 cvc5-fixed_default unsat ✅ 122.69500 120.84200
Par4 Par4-wrapped-sq_default unsat ✅ 0.37792 0.00617
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.78582 5.67689
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 296.38200 1157.81000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 335.23600 1294.40000
Z3 z3-4.8.11_default unsat ✅ 0.59276 1.16276
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 0.38946 0.38971
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 121.03900 120.71400
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.86708 4.74130
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 668.17700 2652.05000
Z3 z3-4.8.17_default unsat ✅ 0.61183 0.61362
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 123.81600 120.85800
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 122.31900 120.85800
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.15206 3.79848
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.00579 5.41280
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 485.56200 1929.49000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 120.52608 120.37333
iProver iProver v3.9 unsat ✅ 3.90656 12.86918
SMTInterpol SMTInterpol unknown ❌ 1202.72692 4167.94340