Benchmark

non-incremental/QF_LRA/tta_startup/simple_startup_15nodes.abstract.base.smt2

TTA Startup. Bruno Dutertre (bruno@csl.sri.com)
Benchmark
Size150730
Compressed Size19298
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 150722
Compressed Size19090
Max. Term Depth391
Asserts 1
Declared Functions0
Declared Constants182
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false15 ite148 not642 or3102
and4529 =1942 let104 /1
+141 -332 *16 <122
<=564 >17 >=36

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.92324
CVC3-SMT-COMP-2011 default unsat ✅ 3.67221
CVC3-SMT-COMP-2012 default unsat ✅ 3.66525
CVC4 CVC4-SMT-COMP-2010 default unsat ✅ 3.61069
CVC4-SMT-COMP-2011 default unsat ✅ 0.32809
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.31076
CVC4-SMT-EVAL-2013 default unsat ✅ 0.32103
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.09330
MathSAT5-SMT-COMP-2010 default unsat ✅ 0.11101
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.11526
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.10390
test_pmathsat-SMT-COMP-2010 default unsat ✅ 0.12702
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 0.56125
OpenSMT-SMT-COMP-2011 default unsat ✅ 0.47854
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 2.84778
SMTInterpol-SMT-COMP-2011 default unsat ✅ 3.25443
SMTInterpol-SMT-COMP-2012 default unsat ✅ 2.18907
veriT veriT-SMT-EVAL-2013 default unsat ✅ 0.13573
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.12420
Z3-SMT-COMP-2011 default unsat ✅ 0.19701
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 0.39198 0.38194
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.10043 0.09198
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 2.62949 6.82196
veriT veriT-smtcomp2014 default unsat ✅ 0.13292 0.11898
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.02777 0.01900
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12761 0.11998
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.40203 0.39894
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.40450 0.40194
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.08940 0.08798
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 2.43981 6.34204
SMT-RAT SMT-RAT-final default unsat ✅ 400.29900 400.42300
veriT veriT default unsat ✅ 0.11551 0.11398
Yices2 Yices default unsat ✅ 0.02158 0.02100
Z3 z3 4.4.0 default unsat ✅ 0.13312 0.13298
SMT-COMP 2016 0.11 (8/9) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.39541 0.39577
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.07610 0.07721
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 0.56669 0.56699
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 1.58023 5.07661
SMT-RAT SMT-RAT default unsat ✅ 1.25991 1.26057
Toysmt toysmt default unknown ❌ 2400.03000 2401.23000
veriT veriT-dev default unsat ✅ 0.06884 0.06898
Yices2 Yices-2.4.2 default unsat ✅ 0.02176 0.02175
Z3 z3-4.4.1 default unsat ✅ 0.14719 0.14845
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.42167 0.42127
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.06945 0.06958
OpenSMT opensmt2-2017-06-04 default unsat ✅ 1.05877 1.05897
SMTInterpol SMTInterpol default unsat ✅ 1.59749 5.28260
SMT-RAT SMTRAT-comp2017_2 default unsat ✅ 2.35911 2.35800
veriT veriT-2017-06-17 default unsat ✅ 0.06898 0.06818
Yices2 Yices2-Main default unsat ✅ 0.02237 0.02101
Z3 z3-4.5.0 default unsat ✅ 0.14565 0.14434
SMT-COMP 2018 Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default unsat ✅ 0.43691 0.43618
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.45966 0.45991
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08731 0.08837
OpenSMT opensmt2_default unsat ✅ 0.53726 0.53718
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 1.52838 4.56143
SMT-RAT SMTRAT-Rat-final_default unsat ✅ 2.58236 2.58219
SMTRAT-MCSAT-final_default unsat ✅ 2.58683 2.58629
veriT veriT_default unsat ✅ 0.06905 0.06920
Yices2 Yices 2.6.0_default unsat ✅ 0.02135 0.02130
Z3 z3-4.7.1_default unsat ✅ 0.11502 0.11493
SMT-COMP 2019 Ctrl-Ergo Ctrl-Ergo-2019-wrapped-sq_default unsat ✅ 0.40991 0.40644
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.46651 0.46690
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 20.24510 20.21290
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.46710 0.46748
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 0.28128 0.28123
Par4 Par4-wrapped-sq_default unsat ✅ 0.09227 0.00594
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 2.75908 8.04077
veriT veriT-wrapped-sq_default unsat ✅ 0.07593 0.07623
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02246 0.02248
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.11651 0.11650
SMT-COMP 2020 CVC4 CVC4-sq-final_default unsat ✅ 0.57714 0.57746
MathSAT MathSAT5_default.sh unsat ✅ 0.09019 0.09015
OpenSMT OpenSMT_default unsat ✅ 0.14462 0.14456
Par4 Par4-wrapped-sq_default unsat ✅ 0.08962 0.00649
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 2.52818 7.46704
veriT veriT_default unsat ✅ 0.07515 0.07536
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02080 0.02071
Z3 z3-4.8.8_default unsat ✅ 0.12586 0.12578
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 0.09052 0.09050
mc2 mc2 2021-06-07_default.sh unsat ✅ 1.18186 1.18184
Par4 Par4-wrapped-sq_default unsat ✅ 0.09367 0.00872
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 3.57582 11.21050
veriT veriT_default unsat ✅ 0.07371 0.07397
Z3 z3-4.8.11_default unsat ✅ 0.11831 0.11820
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.28635 1.28509
MathSAT MathSAT-5.6.8_default unsat ✅ 0.08574 0.08566
veriT veriT_default unsat ✅ 0.07314 0.07340
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02153 0.02150
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02173 0.02170
Z3 z3-4.8.17_default unsat ✅ 0.11138 0.11319
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.44691 0.44642
OpenSMT OpenSMT a78dcf01_default unsat ✅ 0.11602 0.11594
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 3.50322 10.89620
Yaga Yaga_SMT-COMP-2023_presubmition_default unsat ✅ 0.17178 0.17173
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02174 0.02171
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02143 0.02141
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02133 0.02128
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.48841 0.38854
OpenSMT OpenSMT unsat ✅ 0.30740 0.20775
SMTInterpol SMTInterpol unsat ✅ 3.68984 11.19545
Yices2 Yices2 unsat ✅ 0.22501 0.12510
Z3alpha Z3-alpha unsat ✅ 0.78011 0.68034
SMT-COMP 2025 cvc5 cvc5 unsat ✅ 0.52712 0.39720
OpenSMT OpenSMT unsat ✅ 0.30950 0.18882
SMTInterpol SMTInterpol unsat ✅ 2.57334 7.51567
Yices2 Yices2 unsat ✅ 0.26601 0.14123
Z3alpha Z3-alpha unsat ✅ 0.52148 0.76622
Z3 Z3-alpha-base unsat ✅ 0.32867 0.20800