Benchmark

non-incremental/QF_LRA/tta_startup/simple_startup_14nodes.abstract.induct.smt2

TTA Startup. Bruno Dutertre (bruno@csl.sri.com)
Benchmark
Size214783
Compressed Size28715
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 214775
Compressed Size28538
Max. Term Depth429
Asserts 1
Declared Functions0
Declared Constants186
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false14 ite192 not1063 or4970
and5824 =2591 let128 /1
+207 -575 *30 <170
<=951 >1 >=34

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2006 0.86 (1/7) CVC CVC unknown ❌ 894.30000
CVC3 CVC3 unknown ❌ 255.00000
ExtSAT ExtSAT 1.1 unknown ❌ 0.50000
HTP HTP timeout ✅ 1207.60000
MathSAT MathSAT 3.4 timeout ✅ 1207.70000
Simplics Simplics (2005 winner) timeout ✅ 1207.60000
Yices Yices 1.0 unsat ✅ 364.10000
SMT-COMP 2007 0.33 (4/6) Argo-Lib ArgoLib v3.5 unknown ❌ 1801.00000
Barcelogic Barcelogic 1.2 unsat ✅ 833.80000
CVC3 CVC3 1.2 unknown ❌ 1.10000
CVC3 1.2 (patched) unknown ❌ 1800.90000
MathSAT MathSAT 4.0 unsat ✅ 1176.90000
Yices Yices 1.0 unsat ✅ 378.00000
Yices 1.0.10 unsat ✅ 377.80000
Z3 Z3 0.1 unsat ✅ 524.00000
SMT-COMP 2008 0.33 (4/6) Barcelogic Barcelogic 1.3 unsat ✅ 1018.20000
CVC3 CVC3-1.5 unknown ❌ 8.60000
MathSAT MathSAT-4.2 unsat ✅ 577.20000
Yices2 Yices2 (proto c) unknown ❌ 1200.70000
Yices Yices 1.0.10 unsat ✅ 359.90000
Z3 Z3.2 unsat ✅ 310.40000
SMT-COMP 2009 0.75 (1/4) CVC3 CVC3 2.0 unknown ❌ 900.00000
MathSAT MathSAT 4.3 unsat ✅ 383.90000
OpenSMT OpenSMT 0.2 unknown ❌ 900.00000
Yices2 Yices 2 proto unknown ❌ 900.00000
Yices2 (proto c) unknown ❌ 900.00000
SMT-COMP 2012 0.67 (1/3) CVC3 CVC3 v2.4.2 unknown ❌
CVC4 1.0rc.3931 unknown ❌ 1200.00000
SMTInterpol SMTInterpol unknown ❌ 1200.20000
Z3 Z3 unsat ✅ 357.40000
SMT-COMP 2011 0.57 (3/7) CVC3 CVC3 v2.4 unknown ❌ 1200.00000
CVC4 CVC4 1.0rc.2026 unknown ❌ 1200.00000
MathSAT MathSAT 5 unsat ✅ 398.70000
MathSAT5 unsat ✅ 430.50000
OpenSMT opensmt unknown ❌ 1200.00000
SMTInterpol SMTInterpol 2.0pre unknown ❌ 1201.20000
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 355.20000
Z3 Z3 unsat ✅ 507.60000
SMT Evaluation 2013 0.57 (3/7) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2010 default unknown ❌
CVC4-SMT-COMP-2011 default unsat ✅ 1024.55000
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 725.27400
CVC4-SMT-EVAL-2013 default unsat ✅ 134.64100
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 159.74500
MathSAT5-SMT-COMP-2010 default unsat ✅ 239.18700
MathSAT5-SMT-COMP-2011 default unsat ✅ 192.90100
MathSAT5-SMT-COMP-2012 default unsat ✅ 186.23400
test_pmathsat-SMT-COMP-2010 default unsat ✅ 275.25100
OpenSMT OpenSMT-SMT-COMP-2010 default unknown ❌
OpenSMT-SMT-COMP-2011 default unknown ❌
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unknown ❌
SMTInterpol-SMT-COMP-2011 default unknown ❌
SMTInterpol-SMT-COMP-2012 default unknown ❌
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 144.98800
Z3-SMT-COMP-2011 default unsat ✅ 154.05500
SMT-COMP 2014 0.17 (5/6) CVC4 CVC4 f7118b2 default unsat ✅ 196.92900 196.92700
MathSAT MathSAT-5.2.12-Main default unsat ✅ 201.41400 201.45800
SMTInterpol smtinterpol-2.1-118-g3dada2f default unknown ❌ 2310.42000 2400.07000
veriT veriT-smtcomp2014 default unsat ✅ 631.20700 631.37400
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 567.49800 567.70600
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 173.07500 173.12700
SMT-COMP 2015 0.29 (5/7) CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 391.85900 391.84300
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 393.06900 393.15100
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 194.75100 194.80000
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unknown ❌ 2400.02000 2415.89000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.18000
veriT veriT default unsat ✅ 280.20000 280.30900
Yices2 Yices default unsat ✅ 598.04000 598.26700
Z3 z3 4.4.0 default unsat ✅ 161.08900 161.15500
SMT-COMP 2016 0.33 (6/9) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 362.90300 361.95400
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 201.78600 201.86100
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 2051.15000 2052.26000
SMTInterpol smtinterpol-2.1-258-g92ab3df default unknown ❌ 2400.12000 2483.70000
SMT-RAT SMT-RAT default unknown ❌ 2400.04000 2401.35000
Toysmt toysmt default unknown ❌ 2400.02000 2401.29000
veriT veriT-dev default unsat ✅ 263.42800 263.56700
Yices2 Yices-2.4.2 default unsat ✅ 600.17400 600.57300
Z3 z3-4.4.1 default unsat ✅ 135.71000 135.75400
SMT-COMP 2017 0.38 (5/8) CVC4 CVC4-smtcomp2017-main default unsat ✅ 376.33600 375.36300
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 138.99900 138.96300
OpenSMT opensmt2-2017-06-04 default unknown ❌ 600.01700 599.96500
SMTInterpol SMTInterpol default unknown ❌ 600.12700 628.10000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.07100 599.99100
veriT veriT-2017-06-17 default unsat ✅ 347.26500 347.23500
Yices2 Yices2-Main default unsat ✅ 428.18800 428.16000
Z3 z3-4.5.0 default unsat ✅ 148.63200 148.58600
SMT-COMP 2018 0.33 (6/9) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default unknown ❌ 1200.05000 4774.09000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 166.89400 166.89500
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 183.72500 183.70900
OpenSMT opensmt2_default unsat ✅ 810.08900 810.03300
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unknown ❌ 1200.11000 1246.92000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.04000 1200.04000
SMTRAT-MCSAT-final_default unknown ❌ 1200.11000 1199.98000
veriT veriT_default unsat ✅ 405.17800 405.11600
Yices2 Yices 2.6.0_default unsat ✅ 518.20000 518.16800
Z3 z3-4.7.1_default unsat ✅ 265.38300 265.35900
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 388.94500 386.71300
MathSAT MathSAT-5.6.8_default unsat ✅ 199.42600 199.38700
veriT veriT_default unsat ✅ 236.32600 236.30300
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 468.38300 468.27000
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 438.36600 438.31300
Z3 z3-4.8.17_default unsat ✅ 375.30300 375.23000
SMT-COMP 2024 0.20 (4/5) cvc5 cvc5 unsat ✅ 410.27755 410.14939
OpenSMT OpenSMT unsat ✅ 104.03273 103.92780
SMTInterpol SMTInterpol unknown ❌ 1202.25457 1463.05294
Yices2 Yices2 unsat ✅ 525.02077 524.71409
Z3alpha Z3-alpha unsat ✅ 284.95162 284.84430