Benchmark

non-incremental/QF_LIA/CAV_2009_benchmarks/smt/40-vars/problem__021.smt2

Alberto Griggio
Benchmark
Size13534
Compressed Size3474
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryrandom
First Occurrence2010-07-15
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 13526
Compressed Size3480
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants40
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

and1 let1 +40 -51
*120 <=40

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (4/6) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 1173.50000
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 32.12510
CVC4-SMT-EVAL-2013 default sat ✅ 5.99437
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 1.71960
MathSAT5-SMT-COMP-2010 default sat ✅ 0.87654
MathSAT5-SMT-COMP-2011 default sat ✅ 2.99247
MathSAT5-SMT-COMP-2012 default sat ✅ 2.98987
test_pmathsat-SMT-COMP-2010 default sat ✅ 1.72568
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default sat ✅ 990.11400
SMTInterpol-SMT-COMP-2011 default unknown ❌
SMTInterpol-SMT-COMP-2012 default sat ✅ 559.08400
veriT veriT-SMT-EVAL-2013 default unknown ❌ 0.04605
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ 0.94593
Z3-SMT-COMP-2011 default sat ✅ 5.77315
SMT-COMP 2014 0.17 (5/6) CVC4 CVC4 f7118b2 default sat ✅ 0.03690 0.02399
MathSAT MathSAT-5.2.12-Main default sat ✅ 1.34391 1.33580
SMTInterpol smtinterpol-2.1-118-g3dada2f default sat ✅ 1.26554 3.08753
veriT veriT-smtcomp2014 default unknown ❌ 0.89833 0.89686
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 2.77047 2.76258
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.47261 0.46393
SMT-COMP 2015 0.14 (6/7) CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.02822 0.02600
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.02819 0.02600
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.05443 0.05399
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 1.38719 3.35449
SMT-RAT SMT-RAT-final default sat ✅ 0.37750 0.37694
veriT veriT default unknown ❌ 0.57216 0.57091
Yices2 Yices default sat ✅ 0.04574 0.04499
Z3 z3 4.4.0 default sat ✅ 0.53262 0.53292
SMT-COMP 2016 0.25 (6/8) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.02948 0.02960
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.10430 0.10535
ProB ProB competition unknown ❌ 0.98617 0.98710
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 0.67107 1.80545
SMT-RAT SMT-RAT default sat ✅ 0.03002 0.02999
veriT veriT-dev default unknown ❌ 0.31513 0.31576
Yices2 Yices-2.4.2 default sat ✅ 0.06792 0.06789
Z3 z3-4.4.1 default sat ✅ 0.27132 0.27280
SMT-COMP 2017 0.14 (6/7) CVC4 CVC4-smtcomp2017-main default sat ✅ 0.03188 0.02978
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.06429 0.06438
SMTInterpol SMTInterpol default sat ✅ 0.81454 2.15376
SMT-RAT SMTRAT-comp2017_2 default sat ✅ 0.16026 0.15948
veriT veriT-2017-06-17 default unknown ❌ 0.31433 0.31410
Yices2 Yices2-Main default sat ✅ 0.05395 0.05241
Z3 z3-4.5.0 default sat ✅ 0.37961 0.37907
SMT-COMP 2018 0.12 (7/8) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default sat ✅ 0.04697 0.04719
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.03155 0.03165
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.14643 0.14740
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 0.64063 1.60978
SMT-RAT SMTRAT-Rat-final_default sat ✅ 0.08720 0.08712
veriT veriT_default unknown ❌ 0.31650 0.31665
Yices2 Yices 2.6.0_default sat ✅ 0.04017 0.04013
Z3 z3-4.7.1_default sat ✅ 0.19771 0.19769
SMT-COMP 2019 0.25 (6/8) Ctrl-Ergo Ctrl-Ergo-2019-wrapped-sq_default sat ✅ 0.05060 0.05074
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.03612 0.03639
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 0.16224 0.16416
Par4 Par4-wrapped-sq_default sat ✅ 0.03403 0.00586
ProB ProB-wrapped-sq_default unknown ❌ 2400.03000 2399.74000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 0.61897 1.52746
veriT veriT-wrapped-sq_default unknown ❌ 0.33027 0.33046
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.02261 0.02263
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.27731 0.27734
SMT-COMP 2020 0.14 (6/7) CVC4 CVC4-sq-final_default sat ✅ 0.04134 0.04163
MathSAT MathSAT5_default.sh sat ✅ 0.05256 0.05252
Par4 Par4-wrapped-sq_default sat ✅ 0.03485 0.00631
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 0.44486 0.92317
veriT veriT_default unknown ❌ 0.33366 0.33387
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.02041 0.02035
Z3 z3-4.8.8_default sat ✅ 0.14112 0.14114
SMT-COMP 2021 0.14 (6/7) cvc5 cvc5-fixed_default sat ✅ 0.04004 0.04062
MathSAT mathsat-5.6.6_default sat ✅ 0.13516 0.13514
OpenSMT OpenSMT-fixed_default sat ✅ 332.25100 332.18400
Par4 Par4-wrapped-sq_default sat ✅ 0.03740 0.00626
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 1010.97000 1035.05000
veriT veriT_default unknown ❌ 0.95012 0.95035
Z3 z3-4.8.11_default sat ✅ 0.05125 0.05134
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.03720 0.03767
OpenSMT OpenSMT a78dcf01_default sat ✅ 267.21400 267.20100
Par4 Par4-wrapped-sq_default sat ✅ 0.04014 0.00625
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 94.21280 112.40100
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.02594 0.02586
Z3++ Z3++_sq_0526_default sat ✅ 0.71819 0.71825