Benchmark

non-incremental/QF_BV/spear/cvs_v1.11.22/cvs_vc81760.smt2 

Benchmarks generated by the Calysto static checker.  Provided by Domagoj
Babic.  See http://www.cs.ubc.ca/~babic/index_benchmarks.htm.  Translated using
Spear Sf2Smt translator.
Benchmark
Size7052
Compressed Size1428
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 7044
Compressed Size1406
Max. Term Depth4
Asserts 65
Declared Functions0
Declared Constants69
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite10 =>1 =95 distinct3
extract11 bvand11 bvadd5 bvsub5
bvslt7 bvsle5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Spear Spear v1.9 (fh-1-2) unsat ✅ 34.50000 —
Spear v1.9 (sw-v) unsat ✅ 34.50000 —
Yices Yices 1.0.10 unsat ✅ 43.90000 —
Z3 Z3 0.1 unsat ✅ 23.60000 —
Z3 0.1 (fixed BV) unsat ✅ 24.10000 —
SMT-COMP 2010 0.33 (2/3) CVC3 CVC3 2.3 unknown ❌ 1200.00000 —
SONOLAR SONOLAR r252 unsat ✅ 90.50000 —
STP simplifyingSTP unsat ✅ 24.90000 —
SMT-COMP 2011 0.17 (5/6) Boolector Boolector 1.5.23-833 unsat ✅ 15.60000 —
CVC3 CVC3 v2.4 unknown ❌ 1200.00000 —
MathSAT MathSAT5 unsat ✅ 7.00000 —
SONOLAR SONOLAR unsat ✅ 17.30000 —
STP simplifyingSTP unsat ✅ 2.70000 —
STP2 unsat ✅ 9.60000 —
Z3 Z3 unsat ✅ 6.20000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.33276 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 3.49707 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 3.50328 —
abziz_portfolio_2012_minfeatures default unsat ✅ 3.41970 —
abziz_portfolio_2012_solvers default unsat ✅ 3.42388 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 3.43361 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 13.19540 —
Boolector-SMT-COMP-2011 default unsat ✅ 5.87361 —
Boolector-SMT-COMP-2012 default unsat ✅ 6.32817 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.87648 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.03579 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 2.67849 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 5.04780 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 6.40146 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 11.94300 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 7.22521 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 60.20990 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 13.12690 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 6.31517 —
STP STP2-SMT-COMP-2011 default unsat ✅ 3.33576 —
STP2-SMT-COMP-2012 default unsat ✅ 1.45966 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 2.45626 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 4.44571 —
Z3-SMT-COMP-2011 default unsat ✅ 3.38626 —
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 1.16251 1.14782
Abziz abziz_portfolio_all_features default unsat ✅ 6.23213 6.21805
abziz_portfolio_min_features default unsat ✅ 6.07864 6.06808
Boolector Boolector boolector unsat ✅ 31.92900 31.93410
CVC4 CVC4 f7118b2 default unsat ✅ 4.29311 8.57070
MathSAT MathSAT-5.2.12-Main default unsat ✅ 2.06425 2.05669
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.83719 0.82787
STP stp-cryptominisat4 default unsat ✅ 2.20230 4.25867
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 2.51008 2.50262
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 5.60247 5.59515
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 30.21130 30.21740
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.30508 4.60030
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.30456 4.60030
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.40336 1.40279
SMT-RAT SMT-RAT-final default unsat ✅ 35.75490 35.76860
STP stp-cryptominisat4 default unsat ✅ 3.21752 3.21751
stp-cmsat4-v15 default unsat ✅ 1.76017 1.75973
stp-cmsat4-mt-v15 default unknown ❌ 0.04969 0.04899
stp-minisat-v15 default unsat ✅ 4.94227 4.94325
Yices2 Yices default unsat ✅ 2.52174 2.52161
Z3 z3 4.4.0 default unsat ✅ 4.22243 4.22436
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 14.18590 14.19410
ABC_glucose glucose unsat ✅ 1.42503 1.42630
Boolector Boolector boolector unsat ✅ 13.03580 13.04310
Boolector preprop boolector unsat ✅ 13.06880 13.07620
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.65503 3.29467
MapleSTP MapleSTP default unsat ✅ 79.40440 79.45020
MapleSTP-mt default unsat ✅ 74.04920 293.98800
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.31767 1.31932
MinkeyRink Minkeyrink 2016 default unsat ✅ 6.57147 25.42900
Q3B Q3B default unsat ✅ 0.26107 0.26107
STP stp-cms-exp-2016 default unsat ✅ 2.28824 2.28960
stp-cms-mt-2016 default unsat ✅ 1.54956 6.04170
stp-cms-st-2016 default unsat ✅ 3.48374 3.48544
stp-minisat-st-2016 default unsat ✅ 47.18740 47.21390
Yices2 Yices-2.4.2 default unsat ✅ 2.64803 2.64945
Z3 z3-4.4.1 default unsat ✅ 5.67357 5.67805
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 6.46136 6.45857
Boolector SMT17 final boolector unsat ✅ 12.56280 12.56160
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.33931 10.68330
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.25506 1.25489
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 3.82458 3.86781
Q3B Q3B default unsat ✅ 17.61460 38.21420
STP stp_st default unsat ✅ 1.95325 1.95045
stp_mt default unsat ✅ 1.68784 6.57292
Yices2 Yices2-Main default unsat ✅ 2.62961 2.62855
Z3 z3-4.5.0 default unsat ✅ 5.90613 5.90556
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 8.78348 8.78316
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.36811 2.36838
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.13493 1.13584
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.42214 5.48232
Minkeyrink ST_st unsat ✅ 1.29296 1.29278
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.63936 1.63921
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 2.06092 8.06203
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.66637 1.66655
Yices2 Yices 2.6.0_default unsat ✅ 2.60203 2.60171
Z3 z3-4.7.1_default unsat ✅ 33.02020 33.02070
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 62.62840 62.62420
MathSAT mathsat-5.6.6_default unsat ✅ 3.34684 3.34568
STP STP 2021.0_default unsat ✅ 1.64081 6.40317
Z3 z3-4.8.11_default unsat ✅ 6.74270 6.74258
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53727 0.53721
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.82515 2.82571
STP STP 2022.4_default unsat ✅ 1.69402 3.30395
STP 2022.4_default unsat ✅ 1.69422 3.28429
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 11.05570 30.43960
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 3.75103 3.75059
Z3-Owl z3-Owl-Final_default unsat ✅ 7.79093 7.79005
z3-Owl-Final_default unsat ✅ 4.18374 8.26429
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 1.92887 1.82794
cvc5 cvc5 unsat ✅ 3.45341 3.35369
SMTInterpol SMTInterpol unsat ✅ 2.53194 7.27979
STP STP unsat ✅ 1.68019 1.58044
Yices2 Yices2 unsat ✅ 1.60402 1.50357
Z3alpha Z3-alpha unsat ✅ 4.59290 4.49318