Benchmark

non-incremental/QF_BV/spear/cvs_v1.11.22/cvs_vc105128.smt2 

Benchmarks generated by the Calysto static checker.  Provided by Domagoj
Babic.  See http://www.cs.ubc.ca/~babic/index_benchmarks.htm.  Translated using
Spear Sf2Smt translator.
Benchmark
Size101856
Compressed Size14349
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 101848
Compressed Size14352
Max. Term Depth4
Asserts 939
Declared Functions0
Declared Constants990
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite229 =>3 =1491 distinct14
extract314 bvand160 bvxor1 bvadd27
bvmul9 bvsub2 bvsdiv1 bvsrem7
bvslt77 bvsle79 sign_extend13

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.33 (2/3) CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SONOLAR SONOLAR r252 sat ✅ 4.20000 —
STP simplifyingSTP sat ✅ 2.20000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.82253 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 2.43436 —
abziz_portfolio_2011_solvers_2 default sat ✅ 2.47245 —
abziz_portfolio_2012_minfeatures default sat ✅ 2.45433 —
abziz_portfolio_2012_solvers default sat ✅ 2.43773 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 2.42978 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.29313 —
Boolector-SMT-COMP-2011 default sat ✅ 10.11860 —
Boolector-SMT-COMP-2012 default sat ✅ 0.10164 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 4.74511 —
CVC4-SMT-EVAL-2013 default sat ✅ 3.38740 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 3.27641 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 10.16080 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.63217 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.64010 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.92185 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.89482 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.38315 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.96567 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.43957 —
STP2-SMT-COMP-2012 default sat ✅ 0.68472 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 28.67310 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 4.01919 —
Z3-SMT-COMP-2011 default sat ✅ 2.41578 —
SMT-COMP 2014 4Simp 4Simp - 2014 default sat ✅ 0.66194 0.65290
Abziz abziz_portfolio_all_features default sat ✅ 4.71388 4.68129
abziz_portfolio_min_features default sat ✅ 4.69061 4.67529
Boolector Boolector boolector sat ✅ 3.11056 3.11053
CVC4 CVC4 f7118b2 default sat ✅ 5.34316 10.61640
MathSAT MathSAT-5.2.12-Main default sat ✅ 2.29173 2.29165
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.97230 0.95585
STP stp-cryptominisat4 default sat ✅ 0.42843 0.41994
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.16963 0.16098
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 2.99814 2.98754
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.05038 0.05029
Boolector SMT17 final boolector sat ✅ 0.05079 0.04992
CVC4 CVC4-smtcomp2017-main default sat ✅ 4.90644 9.75626
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 2.57405 2.57362
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.73369 0.73423
Q3B Q3B default sat ✅ 8.94859 26.46000
STP stp_st default sat ✅ 0.81475 0.81254
stp_mt default sat ✅ 0.86906 2.07920
Yices2 Yices2-Main default sat ✅ 0.15075 0.15014
Z3 z3-4.5.0 default sat ✅ 3.74296 3.74283
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.04114 0.04110
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 8.67758 8.67709
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 2.52789 2.52871
MinkeyRink Minkeyrink MT_mt sat ✅ 0.41648 0.56789
Minkeyrink ST_st sat ✅ 0.38995 0.39012
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.41127 0.41133
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.44108 0.60022
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.75624 1.75631
Yices2 Yices 2.6.0_default sat ✅ 0.11857 0.11849
Z3 z3-4.7.1_default sat ✅ 3.69841 3.69835
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.05171 0.05175
Poolector-wrapped-sq_default sat ✅ 0.17593 0.20355
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 5.00392 5.00392
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 3.09279 3.09314
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.44410 0.68832
MinkeyRink ST-wrapped-sq_default sat ✅ 0.37483 0.37488
Par4 Par4-wrapped-sq_default sat ✅ 0.04383 0.00593
STP STP-2019-wrapped-sq_default sat ✅ 0.42796 0.42827
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.61718 0.60751
stp-minisat-wrapped-sq_default sat ✅ 0.52927 0.52950
stp-mt-wrapped-sq_default sat ✅ 0.45404 0.56770
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.65809 0.91636
stp-riss-wrapped-sq_default unknown ❌ 0.41415 0.41434
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.14187 0.14183
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.31211 0.31209
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 5.48671 5.48634
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.16253 0.16250
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.52516 0.52302
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.29173 2.29177
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.17747 0.17735
Boolector Boolector-wrapped-sq_default sat ✅ 0.05127 0.05128
Poolector-wrapped-sq_default sat ✅ 0.18083 0.20807
CVC4 CVC4-sq-final_default sat ✅ 3.21794 3.21833
LazyBV2Int LazyBV2Int20200523_default.sh sat ✅ 432.78500 432.69600
MathSAT MathSAT5_default.sh sat ✅ 0.72541 0.72531
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.34249 0.34271
MinkeyRink Solver 2020.3_default sat ✅ 0.48072 0.89748
STP STP_default sat ✅ 0.37872 0.47378
STP ++ Mergsat v1_default sat ✅ 0.33248 0.33418
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.99856 0.99842
Z3 z3-4.8.8_default sat ✅ 2.88796 2.88758
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.18082 0.17937
MathSAT mathsat-5.6.6_default sat ✅ 0.66065 0.66062
STP STP 2021.0_default sat ✅ 0.38441 0.48089
Z3 z3-4.8.11_default sat ✅ 2.21395 2.21372
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.18132 0.18129
Bitwuzla-wrapped_default sat ✅ 0.18172 0.18164
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.20447 4.20463
MathSAT MathSAT-5.6.8_default sat ✅ 0.83445 0.83438
STP STP 2022.4_default sat ✅ 0.37838 0.37837
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.27764 1.27731
Z3++BV z3++bv_0702_default sat ✅ 0.40508 0.40466
Z3 z3-4.8.17_default sat ✅ 2.35377 2.35524
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.66805 0.66793
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 8.77806 8.77703
STP STP 2022.4_default sat ✅ 0.37852 0.37848
STP 2022.4_default sat ✅ 0.37752 0.37751
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1232.22000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.13313 0.13304
Z3-Owl z3-Owl-Final_default sat ✅ 6.70089 6.70114
z3-Owl-Final_default sat ✅ 6.65809 6.65786
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.43838 0.33854
cvc5 cvc5 sat ✅ 2.85208 2.75219
SMTInterpol SMTInterpol unknown ❌ 1201.71997 1234.74590
STP STP sat ✅ 0.53503 0.43500
Yices2 Yices2 sat ✅ 0.70582 0.60619
Z3alpha Z3-alpha sat ✅ 0.53490 0.43532