Benchmark

non-incremental/QF_BV/sage/app11/bench_462.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1529642
Compressed Size151463
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1529634
Compressed Size151472
Max. Term Depth4213
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1280
and1 =2064 let2880 extract1482
bvand959 bvor273 bvxor2275 bvadd14623
bvmul1181 bvsdiv16 bvult1095 bvule1499
bvslt122 bvsle163 bvshl8906 bvashr13273
zero_extend10172

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.15948
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40705
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40445
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40656
abziz_portfolio_2012_solvers default unsat ✅ 0.40973
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40667
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21800
Boolector-SMT-COMP-2011 default unsat ✅ 0.29924
Boolector-SMT-COMP-2012 default unsat ✅ 0.23728
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.91160
CVC3-SMT-COMP-2011 default unsat ✅ 26.28660
CVC3-SMT-COMP-2012 default unsat ✅ 27.25180
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.70321
CVC4-SMT-EVAL-2013 default unsat ✅ 13.60860
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45628
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44595
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.24240
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54562
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46571
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.99050
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.80527
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54219
STP STP2-SMT-COMP-2011 default unsat ✅ 1.08421
STP2-SMT-COMP-2012 default unsat ✅ 0.16461
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25316
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.43863
Z3-SMT-COMP-2011 default unsat ✅ 0.40074
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32712 0.32630
Boolector SMT17 final boolector unsat ✅ 0.38442 0.38369
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.54299 6.32536
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.37676 0.37701
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.69026 0.68870
Q3B Q3B default unsat ✅ 60.82310 180.52000
STP stp_st default unsat ✅ 13.75100 13.74870
stp_mt default unsat ✅ 12.47850 12.47760
Yices2 Yices2-Main default unsat ✅ 0.13637 0.13499
Z3 z3-4.5.0 default unsat ✅ 0.35136 0.35070
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29082 0.29071
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.28844 3.28834
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.31316 0.31421
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68355 0.68359
Minkeyrink ST_st unsat ✅ 0.68318 0.68317
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.35620 12.35630
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.33530 12.33500
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.38580 12.38470
Yices2 Yices 2.6.0_default unsat ✅ 0.12197 0.12188
Z3 z3-4.7.1_default unsat ✅ 0.33655 0.33647
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.57829 0.57828
Poolector-wrapped-sq_default unsat ✅ 0.78071 2.83043
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.51679 0.51681
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.32897 3.32906
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.36265 1.36263
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.36448 1.36444
Par4 Par4-wrapped-sq_default unsat ✅ 0.13153 0.00607
STP STP-2019-wrapped-sq_default unsat ✅ 11.49820 11.49700
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 12.42020 12.41930
stp-minisat-wrapped-sq_default unsat ✅ 11.53120 11.53030
stp-mt-wrapped-sq_default unsat ✅ 11.51700 11.51690
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 11.55850 11.55870
stp-riss-wrapped-sq_default unsat ✅ 11.53970 11.53480
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12720 0.12718
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12744 0.12745
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12756 0.12751
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12668 0.12670
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12749 0.12748
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.30379 0.30377
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42166 0.42163
MathSAT mathsat-5.6.6_default unsat ✅ 33.83240 33.82520
STP STP 2021.0_default unsat ✅ 21.38940 21.38450
Z3 z3-4.8.11_default unsat ✅ 0.31414 0.31410
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41584 0.41576
Bitwuzla-wrapped_default unsat ✅ 0.46027 0.45948
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.11845 4.11916
MathSAT MathSAT-5.6.8_default unsat ✅ 0.30432 0.30425
STP STP 2022.4_default unsat ✅ 0.24331 0.24008
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14148 0.14136
Z3++BV z3++bv_0702_default unsat ✅ 0.35108 0.35099
Z3 z3-4.8.17_default unsat ✅ 0.30243 0.30422
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.74798 0.61797
Bitwuzla-MachBV-base unsat ✅ 0.81035 0.68521
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.90561 0.77532
BVDecide bv_decide unknown ❌ 1201.38640 1201.01228
bv_decide-nokernel unknown ❌ 1201.34998 1200.99907
cvc5 cvc5 unsat ✅ 0.86719 0.73739
SMTInterpol SMTInterpol unknown ❌ 1201.89671 2857.78869
Yices2 Yices2 unsat ✅ 0.34626 0.22410
Z3alpha Z3-alpha unsat ✅ 0.62909 0.54924
Z3 Z3-alpha-base unsat ✅ 0.42795 0.30673
Z3-Owl-base unsat ✅ 0.91083 0.78651
z3siri-base unsat ✅ 0.43172 0.30360
Z3-Owl Z3-Owl unsat ✅ 0.95570 0.83207