Benchmark

non-incremental/QF_BV/sage/app7/bench_2030.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size960447
Compressed Size80650
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 960439
Compressed Size80657
Max. Term Depth3649
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1412 and1
=1921 let3592 extract1157 bvand8578
bvor5510 bvxor1302 bvadd9959 bvmul1
bvsub3201 bvult417 bvule415 bvslt185
bvsle96 bvshl3052 bvashr5160 zero_extend880

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.13746 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.17068 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.17283 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.16756 —
abziz_portfolio_2012_solvers default unsat ✅ 0.17009 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.16773 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.17439 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.22228 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.18474 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 62.58110 —
CVC3-SMT-COMP-2011 default unsat ✅ 52.35940 —
CVC3-SMT-COMP-2012 default unsat ✅ 54.53980 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.88207 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.44518 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.29050 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.27660 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.37476 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.35935 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.26345 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.49015 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.69072 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.38526 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.14534 —
STP2-SMT-COMP-2012 default unsat ✅ 0.13960 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.13796 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.18538 —
Z3-SMT-COMP-2011 default unsat ✅ 0.17062 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.24114 0.23996
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.32358 2.17867
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.32429 2.18467
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.21525 0.21397
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.93000
STP stp-cryptominisat4 default unsat ✅ 0.12624 0.12498
stp-cmsat4-v15 default unsat ✅ 0.12546 0.12398
stp-cmsat4-mt-v15 default unsat ✅ 0.12567 0.12498
stp-minisat-v15 default unsat ✅ 0.12458 0.12398
Yices2 Yices default unsat ✅ 0.06108 0.05999
Z3 z3 4.4.0 default unsat ✅ 0.20529 0.20497
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.54942 0.54951
ABC_glucose glucose unsat ✅ 0.54168 0.54180
Boolector Boolector boolector unsat ✅ 0.26924 0.26975
Boolector preprop boolector unsat ✅ 0.26112 0.26169
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.27851 2.11153
MapleSTP MapleSTP default unsat ✅ 0.11949 0.12000
MapleSTP-mt default unsat ✅ 0.12030 0.12033
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.19541 0.19642
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.16358 0.16358
Q3B Q3B default unsat ✅ 0.37162 0.60535
STP stp-cms-exp-2016 default unsat ✅ 0.12241 0.12243
stp-cms-mt-2016 default unsat ✅ 0.12400 0.12404
stp-cms-st-2016 default unsat ✅ 0.12553 0.12557
stp-minisat-st-2016 default unsat ✅ 0.12468 0.12472
Yices2 Yices-2.4.2 default unsat ✅ 0.06256 0.06253
Z3 z3-4.4.1 default unsat ✅ 0.21696 0.21845
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.23735 0.23728
Boolector SMT17 final boolector unsat ✅ 0.25614 0.25070
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.28438 2.09411
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.20937 0.20811
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.36426 0.36438
Q3B Q3B default unsat ✅ 0.35408 0.78660
STP stp_st default unsat ✅ 0.16186 0.16106
stp_mt default unsat ✅ 0.15634 0.15571
Yices2 Yices2-Main default unsat ✅ 0.06212 0.06229
Z3 z3-4.5.0 default unsat ✅ 0.21766 0.21695
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.20361 0.20334
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.15154 1.15173
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.18778 0.18879
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.36904 0.36911
Minkeyrink ST_st unsat ✅ 0.37008 0.37005
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.15237 0.15235
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.15546 0.15551
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.15154 0.15155
Yices2 Yices 2.6.0_default unsat ✅ 0.05840 0.05835
Z3 z3-4.7.1_default unsat ✅ 0.21477 0.21453
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.30352 0.30350
Bitwuzla-wrapped_default unsat ✅ 0.34083 0.34078
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.20324 1.19547
MathSAT MathSAT-5.6.8_default unsat ✅ 0.19963 0.19958
STP STP 2022.4_default unsat ✅ 0.16627 0.16632
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.07015 0.07012
Z3++BV z3++bv_0702_default unsat ✅ 0.17523 0.17514
Z3 z3-4.8.17_default unsat ✅ 0.16962 0.17148
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.45256 0.35266
cvc5 cvc5 unsat ✅ 0.54782 0.44854
SMTInterpol SMTInterpol unsat ✅ 706.87751 1035.97056
STP STP unsat ✅ 3.52486 3.42480
Yices2 Yices2 unsat ✅ 0.27234 0.17162
Z3alpha Z3-alpha unsat ✅ 0.33938 0.23984
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.44287 0.32210
Bitwuzla-MachBV-base unsat ✅ 0.48935 0.36849
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.58487 0.45497
BVDecide bv_decide unsat ✅ 134.18373 134.01847
bv_decide-nokernel unsat ✅ 112.65114 112.50535
cvc5 cvc5 unsat ✅ 0.50651 0.37280
SMTInterpol SMTInterpol unknown ❌ 1201.89333 3472.73219
Yices2 Yices2 unsat ✅ 0.31549 0.19118
Z3alpha Z3-alpha unsat ✅ 0.50137 0.41204
Z3 Z3-alpha-base unsat ✅ 0.36746 0.24736
Z3-Owl-base unsat ✅ 0.66485 0.54340
z3siri-base unsat ✅ 0.33184 0.21555
Z3-Owl Z3-Owl unsat ✅ 1.00609 0.86656