Benchmark

non-incremental/QF_BV/sage/app7/bench_1133.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2224742
Compressed Size147225
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2224734
Compressed Size147231
Max. Term Depth8579
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1725 and1
=2322 let8480 extract1280 bvand22666
bvor14836 bvxor1512 bvadd24374 bvmul1
bvsub7868 bvult439 bvule481 bvslt204
bvsle102 bvshl7703 bvashr14438 zero_extend999

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.33515 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.36606 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.37186 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.36751 —
abziz_portfolio_2012_solvers default unsat ✅ 0.37111 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.37212 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.45705 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.52689 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.48201 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 229.70500 —
CVC3-SMT-COMP-2011 default unsat ✅ 192.17200 —
CVC3-SMT-COMP-2012 default unsat ✅ 200.39900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.89794 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.94468 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.65524 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.62767 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.82641 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.80911 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.58922 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.94451 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.13969 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.91902 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.36036 —
STP2-SMT-COMP-2012 default unsat ✅ 0.33931 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.34678 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.40377 —
Z3-SMT-COMP-2011 default unsat ✅ 0.36684 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.61700 0.61591
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.92443 4.71628
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.91829 4.72028
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.46655 0.46493
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.01000
STP stp-cryptominisat4 default unsat ✅ 0.30064 0.29995
stp-cmsat4-v15 default unsat ✅ 0.30072 0.29995
stp-cmsat4-mt-v15 default unsat ✅ 0.29844 0.29795
stp-minisat-v15 default unsat ✅ 0.30259 0.30195
Yices2 Yices default unsat ✅ 0.13043 0.12998
Z3 z3 4.4.0 default unsat ✅ 0.52702 0.52692
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.26835 1.26886
ABC_glucose glucose unsat ✅ 1.25132 1.25307
Boolector Boolector boolector unsat ✅ 0.71152 0.71211
Boolector preprop boolector unsat ✅ 0.69207 0.69249
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.89180 4.66325
MapleSTP MapleSTP default unsat ✅ 0.28519 0.28532
MapleSTP-mt default unsat ✅ 0.28636 0.28660
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.41143 0.41260
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.41161 0.41180
Q3B Q3B default unsat ✅ 0.65603 1.54000
STP stp-cms-exp-2016 default unsat ✅ 0.29316 0.29329
stp-cms-mt-2016 default unsat ✅ 0.29677 0.29690
stp-cms-st-2016 default unsat ✅ 0.29753 0.29768
stp-minisat-st-2016 default unsat ✅ 0.29693 0.29708
Yices2 Yices-2.4.2 default unsat ✅ 0.13021 0.13020
Z3 z3-4.4.1 default unsat ✅ 0.48662 0.48862
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.56621 0.56494
Boolector SMT17 final boolector unsat ✅ 0.56701 0.56606
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.88402 4.60445
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.42626 0.42566
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.85528 0.85193
Q3B Q3B default unsat ✅ 0.62902 1.53000
STP stp_st default unsat ✅ 0.40509 0.40431
stp_mt default unsat ✅ 0.40758 0.40718
Yices2 Yices2-Main default unsat ✅ 0.12381 0.12275
Z3 z3-4.5.0 default unsat ✅ 0.41681 0.41574
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.50328 0.50311
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.65278 2.65289
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.41638 0.41732
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.87466 0.87186
Minkeyrink ST_st unsat ✅ 0.87810 0.87484
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.39647 0.39644
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.39515 0.39521
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.40029 0.39866
Yices2 Yices 2.6.0_default unsat ✅ 0.11855 0.11849
Z3 z3-4.7.1_default unsat ✅ 0.39715 0.39469
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.78837 0.78833
Boolector Boolector-wrapped-sq_default unsat ✅ 0.94436 0.94440
Poolector-wrapped-sq_default unsat ✅ 1.17828 4.30516
CVC4 CVC4-sq-final_default unsat ✅ 3.58315 3.58295
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.52846 0.52828
MathSAT MathSAT5_default.sh unsat ✅ 0.42351 0.42340
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.51041 0.51052
MinkeyRink Solver 2020.3_default unsat ✅ 0.53185 0.53197
STP STP_default unsat ✅ 0.37355 0.37366
STP ++ Mergsat v1_default unsat ✅ 0.36948 0.37098
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.14768 0.14757
Z3 z3-4.8.8_default unsat ✅ 0.31544 0.31533
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.78812 0.78812
Bitwuzla-wrapped_default unsat ✅ 0.88305 0.88290
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.95316 2.94973
MathSAT MathSAT-5.6.8_default unsat ✅ 0.44177 0.44122
STP STP 2022.4_default unsat ✅ 0.47185 0.46873
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14872 0.14869
Z3++BV z3++bv_0702_default unsat ✅ 0.34894 0.34886
Z3 z3-4.8.17_default unsat ✅ 0.33981 0.34159
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.70142 0.57213
Bitwuzla-MachBV-base unsat ✅ 0.83011 0.70794
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.01963 0.90309
BVDecide bv_decide unknown ❌ 1201.35103 1201.03920
bv_decide-nokernel unknown ❌ 1201.38763 1200.99989
cvc5 cvc5 unsat ✅ 0.92564 0.79437
SMTInterpol SMTInterpol unknown ❌ 1201.87230 3004.11620
Yices2 Yices2 unsat ✅ 0.33782 0.22287
Z3alpha Z3-alpha unsat ✅ 0.72142 0.66733
Z3 Z3-alpha-base unsat ✅ 0.43340 0.31428
Z3-Owl-base unsat ✅ 1.08480 0.95845
z3siri-base unsat ✅ 0.42580 0.30632
Z3-Owl Z3-Owl unsat ✅ 1.02745 0.89790