Benchmark

non-incremental/QF_BV/sage/app7/bench_1401.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1576362
Compressed Size116055
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1576354
Compressed Size116046
Max. Term Depth6069
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1644 and1
=2225 let6000 extract1254 bvand15331
bvor9938 bvxor1447 bvadd16947 bvmul1
bvsub5444 bvult438 bvule474 bvslt204
bvsle99 bvshl5280 bvashr9594 zero_extend967

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.22597 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.27902 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.28488 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.28360 —
abziz_portfolio_2012_solvers default unsat ✅ 0.28070 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.28450 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.30274 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.36681 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.32104 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ — —
CVC3-SMT-COMP-2011 default unsat ✅ 122.72200 —
CVC3-SMT-COMP-2012 default unsat ✅ 127.84300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.29356 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.12846 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.47687 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45387 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.59671 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.58349 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.42072 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.32785 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.85708 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.62203 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23767 —
STP2-SMT-COMP-2012 default unsat ✅ 0.22269 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.22742 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.30409 —
Z3-SMT-COMP-2011 default unsat ✅ 0.27739 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.42707 0.42593
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.10196 3.42748
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.09072 3.41548
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.34032 0.33895
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.19000
STP stp-cryptominisat4 default unsat ✅ 0.21313 0.21197
stp-cmsat4-v15 default unsat ✅ 0.21204 0.21097
stp-cmsat4-mt-v15 default unsat ✅ 0.21129 0.20997
stp-minisat-v15 default unsat ✅ 0.21099 0.20997
Yices2 Yices default unsat ✅ 0.09597 0.09498
Z3 z3 4.4.0 default unsat ✅ 0.25656 0.25696
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.90455 0.90525
ABC_glucose glucose unsat ✅ 0.88510 0.88559
Boolector Boolector boolector unsat ✅ 0.54285 0.54313
Boolector preprop boolector unsat ✅ 0.52752 0.52781
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.05803 3.36790
MapleSTP MapleSTP default unsat ✅ 0.20237 0.20239
MapleSTP-mt default unsat ✅ 0.21041 0.21046
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.30485 0.30599
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.27301 0.27372
Q3B Q3B default unsat ✅ 0.53287 0.53503
STP stp-cms-exp-2016 default unsat ✅ 0.20575 0.20580
stp-cms-mt-2016 default unsat ✅ 0.21226 0.21231
stp-cms-st-2016 default unsat ✅ 0.20982 0.21023
stp-minisat-st-2016 default unsat ✅ 0.21143 0.21146
Yices2 Yices-2.4.2 default unsat ✅ 0.09539 0.09558
Z3 z3-4.4.1 default unsat ✅ 0.34998 0.35144
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.43401 0.43377
Boolector SMT17 final boolector unsat ✅ 0.40554 0.40300
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.06296 3.32884
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.33446 0.33458
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.63942 0.63877
Q3B Q3B default unsat ✅ 0.51825 0.51734
STP stp_st default unsat ✅ 0.29909 0.28812
stp_mt default unsat ✅ 0.27190 0.27031
Yices2 Yices2-Main default unsat ✅ 0.09235 0.09224
Z3 z3-4.5.0 default unsat ✅ 0.34073 0.33969
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.34994 0.34990
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.88889 1.88901
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.30102 0.30207
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.61538 0.61539
Minkeyrink ST_st unsat ✅ 0.61270 0.61276
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.26017 0.26014
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.26018 0.26024
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.25974 0.25974
Yices2 Yices 2.6.0_default unsat ✅ 0.08996 0.08991
Z3 z3-4.7.1_default unsat ✅ 0.31989 0.31979
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.68287 0.68286
Poolector-wrapped-sq_default unsat ✅ 0.88723 3.12427
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.54537 0.54533
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.96360 1.96371
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.46041 0.46056
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.45878 0.45882
Par4 Par4-wrapped-sq_default unsat ✅ 0.09832 0.00649
STP STP-2019-wrapped-sq_default unsat ✅ 0.26901 0.26913
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.26674 0.26690
stp-minisat-wrapped-sq_default unsat ✅ 0.26912 0.26925
stp-mt-wrapped-sq_default unsat ✅ 0.26954 0.26966
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.26748 0.26760
stp-riss-wrapped-sq_default unsat ✅ 0.26879 0.26892
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.09278 0.09279
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09599 0.09601
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.09219 0.09215
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09259 0.09262
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.09256 0.09258
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27258 0.27252
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53874 0.53867
MathSAT mathsat-5.6.6_default unsat ✅ 0.32016 0.32003
STP STP 2021.0_default unsat ✅ 0.25686 0.25701
Z3 z3-4.8.11_default unsat ✅ 0.25511 0.25509
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.61344 0.51321
cvc5 cvc5 unsat ✅ 0.70790 0.60780
SMTInterpol SMTInterpol unsat ✅ 1036.67272 1513.60097
STP STP unsat ✅ 7.73716 7.63645
Yices2 Yices2 unsat ✅ 0.29530 0.19551
Z3alpha Z3-alpha unsat ✅ 0.40621 0.30628
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.62083 0.48567
Bitwuzla-MachBV-base unsat ✅ 0.67512 0.55316
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.72535 0.60767
BVDecide bv_decide unsat ✅ 428.32712 428.12621
bv_decide-nokernel unsat ✅ 383.54567 383.37700
cvc5 cvc5 unsat ✅ 0.49843 0.38325
SMTInterpol SMTInterpol unknown ❌ 1201.85253 3067.16033
Yices2 Yices2 unsat ✅ 0.29734 0.18110
Z3alpha Z3-alpha unsat ✅ 0.63687 0.56313
Z3 Z3-alpha-base unsat ✅ 0.38532 0.26786
Z3-Owl-base unsat ✅ 0.82579 0.70113
z3siri-base unsat ✅ 0.39648 0.26487
Z3-Owl Z3-Owl unsat ✅ 0.94014 0.80575