Benchmark

non-incremental/QF_BV/sage/app7/bench_1309.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1824567
Compressed Size127584
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1824559
Compressed Size127591
Max. Term Depth7040
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1665 and1
=2250 let6941 extract1262 bvand18151
bvor11825 bvxor1461 bvadd19790 bvmul1
bvsub6375 bvult438 bvule476 bvslt204
bvsle100 bvshl6211 bvashr11452 zero_extend977

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.25946 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.31478 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.33674 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.31685 —
abziz_portfolio_2012_solvers default unsat ✅ 0.31928 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.31462 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.35037 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.42863 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.37151 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 71.63170 —
CVC3-SMT-COMP-2011 default unsat ✅ 60.61880 —
CVC3-SMT-COMP-2012 default unsat ✅ 63.35210 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.43640 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.40413 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.54255 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.52357 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.68409 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.66583 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.48274 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.50875 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.34108 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.76055 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.30993 —
STP2-SMT-COMP-2012 default unsat ✅ 0.25746 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.26769 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.35310 —
Z3-SMT-COMP-2011 default unsat ✅ 0.30910 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.50338 0.50192
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.46429 4.03639
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.43799 3.99639
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.38361 0.38294
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.70000
STP stp-cryptominisat4 default unsat ✅ 0.24729 0.24596
stp-cmsat4-v15 default unsat ✅ 0.24530 0.24396
stp-cmsat4-mt-v15 default unsat ✅ 0.24537 0.24396
stp-minisat-v15 default unsat ✅ 0.24365 0.24296
Yices2 Yices default unsat ✅ 0.10932 0.10798
Z3 z3 4.4.0 default unsat ✅ 0.31442 0.31395
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.04061 1.04116
ABC_glucose glucose unsat ✅ 1.03199 1.03233
Boolector Boolector boolector unsat ✅ 0.62843 0.62919
Boolector preprop boolector unsat ✅ 0.61415 0.61450
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.42049 3.97721
MapleSTP MapleSTP default unsat ✅ 0.23373 0.23382
MapleSTP-mt default unsat ✅ 0.23335 0.23355
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.34330 0.34445
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.34330 0.34346
Q3B Q3B default unsat ✅ 0.56521 0.56656
STP stp-cms-exp-2016 default unsat ✅ 0.23936 0.23943
stp-cms-mt-2016 default unsat ✅ 0.24342 0.24355
stp-cms-st-2016 default unsat ✅ 0.24282 0.24293
stp-minisat-st-2016 default unsat ✅ 0.24300 0.24305
Yices2 Yices-2.4.2 default unsat ✅ 0.11005 0.11009
Z3 z3-4.4.1 default unsat ✅ 0.31027 0.31154
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.46505 0.46372
Boolector SMT17 final boolector unsat ✅ 0.46499 0.46335
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.39371 3.88260
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.35303 0.35391
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.72053 0.71972
Q3B Q3B default unsat ✅ 1.03955 1.27000
STP stp_st default unsat ✅ 0.32504 0.32434
stp_mt default unsat ✅ 0.34996 0.34727
Yices2 Yices2-Main default unsat ✅ 0.11122 0.10293
Z3 z3-4.5.0 default unsat ✅ 0.28806 0.28691
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.41004 0.40994
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.19834 2.19839
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.34337 0.34435
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.70771 0.70773
Minkeyrink ST_st unsat ✅ 0.70851 0.70843
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.32240 0.32254
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.30168 0.30170
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.30091 0.30097
Yices2 Yices 2.6.0_default unsat ✅ 0.10063 0.10057
Z3 z3-4.7.1_default unsat ✅ 0.35496 0.35481
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.79503 0.79310
Poolector-wrapped-sq_default unsat ✅ 0.98702 3.53000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.64143 0.64140
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.27573 2.27595
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.51725 0.51738
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.52056 0.52069
Par4 Par4-wrapped-sq_default unsat ✅ 0.12180 0.00610
STP STP-2019-wrapped-sq_default unsat ✅ 0.31254 0.31267
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.30849 0.30856
stp-minisat-wrapped-sq_default unsat ✅ 0.31135 0.31149
stp-mt-wrapped-sq_default unsat ✅ 0.31313 0.31327
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.31203 0.31215
stp-riss-wrapped-sq_default unsat ✅ 0.31107 0.31120
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.10517 0.10518
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.10449 0.10450
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.10576 0.10580
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.10310 0.10308
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.10534 0.10530
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.35528 0.35531
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62524 0.62515
MathSAT mathsat-5.6.6_default unsat ✅ 0.36437 0.36433
STP STP 2021.0_default unsat ✅ 0.29782 0.29795
Z3 z3-4.8.11_default unsat ✅ 0.31967 0.31954
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.99389 0.99378
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.68411 1.68441
STP STP 2022.4_default unsat ✅ 0.33347 0.33344
STP 2022.4_default unsat ✅ 0.33112 0.33119
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 499.43500 570.65000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.12053 0.12048
Z3-Owl z3-Owl-Final_default unsat ✅ 0.89575 0.89570
z3-Owl-Final_default unsat ✅ 0.90984 0.90997
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.72211 0.62306
cvc5 cvc5 unsat ✅ 0.55621 0.45684
SMTInterpol SMTInterpol unsat ✅ 950.34986 1434.89131
STP STP unsat ✅ 11.08085 10.97100
Yices2 Yices2 unsat ✅ 0.29066 0.19081
Z3alpha Z3-alpha unsat ✅ 0.41516 0.31555