Benchmark

non-incremental/QF_BV/sage/app7/bench_1336.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4490631
Compressed Size280690
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4490623
Compressed Size280696
Max. Term Depth17095
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2792 and1
=3605 let16945 extract1730 bvand46371
bvor30597 bvxor2344 bvadd49933 bvmul9
bvsub16376 bvsdiv28 bvult648 bvule658
bvslt221 bvsle126 bvshl16049 bvashr30291
zero_extend1533

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71689
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.68840
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.68426
abziz_portfolio_2012_minfeatures default unsat ✅ 0.69099
abziz_portfolio_2012_solvers default unsat ✅ 0.69032
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.68640
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.96394
Boolector-SMT-COMP-2011 default unsat ✅ 1.07806
Boolector-SMT-COMP-2012 default unsat ✅ 1.00902
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 414.16300
CVC3-SMT-COMP-2011 default unsat ✅ 347.44400
CVC3-SMT-COMP-2012 default unsat ✅ 362.49900
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.96868
CVC4-SMT-EVAL-2013 default unsat ✅ 6.00174
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.32230
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.27175
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.67290
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.62067
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.16663
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.66491
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.30267
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.89033
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74937
STP2-SMT-COMP-2012 default unsat ✅ 0.71881
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76514
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.74899
Z3-SMT-COMP-2011 default unsat ✅ 0.67517
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.19300 1.19318
Boolector SMT17 final boolector unsat ✅ 1.25909 1.25825
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.82121 9.25384
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.85247 0.85267
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.71519 1.71528
Q3B Q3B default unsat ✅ 1.10898 2.94000
STP stp_st default unsat ✅ 0.84457 0.84350
stp_mt default unsat ✅ 0.83946 0.83803
Yices2 Yices2-Main default unsat ✅ 0.27948 0.27887
Z3 z3-4.5.0 default unsat ✅ 0.90375 0.90262
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.06624 1.06613
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.37928 5.37962
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83765 0.83851
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.75123 1.75064
Minkeyrink ST_st unsat ✅ 1.73776 1.73761
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83837 0.83571
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.84857 0.84859
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.83938 0.83930
Yices2 Yices 2.6.0_default unsat ✅ 0.27001 0.26994
Z3 z3-4.7.1_default unsat ✅ 0.74314 0.74305
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.05783 2.05766
Poolector-wrapped-sq_default unsat ✅ 2.40825 9.04000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.68695 1.68679
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.66475 5.66445
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.18302 1.18302
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.18267 1.18252
Par4 Par4-wrapped-sq_default unsat ✅ 0.28105 0.00608
STP STP-2019-wrapped-sq_default unsat ✅ 0.83677 0.83689
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.84197 0.84214
stp-minisat-wrapped-sq_default unsat ✅ 0.83995 0.83999
stp-mt-wrapped-sq_default unsat ✅ 0.83758 0.83766
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.82362 0.82375
stp-riss-wrapped-sq_default unsat ✅ 0.83571 0.83583
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.27405 0.27403
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.27480 0.27484
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.27555 0.27552
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.27090 0.27087
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.27470 0.27469
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.68611 0.68603
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.71457 1.71338
Boolector Boolector-wrapped-sq_default unsat ✅ 2.06962 2.06841
Poolector-wrapped-sq_default unsat ✅ 2.38608 8.83000
CVC4 CVC4-sq-final_default unsat ✅ 7.41148 7.41107
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.05940 1.05926
MathSAT MathSAT5_default.sh unsat ✅ 0.86245 0.86240
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.99227 0.99235
MinkeyRink Solver 2020.3_default unsat ✅ 1.01541 1.01551
STP STP_default unsat ✅ 0.78723 0.78738
STP ++ Mergsat v1_default unsat ✅ 0.78769 0.78936
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.32367 0.32353
Z3 z3-4.8.8_default unsat ✅ 0.48853 0.48843