Benchmark

non-incremental/QF_BV/sage/app7/bench_1784.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1210048
Compressed Size95194
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1210040
Compressed Size95200
Max. Term Depth4631
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1508 and1
=2043 let4574 extract1189 bvand11322
bvor7301 bvxor1355 bvadd12799 bvmul1
bvsub4110 bvult425 bvule447 bvslt190
bvsle96 bvshl3956 bvashr6982 zero_extend904

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.17110 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22113 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.22027 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.22386 —
abziz_portfolio_2012_solvers default unsat ✅ 0.22054 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.21940 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.23550 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.27994 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.25625 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 104.08200 —
CVC3-SMT-COMP-2011 default unsat ✅ 87.00670 —
CVC3-SMT-COMP-2012 default unsat ✅ 90.55280 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.02993 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.73762 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.37719 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.35432 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.46915 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.45076 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.33105 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.80999 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.15779 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.47599 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.17985 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16958 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.17530 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.25017 —
Z3-SMT-COMP-2011 default unsat ✅ 0.21879 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.32700 0.32595
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.65592 2.71559
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.65821 2.72358
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.26005 0.25896
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.57000
STP stp-cryptominisat4 default unsat ✅ 0.16623 0.16497
stp-cmsat4-v15 default unsat ✅ 0.16356 0.16198
stp-cmsat4-mt-v15 default unsat ✅ 0.16410 0.16297
stp-minisat-v15 default unsat ✅ 0.16312 0.16198
Yices2 Yices default unsat ✅ 0.07580 0.07499
Z3 z3 4.4.0 default unsat ✅ 0.22891 0.22896
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.69761 0.69800
ABC_glucose glucose unsat ✅ 0.68546 0.68564
Boolector Boolector boolector unsat ✅ 0.41020 0.41039
Boolector preprop boolector unsat ✅ 0.39510 0.39564
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.62998 2.67794
MapleSTP MapleSTP default unsat ✅ 0.15505 0.15510
MapleSTP-mt default unsat ✅ 0.15554 0.15560
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.23091 0.23202
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.21952 0.21903
Q3B Q3B default unsat ✅ 0.81546 1.90000
STP stp-cms-exp-2016 default unsat ✅ 0.16109 0.16117
stp-cms-mt-2016 default unsat ✅ 0.16076 0.16082
stp-cms-st-2016 default unsat ✅ 0.16839 0.16845
stp-minisat-st-2016 default unsat ✅ 0.16273 0.16277
Yices2 Yices-2.4.2 default unsat ✅ 0.07631 0.07629
Z3 z3-4.4.1 default unsat ✅ 0.21631 0.21785
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.30055 0.30079
Boolector SMT17 final boolector unsat ✅ 0.30296 0.30265
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.61517 2.62258
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.23790 0.23610
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.47629 0.46950
Q3B Q3B default unsat ✅ 0.39827 0.92189
STP stp_st default unsat ✅ 0.23790 0.23571
stp_mt default unsat ✅ 0.24178 0.23954
Yices2 Yices2-Main default unsat ✅ 0.07288 0.07280
Z3 z3-4.5.0 default unsat ✅ 0.24216 0.24071
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.27086 0.27082
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.47473 1.47447
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.22761 0.22862
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.46680 0.46682
Minkeyrink ST_st unsat ✅ 0.46603 0.46597
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.19901 0.19906
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.20047 0.20049
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.20039 0.20028
Yices2 Yices 2.6.0_default unsat ✅ 0.07063 0.07050
Z3 z3-4.7.1_default unsat ✅ 0.29705 0.29693
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40135 0.40125
Boolector Boolector-wrapped-sq_default unsat ✅ 0.50007 0.50008
Poolector-wrapped-sq_default unsat ✅ 0.67847 2.32058
CVC4 CVC4-sq-final_default unsat ✅ 1.93655 1.93671
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.28965 0.28960
MathSAT MathSAT5_default.sh unsat ✅ 0.24040 0.24031
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.30180 0.30182
MinkeyRink Solver 2020.3_default unsat ✅ 0.31250 0.31258
STP STP_default unsat ✅ 0.19229 0.19237
STP ++ Mergsat v1_default unsat ✅ 0.18655 0.18821
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.08489 0.08481
Z3 z3-4.8.8_default unsat ✅ 0.23403 0.23396
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40301 0.40296
MathSAT mathsat-5.6.6_default unsat ✅ 0.24142 0.24133
STP STP 2021.0_default unsat ✅ 0.19593 0.19604
Z3 z3-4.8.11_default unsat ✅ 0.21602 0.21583
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.54144 0.41570
Bitwuzla-MachBV-base unsat ✅ 0.53284 0.41127
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.61655 0.50006
BVDecide bv_decide unsat ✅ 217.05039 216.89899
bv_decide-nokernel unsat ✅ 195.41025 195.26484
cvc5 cvc5 unsat ✅ 0.59006 0.46396
SMTInterpol SMTInterpol unknown ❌ 1201.86178 3485.12969
Yices2 Yices2 unsat ✅ 0.31122 0.19244
Z3alpha Z3-alpha unsat ✅ 0.55745 0.46642
Z3 Z3-alpha-base unsat ✅ 0.39603 0.27030
Z3-Owl-base unsat ✅ 0.81314 0.68798
z3siri-base unsat ✅ 0.39392 0.27584
Z3-Owl Z3-Owl unsat ✅ 0.93538 0.79513