Benchmark

non-incremental/QF_BV/sage/app7/bench_1598.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1487784
Compressed Size110127
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1487776
Compressed Size110135
Max. Term Depth5718
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1571 and1
=2130 let5661 extract1229 bvand14396
bvor9326 bvxor1413 bvadd15946 bvmul1
bvsub5157 bvult431 bvule463 bvslt201
bvsle97 bvshl4990 bvashr9019 zero_extend938

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.20891 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.26467 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.26757 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.26938 —
abziz_portfolio_2012_solvers default unsat ✅ 0.26608 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.27223 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.28513 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.34462 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.30060 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 142.41600 —
CVC3-SMT-COMP-2011 default unsat ✅ 119.47000 —
CVC3-SMT-COMP-2012 default unsat ✅ 124.39900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.22510 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.01920 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.44865 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.42922 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.56936 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.56144 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.39969 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.20511 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.68129 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.58659 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.22224 —
STP2-SMT-COMP-2012 default unsat ✅ 0.21026 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.21536 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.28903 —
Z3-SMT-COMP-2011 default unsat ✅ 0.26207 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.40789 0.40694
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.00486 3.27750
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.99264 3.26550
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.32423 0.32295
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.01000
STP stp-cryptominisat4 default unsat ✅ 0.20067 0.19997
stp-cmsat4-v15 default unsat ✅ 0.20033 0.19897
stp-cmsat4-mt-v15 default unsat ✅ 0.20369 0.20297
stp-minisat-v15 default unsat ✅ 0.19906 0.19797
Yices2 Yices default unsat ✅ 0.09119 0.08998
Z3 z3 4.4.0 default unsat ✅ 0.24576 0.24596
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.85018 0.85034
ABC_glucose glucose unsat ✅ 0.84818 0.84903
Boolector Boolector boolector unsat ✅ 0.50565 0.50592
Boolector preprop boolector unsat ✅ 0.49265 0.49289
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.94923 3.19250
MapleSTP MapleSTP default unsat ✅ 0.19079 0.19085
MapleSTP-mt default unsat ✅ 0.19202 0.19208
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.29059 0.29199
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.25793 0.25805
Q3B Q3B default unsat ✅ 0.49774 0.50028
STP stp-cms-exp-2016 default unsat ✅ 0.20451 0.20068
stp-cms-mt-2016 default unsat ✅ 0.19990 0.19995
stp-cms-st-2016 default unsat ✅ 0.19847 0.19851
stp-minisat-st-2016 default unsat ✅ 0.19724 0.19732
Yices2 Yices-2.4.2 default unsat ✅ 0.09176 0.09178
Z3 z3-4.4.1 default unsat ✅ 0.28796 0.28939
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.39152 0.38836
Boolector SMT17 final boolector unsat ✅ 0.38915 0.38096
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.94639 3.15205
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.31553 0.30931
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.57253 0.57189
Q3B Q3B default unsat ✅ 0.47448 0.81032
STP stp_st default unsat ✅ 0.28130 0.28043
stp_mt default unsat ✅ 0.27019 0.26924
Yices2 Yices2-Main default unsat ✅ 0.08831 0.08817
Z3 z3-4.5.0 default unsat ✅ 0.29708 0.29638
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.33286 0.33281
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.80946 1.80955
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.28671 0.28778
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.57795 0.57798
Minkeyrink ST_st unsat ✅ 0.58201 0.58183
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.24508 0.24510
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.24390 0.24398
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.24596 0.24599
Yices2 Yices 2.6.0_default unsat ✅ 0.08467 0.08457
Z3 z3-4.7.1_default unsat ✅ 0.31048 0.31033
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.51728 0.51713
Bitwuzla-wrapped_default unsat ✅ 0.53728 0.53721
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.85242 1.84945
MathSAT MathSAT-5.6.8_default unsat ✅ 0.30602 0.30592
STP STP 2022.4_default unsat ✅ 0.25764 0.25770
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.10442 0.10439
Z3++BV z3++bv_0702_default unsat ✅ 0.21789 0.21750
Z3 z3-4.8.17_default unsat ✅ 0.21687 0.21873
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.77262 0.77252
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.36585 1.36176
STP STP 2022.4_default unsat ✅ 0.25643 0.25647
STP 2022.4_default unsat ✅ 0.25841 0.25838
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 444.49700 500.97200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10140 0.10134
Z3-Owl z3-Owl-Final_default unsat ✅ 0.86884 0.86870
z3-Owl-Final_default unsat ✅ 0.87721 0.87755