Benchmark

non-incremental/QF_BV/sage/app7/bench_2090.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size874803
Compressed Size77205
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 874795
Compressed Size77212
Max. Term Depth3314
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1393 and1
=1895 let3257 extract1145 bvand7624
bvor4858 bvxor1274 bvadd8984 bvmul1
bvsub2914 bvult412 bvule399 bvslt185
bvsle96 bvshl2759 bvashr4570 zero_extend867

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.11805 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.15338 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.14619 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.14614 —
abziz_portfolio_2012_solvers default unsat ✅ 0.15020 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.14527 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.16106 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.19617 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.16728 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 4.86126 —
CVC3-SMT-COMP-2011 default unsat ✅ 4.17694 —
CVC3-SMT-COMP-2012 default unsat ✅ 4.31895 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.77382 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.29846 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.26804 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.25726 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.34279 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.33544 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.23975 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.38822 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.50735 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.33225 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.12753 —
STP2-SMT-COMP-2012 default unsat ✅ 0.11878 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.11817 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.14611 —
Z3-SMT-COMP-2011 default unsat ✅ 0.13955 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.21835 0.21697
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.22240 2.02369
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.23122 2.04169
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.19699 0.19597
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.88000
STP stp-cryptominisat4 default unsat ✅ 0.11583 0.11498
stp-cmsat4-v15 default unsat ✅ 0.11485 0.11398
stp-cmsat4-mt-v15 default unsat ✅ 0.11511 0.11398
stp-minisat-v15 default unsat ✅ 0.11499 0.11398
Yices2 Yices default unsat ✅ 0.05681 0.05599
Z3 z3 4.4.0 default unsat ✅ 0.18547 0.18497
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.50221 0.50244
ABC_glucose glucose unsat ✅ 0.49166 0.49181
Boolector Boolector boolector unsat ✅ 0.25809 0.25858
Boolector preprop boolector unsat ✅ 0.25171 0.25235
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.19830 1.99001
MapleSTP MapleSTP default unsat ✅ 0.10997 0.11000
MapleSTP-mt default unsat ✅ 0.11000 0.11003
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.17818 0.17929
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.14431 0.14435
Q3B Q3B default unsat ✅ 0.34303 0.55515
STP stp-cms-exp-2016 default unsat ✅ 0.11306 0.11306
stp-cms-mt-2016 default unsat ✅ 0.11517 0.11517
stp-cms-st-2016 default unsat ✅ 0.11430 0.11450
stp-minisat-st-2016 default unsat ✅ 0.11316 0.11321
Yices2 Yices-2.4.2 default unsat ✅ 0.05714 0.05713
Z3 z3-4.4.1 default unsat ✅ 0.15132 0.15269
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.21118 0.20889
Boolector SMT17 final boolector unsat ✅ 0.21028 0.20860
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.25605 2.06621
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.18302 0.18222
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.34228 0.34165
Q3B Q3B default unsat ✅ 0.32420 0.70217
STP stp_st default unsat ✅ 0.17057 0.16228
stp_mt default unsat ✅ 0.16071 0.16058
Yices2 Yices2-Main default unsat ✅ 0.05666 0.05547
Z3 z3-4.5.0 default unsat ✅ 0.19982 0.19975
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.18063 0.18056
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.06373 1.06381
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.17194 0.17295
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.34389 0.34392
Minkeyrink ST_st unsat ✅ 0.33817 0.33814
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.13831 0.13837
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.13903 0.13904
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.14375 0.14378
Yices2 Yices 2.6.0_default unsat ✅ 0.05490 0.05464
Z3 z3-4.7.1_default unsat ✅ 0.17564 0.17556
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.46202 0.46195
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.81142 0.80949
STP STP 2022.4_default unsat ✅ 0.14738 0.14741
STP 2022.4_default unsat ✅ 0.15171 0.15175
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 302.01900 347.35600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06377 0.06370
Z3-Owl z3-Owl-Final_default unsat ✅ 0.83745 0.83736
z3-Owl-Final_default unsat ✅ 0.84572 0.84577
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.50041 0.40053
cvc5 cvc5 unsat ✅ 0.62796 0.52815
SMTInterpol SMTInterpol unsat ✅ 636.64410 958.48273
STP STP unsat ✅ 3.00005 2.90039
Yices2 Yices2 unsat ✅ 0.25169 0.15201
Z3alpha Z3-alpha unsat ✅ 0.32937 0.22977
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.45357 0.33206
Bitwuzla-MachBV-base unsat ✅ 0.46570 0.33808
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.57378 0.44155
BVDecide bv_decide unsat ✅ 86.16929 86.02937
bv_decide-nokernel unsat ✅ 70.73543 70.58052
cvc5 cvc5 unsat ✅ 0.57974 0.45505
SMTInterpol SMTInterpol unknown ❌ 1201.89611 3582.62821
Yices2 Yices2 unsat ✅ 0.30326 0.18173
Z3alpha Z3-alpha unsat ✅ 0.49842 0.40008
Z3 Z3-alpha-base unsat ✅ 0.39365 0.26070
Z3-Owl-base unsat ✅ 0.72807 0.59976
z3siri-base unsat ✅ 0.37267 0.24691
Z3-Owl Z3-Owl unsat ✅ 0.89301 0.76782