Benchmark

non-incremental/QF_BV/sage/app9/bench_78.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size37940
Compressed Size6762
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 37932
Compressed Size6759
Max. Term Depth109
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not116 and1
=177 let99 extract2 bvand6
bvor63 bvadd323 bvmul11 bvsub97
bvult87 bvule227 bvslt5 bvsle10
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.50387 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 1.23249 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 1.21112 —
abziz_portfolio_2012_minfeatures default unsat ✅ 1.21673 —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 1.24337 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 3.29064 —
Boolector-SMT-COMP-2011 default unsat ✅ 2.90587 —
Boolector-SMT-COMP-2012 default unsat ✅ 3.55808 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.32116 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.37585 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.10344 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.18265 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.10219 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.09514 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.15596 —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.45386 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.22920 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.19098 —
STP2-SMT-COMP-2012 default unsat ✅ 0.29744 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 9.37713 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unsat ✅ 1.20847 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 1.01437 1.01285
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.51222 0.98985
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.54671 1.05984
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.27260 0.27196
SMT-RAT SMT-RAT-final default unsat ✅ 92.87650 92.89690
STP stp-cryptominisat4 default unsat ✅ 0.31983 0.31895
stp-cmsat4-v15 default unsat ✅ 0.26575 0.26496
stp-cmsat4-mt-v15 default unknown ❌ 0.16281 0.16197
stp-minisat-v15 default unsat ✅ 0.22792 0.22696
Yices2 Yices default unsat ✅ 0.02587 0.02499
Z3 z3 4.4.0 default unsat ✅ 1.15327 1.15382
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.54823 0.54833
ABC_glucose glucose unsat ✅ 3.16799 3.16994
Boolector Boolector boolector unsat ✅ 1.03141 1.03198
Boolector preprop boolector unsat ✅ 1.03965 1.04016
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.51708 1.00315
MapleSTP MapleSTP default unsat ✅ 0.29864 0.29875
MapleSTP-mt default unsat ✅ 0.29824 0.76784
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.25493 0.25594
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.02919 1.63293
Q3B Q3B default unknown ❌ 2400.03000 7204.17000
STP stp-cms-exp-2016 default unsat ✅ 0.36561 0.36578
stp-cms-mt-2016 default unsat ✅ 0.31971 0.84744
stp-cms-st-2016 default unsat ✅ 0.29757 0.29770
stp-minisat-st-2016 default unsat ✅ 0.69994 0.69998
Yices2 Yices-2.4.2 default unsat ✅ 0.03494 0.03492
Z3 z3-4.4.1 default unsat ✅ 2.70046 2.70319
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.52679 0.52588
Boolector SMT17 final boolector unsat ✅ 1.05218 1.05094
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.60745 1.17960
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.25031 0.25085
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.43234 0.39413
Q3B Q3B default unknown ❌ 600.07400 1786.51000
STP stp_st default unsat ✅ 1.86676 1.86120
stp_mt default unsat ✅ 2.13279 6.35944
Yices2 Yices2-Main default unsat ✅ 0.02549 0.02470
Z3 z3-4.5.0 default unsat ✅ 1.53679 1.53572
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.22743 0.22733
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.60632 0.60638
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.25624 0.25743
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.28166 0.60934
Minkeyrink ST_st unsat ✅ 0.26233 0.26241
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.59700 1.59725
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.42050 5.14057
STP-Riss-st-2018_riss-no-stderr unsat ✅ 2.16285 2.16281
Yices2 Yices 2.6.0_default unsat ✅ 0.02911 0.02907
Z3 z3-4.7.1_default unsat ✅ 2.98962 2.98949
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.83824 0.83814
Poolector-wrapped-sq_default unsat ✅ 0.68327 2.20000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.00963 1.00958
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.40177 0.40199
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.29594 0.70970
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.29763 0.29768
Par4 Par4-wrapped-sq_default unsat ✅ 0.03755 0.00626
STP STP-2019-wrapped-sq_default unsat ✅ 2.73162 2.73166
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 9.68444 9.66496
stp-minisat-wrapped-sq_default unsat ✅ 3.29127 3.29106
stp-mt-wrapped-sq_default unsat ✅ 2.56310 9.58467
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 10.09310 15.88690
stp-riss-wrapped-sq_default unknown ❌ 0.17924 0.17947
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03036 0.03035
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03849 0.03852
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03416 0.03415
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.06000 2400.14000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.06109 0.06112
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 2.20936 2.20944
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.86874 0.86871
MathSAT mathsat-5.6.6_default unsat ✅ 0.13809 0.13802
STP STP 2021.0_default unsat ✅ 0.26061 0.60096
Z3 z3-4.8.11_default unsat ✅ 1.19239 1.19216
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.31486 0.31478
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.41733 0.41676
STP STP 2022.4_default unsat ✅ 0.32184 0.32189
STP 2022.4_default unsat ✅ 0.31997 0.32002
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 10.80730 28.76180
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02781 0.02778
Z3-Owl z3-Owl-Final_default unsat ✅ 10.40620 10.40500
z3-Owl-Final_default unsat ✅ 10.79250 10.79130
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.40449 0.30465
cvc5 cvc5 unsat ✅ 1.02335 0.92382
SMTInterpol SMTInterpol unsat ✅ 50.65418 71.78337
STP STP unsat ✅ 0.45568 0.35574
Yices2 Yices2 unsat ✅ 0.23578 0.13599
Z3alpha Z3-alpha unsat ✅ 0.56287 0.46306