Benchmark

non-incremental/QF_BV/sage/app7/bench_623.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3151677
Compressed Size195663
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3151669
Compressed Size195651
Max. Term Depth12092
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1902 and1
=2543 let11987 extract1393 bvand32857
bvor21678 bvxor1690 bvadd34792 bvmul1
bvsub11291 bvult461 bvule505 bvslt211
bvsle115 bvshl11105 bvashr21088 zero_extend1118

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46874 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.51883 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51489 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.51806 —
abziz_portfolio_2012_solvers default unsat ✅ 0.51779 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.51811 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.63830 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.76099 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.67944 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 296.80500 —
CVC3-SMT-COMP-2011 default unsat ✅ 248.52200 —
CVC3-SMT-COMP-2012 default unsat ✅ 259.74100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.74621 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.17148 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.95033 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.91080 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.18261 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.14942 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.82668 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.75966 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.90506 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.28418 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.49976 —
STP2-SMT-COMP-2012 default unsat ✅ 0.47452 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49502 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.55909 —
Z3-SMT-COMP-2011 default unsat ✅ 0.50879 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.92180 0.92086
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.13286 6.71098
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.12223 6.70098
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.66420 0.66390
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.50000
STP stp-cryptominisat4 default unsat ✅ 0.44204 0.44093
stp-cmsat4-v15 default unsat ✅ 0.44420 0.44293
stp-cmsat4-mt-v15 default unsat ✅ 0.44877 0.44793
stp-minisat-v15 default unsat ✅ 0.44426 0.44293
Yices2 Yices default unsat ✅ 0.18165 0.18097
Z3 z3 4.4.0 default unsat ✅ 0.51848 0.51892
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.81342 1.78002
ABC_glucose glucose unsat ✅ 1.80586 1.77581
Boolector Boolector boolector unsat ✅ 1.11816 1.11916
Boolector preprop boolector unsat ✅ 1.08794 1.08701
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.08280 6.64347
MapleSTP MapleSTP default unsat ✅ 0.42732 0.42755
MapleSTP-mt default unsat ✅ 0.43014 0.43028
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.61689 0.61817
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.60251 0.60281
Q3B Q3B default unsat ✅ 0.83250 2.10000
STP stp-cms-exp-2016 default unsat ✅ 0.43883 0.43899
stp-cms-mt-2016 default unsat ✅ 0.44985 0.44901
stp-cms-st-2016 default unsat ✅ 0.45003 0.44972
stp-minisat-st-2016 default unsat ✅ 0.44780 0.44797
Yices2 Yices-2.4.2 default unsat ✅ 0.18150 0.18153
Z3 z3-4.4.1 default unsat ✅ 0.49605 0.49755
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.88129 0.87944
Boolector SMT17 final boolector unsat ✅ 0.85100 0.84976
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.03946 6.48027
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.62608 0.62647
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.20342 1.20285
Q3B Q3B default unsat ✅ 0.78880 2.01412
STP stp_st default unsat ✅ 0.56877 0.56747
stp_mt default unsat ✅ 0.54710 0.54553
Yices2 Yices2-Main default unsat ✅ 0.17157 0.17101
Z3 z3-4.5.0 default unsat ✅ 0.65805 0.65699
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.75143 0.75125
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.71434 3.71413
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59916 0.60018
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.21590 1.21308
Minkeyrink ST_st unsat ✅ 1.21889 1.21515
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.55075 0.55080
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.55106 0.55092
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.55123 0.55128
Yices2 Yices 2.6.0_default unsat ✅ 0.16508 0.16496
Z3 z3-4.7.1_default unsat ✅ 0.54267 0.54250
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.15765 1.15756
MathSAT mathsat-5.6.6_default unsat ✅ 0.62945 0.62936
STP STP 2021.0_default unsat ✅ 0.53895 0.53891
Z3 z3-4.8.11_default unsat ✅ 0.43032 0.43021
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.16347 2.29336
Bitwuzla-wrapped_default unsat ✅ 1.25808 1.25793
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.89504 3.89487
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66569 0.66546
STP STP 2022.4_default unsat ✅ 0.58627 0.58626
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20730 0.20725
Z3++BV z3++bv_0702_default unsat ✅ 0.42641 0.42637
Z3 z3-4.8.17_default unsat ✅ 0.48702 0.48614
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.11570 1.01581
cvc5 cvc5 unsat ✅ 0.84109 0.74093
SMTInterpol SMTInterpol unknown ❌ 1202.74373 1450.57518
STP STP unsat ✅ 28.57842 28.47805
Yices2 Yices2 unsat ✅ 0.34901 0.24752
Z3alpha Z3-alpha unsat ✅ 0.53647 0.43694