Benchmark

non-incremental/QF_BV/sage/app7/bench_553.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3223218
Compressed Size202271
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3223210
Compressed Size202279
Max. Term Depth12348
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1953 and1
=2601 let12269 extract1417 bvand33739
bvor22284 bvxor1726 bvadd35730 bvmul1
bvsub11586 bvult462 bvule505 bvslt210
bvsle116 bvshl11405 bvashr21670 zero_extend1142

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48010 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.72623 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.71700 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.71919 —
abziz_portfolio_2012_solvers default unsat ✅ 0.72876 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.72241 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.64902 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79036 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.68570 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 348.88500 —
CVC3-SMT-COMP-2011 default unsat ✅ 291.90900 —
CVC3-SMT-COMP-2012 default unsat ✅ 304.07300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.70256 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.33614 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.96444 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.92401 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.19831 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.17353 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.83459 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.82027 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.05917 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.31087 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.50787 —
STP2-SMT-COMP-2012 default unsat ✅ 0.48307 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49487 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.74014 —
Z3-SMT-COMP-2011 default unsat ✅ 0.71648 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.94361 0.94285
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.21534 6.83996
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.20679 6.83296
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.67610 0.67490
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.96000
STP stp-cryptominisat4 default unsat ✅ 0.45199 0.45093
stp-cmsat4-v15 default unsat ✅ 0.45204 0.45093
stp-cmsat4-mt-v15 default unsat ✅ 0.44941 0.44893
stp-minisat-v15 default unsat ✅ 0.45039 0.44993
Yices2 Yices default unsat ✅ 0.18008 0.17897
Z3 z3 4.4.0 default unsat ✅ 0.48752 0.48792
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.81315 1.81467
ABC_glucose glucose unsat ✅ 1.80870 1.81008
Boolector Boolector boolector unsat ✅ 1.03477 1.03527
Boolector preprop boolector unsat ✅ 1.00449 1.00503
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.15119 6.74901
MapleSTP MapleSTP default unsat ✅ 0.43602 0.43623
MapleSTP-mt default unsat ✅ 0.43770 0.43801
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.61442 0.61575
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.61132 0.61162
Q3B Q3B default unsat ✅ 0.83889 2.01000
STP stp-cms-exp-2016 default unsat ✅ 0.43884 0.43903
stp-cms-mt-2016 default unsat ✅ 0.45371 0.45424
stp-cms-st-2016 default unsat ✅ 0.45409 0.45429
stp-minisat-st-2016 default unsat ✅ 0.44436 0.44473
Yices2 Yices-2.4.2 default unsat ✅ 0.17734 0.17755
Z3 z3-4.4.1 default unsat ✅ 0.59468 0.59616
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86048 0.85918
Boolector SMT17 final boolector unsat ✅ 0.86233 0.86218
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.14216 6.64866
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.62696 0.62687
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.22825 1.22712
Q3B Q3B default unsat ✅ 0.81356 2.08000
STP stp_st default unsat ✅ 0.55889 0.55752
stp_mt default unsat ✅ 0.55640 0.55551
Yices2 Yices2-Main default unsat ✅ 0.16654 0.16556
Z3 z3-4.5.0 default unsat ✅ 0.57953 0.57875
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77641 0.77636
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.83819 3.83829
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.61389 0.61508
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.25029 1.25030
Minkeyrink ST_st unsat ✅ 1.27494 1.27502
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56183 0.56183
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.56129 0.56127
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56211 0.56216
Yices2 Yices 2.6.0_default unsat ✅ 0.15961 0.15954
Z3 z3-4.7.1_default unsat ✅ 0.71852 0.71839
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.50969 1.50850
Poolector-wrapped-sq_default unsat ✅ 1.79557 6.60000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.20708 1.20687
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.98882 3.98871
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.87074 0.87082
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.87175 0.87127
Par4 Par4-wrapped-sq_default unsat ✅ 0.17241 0.00595
STP STP-2019-wrapped-sq_default unsat ✅ 0.57781 0.57518
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.56767 0.56778
stp-minisat-wrapped-sq_default unsat ✅ 0.57379 0.57390
stp-mt-wrapped-sq_default unsat ✅ 0.58713 0.57847
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.57025 0.57029
stp-riss-wrapped-sq_default unsat ✅ 0.57505 0.57514
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.16806 0.16807
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.16917 0.16916
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.16821 0.16819
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.16629 0.16630
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.16881 0.16881
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.53896 0.53893
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.96994 0.83913
Bitwuzla-MachBV-base unsat ✅ 1.16177 1.03937
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.39145 1.26460
BVDecide bv_decide unknown ❌ 1201.39065 1201.05019
bv_decide-nokernel unknown ❌ 1201.38631 1201.02017
cvc5 cvc5 unsat ✅ 1.06822 0.94509
SMTInterpol SMTInterpol unknown ❌ 1201.87255 2170.93067
Yices2 Yices2 unsat ✅ 0.38751 0.25894
Z3alpha Z3-alpha unsat ✅ 0.95385 0.93538
Z3 Z3-alpha-base unsat ✅ 0.54626 0.42394
Z3-Owl-base unsat ✅ 1.53045 1.40269
z3siri-base unsat ✅ 0.56056 0.43487
Z3-Owl Z3-Owl unsat ✅ 1.06197 0.94042