Benchmark

non-incremental/QF_BV/sage/app7/bench_561.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3223338
Compressed Size200369
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3223330
Compressed Size200373
Max. Term Depth12347
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1949 and1
=2596 let12242 extract1415 bvand33607
bvor22194 bvxor1720 bvadd35595 bvmul1
bvsub11542 bvult461 bvule505 bvslt210
bvsle116 bvshl11362 bvashr21584 zero_extend1140

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48233 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.48376 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.48628 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.48461 —
abziz_portfolio_2012_solvers default unsat ✅ 0.48812 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.49606 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.64542 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.77585 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.68450 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 171.97800 —
CVC3-SMT-COMP-2011 default unsat ✅ 145.49200 —
CVC3-SMT-COMP-2012 default unsat ✅ 152.17700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.76888 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.32192 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.96889 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.92763 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.20109 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.16886 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.84884 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.80615 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.03774 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.30598 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51175 —
STP2-SMT-COMP-2012 default unsat ✅ 0.48300 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.51029 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.53251 —
Z3-SMT-COMP-2011 default unsat ✅ 0.48799 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.93348 0.93286
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.21527 6.82796
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.21074 6.83496
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.67437 0.67390
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.09000
STP stp-cryptominisat4 default unsat ✅ 0.44964 0.44893
stp-cmsat4-v15 default unsat ✅ 0.45043 0.44993
stp-cmsat4-mt-v15 default unsat ✅ 0.45201 0.45093
stp-minisat-v15 default unsat ✅ 0.44906 0.44793
Yices2 Yices default unsat ✅ 0.18721 0.18597
Z3 z3 4.4.0 default unsat ✅ 0.53290 0.53292
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.82244 1.82309
ABC_glucose glucose unsat ✅ 1.80893 1.81005
Boolector Boolector boolector unsat ✅ 1.05666 1.05739
Boolector preprop boolector unsat ✅ 1.01810 1.01862
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.18355 6.80242
MapleSTP MapleSTP default unsat ✅ 0.44005 0.44028
MapleSTP-mt default unsat ✅ 0.43818 0.43831
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.89743 0.89968
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.60814 0.60830
Q3B Q3B default unsat ✅ 0.85574 2.19000
STP stp-cms-exp-2016 default unsat ✅ 0.43818 0.43867
stp-cms-mt-2016 default unsat ✅ 0.45198 0.45223
stp-cms-st-2016 default unsat ✅ 0.45247 0.45268
stp-minisat-st-2016 default unsat ✅ 0.44772 0.44791
Yices2 Yices-2.4.2 default unsat ✅ 0.18454 0.18457
Z3 z3-4.4.1 default unsat ✅ 0.52486 0.52482
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86015 0.86005
Boolector SMT17 final boolector unsat ✅ 0.84112 0.84111
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.41454 7.12300
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63037 0.63023
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.21406 1.21014
Q3B Q3B default unsat ✅ 0.84782 0.84466
STP stp_st default unsat ✅ 0.60850 0.60376
stp_mt default unsat ✅ 0.60154 0.60038
Yices2 Yices2-Main default unsat ✅ 0.17520 0.17346
Z3 z3-4.5.0 default unsat ✅ 0.48808 0.48771
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.76536 0.76534
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.82580 3.82586
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.61759 0.61865
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.22730 1.22712
Minkeyrink ST_st unsat ✅ 1.22920 1.22923
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56375 0.56379
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.55968 0.55969
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56339 0.56337
Yices2 Yices 2.6.0_default unsat ✅ 0.16683 0.16677
Z3 z3-4.7.1_default unsat ✅ 0.75479 0.75463
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.19952 1.19926
Boolector Boolector-wrapped-sq_default unsat ✅ 1.45106 1.45095
Poolector-wrapped-sq_default unsat ✅ 1.68677 6.14000
CVC4 CVC4-sq-final_default unsat ✅ 5.23792 5.23775
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.77334 0.77331
MathSAT MathSAT5_default.sh unsat ✅ 0.63558 0.63549
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.71346 0.71352
MinkeyRink Solver 2020.3_default unsat ✅ 0.73506 0.73524
STP STP_default unsat ✅ 0.53153 0.53167
STP ++ Mergsat v1_default unsat ✅ 0.52670 0.52833
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.21087 0.21076
Z3 z3-4.8.8_default unsat ✅ 0.38299 0.38288
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.86900 1.86869
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.92584 2.92620
STP STP 2022.4_default unsat ✅ 0.58628 0.58630
STP 2022.4_default unsat ✅ 0.58643 0.58640
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 770.52300 879.46500
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.20362 0.20355
Z3-Owl z3-Owl-Final_default unsat ✅ 1.09139 1.09136
z3-Owl-Final_default unsat ✅ 1.10172 1.10206
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.92835 0.80413
Bitwuzla-MachBV-base unsat ✅ 1.17981 1.05630
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.34907 1.22030
BVDecide bv_decide unknown ❌ 1201.39178 1201.04248
bv_decide-nokernel unknown ❌ 1201.39349 1200.95235
cvc5 cvc5 unsat ✅ 0.99032 0.86620
SMTInterpol SMTInterpol unknown ❌ 1201.89100 2270.79850
Yices2 Yices2 unsat ✅ 0.38078 0.25909
Z3alpha Z3-alpha unsat ✅ 0.97318 0.94469
Z3 Z3-alpha-base unsat ✅ 0.53368 0.39927
Z3-Owl-base unsat ✅ 1.24059 1.12507
z3siri-base unsat ✅ 0.51800 0.38978
Z3-Owl Z3-Owl unsat ✅ 1.00352 0.88430