Benchmark

non-incremental/QF_BV/sage/app8/bench_3775.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size35541
Compressed Size6095
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 35533
Compressed Size6112
Max. Term Depth95
Asserts 1
Declared Functions0
Declared Constants166
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite1 not110 and1
=207 let85 extract21 bvand27
bvor72 bvadd243 bvsub64 bvult113
bvule187 bvsle3 bvshl79 zero_extend161

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.34332 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.16472 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.16400 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.16518 —
abziz_portfolio_2012_solvers default unsat ✅ 0.16609 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.16404 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.05324 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.06352 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.04899 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 15.77830 —
CVC3-SMT-COMP-2011 default unsat ✅ 14.82040 —
CVC3-SMT-COMP-2012 default unsat ✅ 15.18610 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.38099 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.44683 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.18079 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.37999 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.13593 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.17528 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.08331 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.11497 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.30700 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.07862 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03278 —
STP2-SMT-COMP-2012 default unsat ✅ 0.02232 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.05336 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.16993 —
Z3-SMT-COMP-2011 default unsat ✅ 0.15918 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.08186 0.08099
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.65800 1.28180
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.68832 1.34380
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.32161 0.32095
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.52000
STP stp-cryptominisat4 default unsat ✅ 0.02933 0.02799
stp-cmsat4-v15 default unsat ✅ 0.02802 0.02700
stp-cmsat4-mt-v15 default unsat ✅ 0.02820 0.02700
stp-minisat-v15 default unsat ✅ 0.02780 0.02700
Yices2 Yices default unsat ✅ 0.02021 0.01900
Z3 z3 4.4.0 default unsat ✅ 0.21670 0.21697
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.39787 0.39774
ABC_glucose glucose unsat ✅ 4.61740 4.62059
Boolector Boolector boolector unsat ✅ 0.08610 0.08611
Boolector preprop boolector unsat ✅ 0.09735 0.09735
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.68512 1.33683
MapleSTP MapleSTP default unsat ✅ 0.02713 0.02636
MapleSTP-mt default unsat ✅ 0.02659 0.02650
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.20164 0.20285
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.03278 0.03272
Q3B Q3B default unknown ❌ 2400.11000 7203.40000
STP stp-cms-exp-2016 default unsat ✅ 0.02687 0.02681
stp-cms-mt-2016 default unsat ✅ 0.02676 0.02675
stp-cms-st-2016 default unsat ✅ 0.02692 0.02690
stp-minisat-st-2016 default unsat ✅ 0.02654 0.02648
Yices2 Yices-2.4.2 default unsat ✅ 0.02101 0.02100
Z3 z3-4.4.1 default unsat ✅ 0.24403 0.24547
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.27428 0.26588
Boolector SMT17 final boolector unsat ✅ 0.23692 0.23539
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.11647 1.26564
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.34445 0.34341
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.02908 0.02880
Q3B Q3B default unknown ❌ 600.08400 1786.38000
STP stp_st default unsat ✅ 0.07183 0.07101
stp_mt default unsat ✅ 0.06800 0.06721
Yices2 Yices2-Main default unsat ✅ 0.01649 0.01567
Z3 z3-4.5.0 default unsat ✅ 0.24257 0.24087
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.14923 0.14911
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.32705 1.32713
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.27333 0.27435
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.02824 0.02821
Minkeyrink ST_st unsat ✅ 0.02771 0.02772
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.07305 0.07308
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.07305 0.07310
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.07384 0.07389
Yices2 Yices 2.6.0_default unsat ✅ 0.01898 0.01891
Z3 z3-4.7.1_default unsat ✅ 0.26204 0.26192
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.33762 0.33754
Boolector Boolector-wrapped-sq_default unsat ✅ 0.29766 0.29761
Poolector-wrapped-sq_default unsat ✅ 0.18002 0.18479
CVC4 CVC4-sq-final_default unsat ✅ 0.59667 0.59679
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1200.00000
MathSAT MathSAT5_default.sh unsat ✅ 0.10643 0.10638
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.02785 0.02799
MinkeyRink Solver 2020.3_default unsat ✅ 0.02951 0.02964
STP STP_default unsat ✅ 0.06733 0.06742
STP ++ Mergsat v1_default unsat ✅ 0.06253 0.06413
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01809 0.01798
Z3 z3-4.8.8_default unsat ✅ 0.29709 0.29702
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.26179 0.26177
MathSAT mathsat-5.6.6_default unsat ✅ 0.17354 0.17348
STP STP 2021.0_default unsat ✅ 0.07264 0.07274
Z3 z3-4.8.11_default unsat ✅ 0.36960 0.36956
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.34184 0.24145
cvc5 cvc5 unsat ✅ 1.43241 1.33199
SMTInterpol SMTInterpol unsat ✅ 209.77625 239.09750
STP STP unsat ✅ 0.25028 0.15053
Yices2 Yices2 unsat ✅ 0.23930 0.13944
Z3alpha Z3-alpha unsat ✅ 0.36156 0.26178