Benchmark

non-incremental/QF_BV/sage/app1/bench_2114.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size74501
Compressed Size10768
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 74493
Compressed Size10766
Max. Term Depth179
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite79 not73 and1
=191 let169 extract1 bvand40
bvor171 bvadd367 bvmul5 bvsub240
bvult258 bvule561 bvslt2 bvsle47
bvshl172 bvashr5 zero_extend307

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.86151 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04651 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.04748 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unsat ✅ 0.04685 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.04629 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11732 —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unsat ✅ 0.11192 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.35098 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unsat ✅ 2.08590 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.58794 —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.35879 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.82266 —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.34378 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.26586 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.76916 —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03531 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04457 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.08634 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03453 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04152 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02244 0.02100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.04636 2.03569
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.04766 2.04369
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.90842 0.90786
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.21000
STP stp-cryptominisat4 default unsat ✅ 0.05095 0.04999
stp-cmsat4-v15 default unsat ✅ 0.04946 0.04799
stp-cmsat4-mt-v15 default unsat ✅ 0.04939 0.04799
stp-minisat-v15 default unsat ✅ 0.04884 0.04799
Yices2 Yices default unsat ✅ 0.04236 0.04099
Z3 z3 4.4.0 default unsat ✅ 0.33275 0.33295
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.89179 0.89206
ABC_glucose glucose unsat ✅ 11.68100 11.67160
Boolector Boolector boolector unsat ✅ 0.02632 0.02631
Boolector preprop boolector unsat ✅ 0.02571 0.02609
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.03635 2.02287
MapleSTP MapleSTP default unsat ✅ 0.03827 0.03840
MapleSTP-mt default unsat ✅ 0.04009 0.03889
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.75424 0.75576
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.05088 0.05085
Q3B Q3B default unsat ✅ 0.44089 1.04865
STP stp-cms-exp-2016 default unsat ✅ 0.03902 0.03898
stp-cms-mt-2016 default unsat ✅ 0.03945 0.03942
stp-cms-st-2016 default unsat ✅ 0.03817 0.03875
stp-minisat-st-2016 default unsat ✅ 0.03845 0.03843
Yices2 Yices-2.4.2 default unsat ✅ 0.04235 0.04235
Z3 z3-4.4.1 default unsat ✅ 0.33150 0.33288
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02790 0.02699
Boolector SMT17 final boolector unsat ✅ 0.02720 0.02674
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.96949 1.87958
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.87868 0.87892
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04211 0.04148
Q3B Q3B default unsat ✅ 0.46427 0.94037
STP stp_st default unsat ✅ 0.05458 0.05455
stp_mt default unsat ✅ 0.05726 0.05638
Yices2 Yices2-Main default unsat ✅ 0.03847 0.03791
Z3 z3-4.5.0 default unsat ✅ 0.35548 0.35540
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01817 0.01815
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.24204 2.24150
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67842 0.67932
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04346 0.04348
Minkeyrink ST_st unsat ✅ 0.04344 0.04352
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.07253 0.07262
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.07298 0.07299
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.07309 0.07313
Yices2 Yices 2.6.0_default unsat ✅ 0.04147 0.04141
Z3 z3-4.7.1_default unsat ✅ 0.35831 0.35817
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03705 0.03698
Boolector Boolector-wrapped-sq_default unsat ✅ 0.04213 0.04213
Poolector-wrapped-sq_default unsat ✅ 0.17999 0.26158
CVC4 CVC4-sq-final_default unsat ✅ 1.02553 1.02568
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 131.55700 131.53200
MathSAT MathSAT5_default.sh unsat ✅ 0.46119 0.46110
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.04247 0.04260
MinkeyRink Solver 2020.3_default unsat ✅ 0.04525 0.04532
STP STP_default unsat ✅ 0.05141 0.05153
STP ++ Mergsat v1_default unsat ✅ 0.04673 0.04836
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04596 0.04592
Z3 z3-4.8.8_default unsat ✅ 0.30250 0.30246
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03829 0.03823
Bitwuzla-wrapped_default unsat ✅ 0.04124 0.04120
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.88419 0.88474
MathSAT MathSAT-5.6.8_default unsat ✅ 0.55829 0.55824
STP STP 2022.4_default unsat ✅ 0.04019 0.04023
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04425 0.04422
Z3++BV z3++bv_0702_default unsat ✅ 0.44996 0.44987
Z3 z3-4.8.17_default unsat ✅ 0.52522 0.52689