Benchmark

non-incremental/QF_BV/sage/app1/bench_2411.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size86479
Compressed Size12273
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 86471
Compressed Size12300
Max. Term Depth222
Asserts 1
Declared Functions0
Declared Constants320
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite94 not78 and1
=218 let212 extract1 bvand50
bvor192 bvadd413 bvmul5 bvsub301
bvult298 bvule651 bvslt2 bvsle72
bvshl193 bvashr5 zero_extend350

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.73045 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.28341 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.27938 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.28140 —
abziz_portfolio_2012_solvers default unsat ✅ 0.28288 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.28159 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.17284 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.37570 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.58284 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 59.39900 —
CVC3-SMT-COMP-2011 default unsat ✅ 56.54110 —
CVC3-SMT-COMP-2012 default unsat ✅ 57.47900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.73435 —
CVC4-SMT-EVAL-2013 default unsat ✅ 11.20560 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.53845 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 2.33976 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.51115 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.52129 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46036 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.65309 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.05507 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.26549 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04186 —
STP2-SMT-COMP-2012 default unsat ✅ 0.31789 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.10475 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.26653 —
Z3-SMT-COMP-2011 default unsat ✅ 0.27533 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.24100 0.23996
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.32788 2.58761
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.52940 3.00054
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.26933 1.26881
SMT-RAT SMT-RAT-final default unsat ✅ 168.88000 168.95100
STP stp-cryptominisat4 default unsat ✅ 0.24668 0.24596
stp-cmsat4-v15 default unsat ✅ 0.24780 0.24696
stp-cmsat4-mt-v15 default unsat ✅ 0.24759 0.24696
stp-minisat-v15 default unsat ✅ 0.24425 0.24296
Yices2 Yices default unsat ✅ 0.58672 0.58591
Z3 z3 4.4.0 default unsat ✅ 1.21762 1.21781
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 1.08206 1.08257
ABC_glucose glucose unsat ✅ 14.26590 14.27400
Boolector Boolector boolector unsat ✅ 0.20210 0.20129
Boolector preprop boolector unsat ✅ 0.20342 0.20383
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.44644 2.83520
MapleSTP MapleSTP default unsat ✅ 0.05360 0.05360
MapleSTP-mt default unsat ✅ 0.05304 0.05328
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.22809 1.22982
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.06543 0.06564
Q3B Q3B default unknown ❌ 2400.02000 7203.83000
STP stp-cms-exp-2016 default unsat ✅ 0.05292 0.05291
stp-cms-mt-2016 default unsat ✅ 0.05458 0.05474
stp-cms-st-2016 default unsat ✅ 0.05398 0.05430
stp-minisat-st-2016 default unsat ✅ 0.05354 0.05353
Yices2 Yices-2.4.2 default unsat ✅ 2.46659 2.46797
Z3 z3-4.4.1 default unsat ✅ 1.19195 1.19396
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.41069 0.40958
Boolector SMT17 final boolector unsat ✅ 0.29134 0.29005
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.23796 4.42093
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.07293 1.07292
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.05213 0.04493
Q3B Q3B default unknown ❌ 600.02600 1787.60000
STP stp_st default unsat ✅ 0.58265 0.58202
stp_mt default unsat ✅ 0.58668 0.58527
Yices2 Yices2-Main default unsat ✅ 0.12981 0.12975
Z3 z3-4.5.0 default unsat ✅ 1.33254 1.32769
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.45497 0.45483
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.31538 2.31551
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.13027 1.13097
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04616 0.04618
Minkeyrink ST_st unsat ✅ 0.04664 0.04668
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 3.79957 3.79945
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 3.79781 3.79791
STP-Riss-st-2018_riss-no-stderr unsat ✅ 3.79777 3.79750
Yices2 Yices 2.6.0_default unsat ✅ 0.05349 0.05339
Z3 z3-4.7.1_default unsat ✅ 0.83777 0.83751
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.57777 0.57766
MathSAT mathsat-5.6.6_default unsat ✅ 1.18793 1.18785
STP STP 2021.0_default unsat ✅ 0.35616 0.35626
Z3 z3-4.8.11_default unsat ✅ 1.58952 1.58952
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.84175 0.84164
Bitwuzla-wrapped_default unsat ✅ 0.92240 0.92233
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.15379 1.15340
MathSAT MathSAT-5.6.8_default unsat ✅ 2.14465 2.14448
STP STP 2022.4_default unsat ✅ 0.04424 0.04429
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.08303 0.08299
Z3++BV z3++bv_0702_default unsat ✅ 0.58900 0.58891
Z3 z3-4.8.17_default unsat ✅ 1.09662 1.09848
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.22239 2.22213
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.26816 1.26850
STP STP 2022.4_default unsat ✅ 0.04328 0.04333
STP 2022.4_default unsat ✅ 0.04352 0.04354
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1256.78000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.64312 0.64298
Z3-Owl z3-Owl-Final_default unsat ✅ 14.00460 14.00370
z3-Owl-Final_default unsat ✅ 14.12690 14.12800