Benchmark

non-incremental/QF_BV/sage/app7/bench_1460.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1564329
Compressed Size115701
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1564321
Compressed Size115707
Max. Term Depth5996
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1613 and1
=2185 let5939 extract1244 bvand15218
bvor9863 bvxor1447 bvadd16799 bvmul1
bvsub5431 bvult437 bvule473 bvslt204
bvsle99 bvshl5262 bvashr9546 zero_extend957

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.22058 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.23969 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.23952 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.24700 —
abziz_portfolio_2012_solvers default unsat ✅ 0.24234 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.24049 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.29950 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.36252 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.31554 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 51.55000 —
CVC3-SMT-COMP-2011 default unsat ✅ 43.66570 —
CVC3-SMT-COMP-2012 default unsat ✅ 45.61040 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.26470 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.08761 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.47060 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44623 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.60060 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.57560 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.42433 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.30670 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.83247 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.61231 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23347 —
STP2-SMT-COMP-2012 default unsat ✅ 0.22630 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.22628 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.25459 —
Z3-SMT-COMP-2011 default unsat ✅ 0.23376 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.42685 0.42593
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.07168 3.38349
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.07424 3.39148
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.33597 0.33495
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.95000
STP stp-cryptominisat4 default unsat ✅ 0.21168 0.21097
stp-cmsat4-v15 default unsat ✅ 0.21002 0.20897
stp-cmsat4-mt-v15 default unsat ✅ 0.21139 0.20997
stp-minisat-v15 default unsat ✅ 0.20908 0.20797
Yices2 Yices default unsat ✅ 0.09557 0.09498
Z3 z3 4.4.0 default unsat ✅ 0.28414 0.28396
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.89172 0.89229
ABC_glucose glucose unsat ✅ 0.89380 0.88283
Boolector Boolector boolector unsat ✅ 0.53682 0.53715
Boolector preprop boolector unsat ✅ 0.52696 0.52716
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.04078 3.34138
MapleSTP MapleSTP default unsat ✅ 0.20071 0.20076
MapleSTP-mt default unsat ✅ 0.20093 0.20093
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.30141 0.30257
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.27076 0.27087
Q3B Q3B default unsat ✅ 0.50770 0.50860
STP stp-cms-exp-2016 default unsat ✅ 0.20505 0.20506
stp-cms-mt-2016 default unsat ✅ 0.21197 0.21199
stp-cms-st-2016 default unsat ✅ 0.20760 0.20813
stp-minisat-st-2016 default unsat ✅ 0.20801 0.20809
Yices2 Yices-2.4.2 default unsat ✅ 0.09499 0.09500
Z3 z3-4.4.1 default unsat ✅ 0.31256 0.31400
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.41785 0.41459
Boolector SMT17 final boolector unsat ✅ 0.40457 0.40330
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.07513 3.36081
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.31681 0.31507
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.61755 0.61672
Q3B Q3B default unsat ✅ 0.50455 0.86936
STP stp_st default unsat ✅ 0.27608 0.27450
stp_mt default unsat ✅ 0.28747 0.28575
Yices2 Yices2-Main default unsat ✅ 0.09180 0.09046
Z3 z3-4.5.0 default unsat ✅ 0.34405 0.34124
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.34943 0.34934
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.89574 1.89596
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.30200 0.30312
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.61057 0.61051
Minkeyrink ST_st unsat ✅ 0.61159 0.61158
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.25756 0.25756
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.25684 0.25683
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.25712 0.25712
Yices2 Yices 2.6.0_default unsat ✅ 0.08916 0.08898
Z3 z3-4.7.1_default unsat ✅ 0.30223 0.30208
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.67919 0.67912
Poolector-wrapped-sq_default unsat ✅ 0.88332 3.11312
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.54692 0.54688
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.92663 1.92677
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.45948 0.45965
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.45626 0.45630
Par4 Par4-wrapped-sq_default unsat ✅ 0.10046 0.00599
STP STP-2019-wrapped-sq_default unsat ✅ 0.26743 0.26760
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.26565 0.26573
stp-minisat-wrapped-sq_default unsat ✅ 0.26793 0.26807
stp-mt-wrapped-sq_default unsat ✅ 0.26839 0.26853
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.26631 0.26648
stp-riss-wrapped-sq_default unsat ✅ 0.26701 0.26712
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.09164 0.09164
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09145 0.09144
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.09181 0.09179
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09038 0.09038
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.09169 0.09168
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.29983 0.29977
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53381 0.53375
MathSAT mathsat-5.6.6_default unsat ✅ 0.32044 0.32040
STP STP 2021.0_default unsat ✅ 0.25522 0.25533
Z3 z3-4.8.11_default unsat ✅ 0.20214 0.20204
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90531 0.90519
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.43009 1.43051
STP STP 2022.4_default unsat ✅ 0.27055 0.27060
STP 2022.4_default unsat ✅ 0.27033 0.27036
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 501.23900 565.80600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10549 0.10542
Z3-Owl z3-Owl-Final_default unsat ✅ 1.07022 1.06700
z3-Owl-Final_default unsat ✅ 1.01818 1.01817
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.58585 0.48563
cvc5 cvc5 unsat ✅ 0.90047 0.80123
SMTInterpol SMTInterpol unsat ✅ 1016.58590 1468.73312
STP STP unsat ✅ 7.81886 7.71442
Yices2 Yices2 unsat ✅ 0.29717 0.19751
Z3alpha Z3-alpha unsat ✅ 0.39380 0.29421
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.61885 0.49221
Bitwuzla-MachBV-base unsat ✅ 0.64456 0.51801
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.77434 0.65011
BVDecide bv_decide unsat ✅ 433.62607 433.42374
bv_decide-nokernel unsat ✅ 385.64915 385.49626
cvc5 cvc5 unsat ✅ 0.58533 0.47109
SMTInterpol SMTInterpol unknown ❌ 1201.88836 3005.20846
Yices2 Yices2 unsat ✅ 0.31088 0.19178
Z3alpha Z3-alpha unsat ✅ 0.63520 0.54859
Z3 Z3-alpha-base unsat ✅ 0.44939 0.32293
Z3-Owl-base unsat ✅ 0.94672 0.82595
z3siri-base unsat ✅ 0.43137 0.30246
Z3-Owl Z3-Owl unsat ✅ 0.95756 0.82504