Benchmark

non-incremental/QF_BV/sage/app7/bench_1414.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4402981
Compressed Size273829
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4402973
Compressed Size273835
Max. Term Depth16935
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2703 and1
=3481 let16721 extract1712 bvand45725
bvor30130 bvxor2276 bvadd49116 bvmul7
bvsub16104 bvsdiv22 bvult604 bvule632
bvslt219 bvsle124 bvshl15791 bvashr29845
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70023 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.93427 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.94005 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.94062 —
abziz_portfolio_2012_solvers default unsat ✅ 0.93835 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.92985 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94507 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.08530 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.99542 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 258.89100 —
CVC3-SMT-COMP-2011 default unsat ✅ 218.93100 —
CVC3-SMT-COMP-2012 default unsat ✅ 228.98100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.60587 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.53942 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.29138 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.24382 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.62863 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.59903 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.13398 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.55269 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.17391 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.85537 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.73520 —
STP2-SMT-COMP-2012 default unsat ✅ 0.71038 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.75324 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.93697 —
Z3-SMT-COMP-2011 default unsat ✅ 0.92936 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.19814 1.19648
Boolector SMT17 final boolector unsat ✅ 1.21869 1.21717
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.64471 8.96143
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.83991 0.84038
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.70981 1.70824
Q3B Q3B default unsat ✅ 1.08320 2.72000
STP stp_st default unsat ✅ 0.79774 0.79706
stp_mt default unsat ✅ 0.86128 0.86057
Yices2 Yices2-Main default unsat ✅ 0.26702 0.26643
Z3 z3-4.5.0 default unsat ✅ 0.82657 0.81998
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.05443 1.05423
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.30737 5.30781
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.81968 0.82068
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.71175 1.71185
Minkeyrink ST_st unsat ✅ 1.70615 1.70403
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82026 0.82019
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82036 0.82026
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.81985 0.81971
Yices2 Yices 2.6.0_default unsat ✅ 0.25523 0.25516
Z3 z3-4.7.1_default unsat ✅ 1.02081 1.02071
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.12266 2.12271
Poolector-wrapped-sq_default unsat ✅ 2.51887 9.46915
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.69461 3.30441
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.56801 5.56860
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.17135 1.17132
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.16857 1.16857
Par4 Par4-wrapped-sq_default unsat ✅ 0.26897 0.00570
STP STP-2019-wrapped-sq_default unsat ✅ 0.81729 0.81738
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.81147 0.81167
stp-minisat-wrapped-sq_default unsat ✅ 0.82745 0.82752
stp-mt-wrapped-sq_default unsat ✅ 0.82064 0.82072
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.80564 0.80583
stp-riss-wrapped-sq_default unsat ✅ 0.81755 0.81763
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.26274 0.26277
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.26377 0.26376
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.26351 0.26346
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.26101 0.26102
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.26306 0.26289
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.88654 0.88648
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.65302 3.21302
Bitwuzla-wrapped_default unsat ✅ 1.85424 1.85422
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.64776 5.64797
MathSAT MathSAT-5.6.8_default unsat ✅ 0.88105 0.88021
STP STP 2022.4_default unsat ✅ 0.86563 0.86383
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.31087 0.31083
Z3++BV z3++bv_0702_default unsat ✅ 0.92953 0.92935
Z3 z3-4.8.17_default unsat ✅ 0.86480 0.86628
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.60766 2.60726
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.23463 4.23223
STP STP 2022.4_default unsat ✅ 0.83163 0.83166
STP 2022.4_default unsat ✅ 0.82935 0.82928
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.08000 1347.14000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.30209 0.30203
Z3-Owl z3-Owl-Final_default unsat ✅ 1.45769 1.45710
z3-Owl-Final_default unsat ✅ 1.48733 1.48601
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.43886 1.33910
cvc5 cvc5 unsat ✅ 2.20230 2.10054
SMTInterpol SMTInterpol unknown ❌ 1202.72075 1438.57105
STP STP unsat ✅ 69.23391 69.08228
Yices2 Yices2 unsat ✅ 0.43158 0.33134
Z3alpha Z3-alpha unsat ✅ 0.66119 0.56185
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.19721 1.06826
Bitwuzla-MachBV-base unsat ✅ 1.47381 1.34741
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.69827 1.56983
BVDecide bv_decide unknown ❌ 1201.38697 1201.00008
bv_decide-nokernel unknown ❌ 1201.38826 1201.03321
cvc5 cvc5 unsat ✅ 1.56018 1.42902
SMTInterpol SMTInterpol unknown ❌ 1201.89756 1646.65983
Yices2 Yices2 unsat ✅ 0.41867 0.30090
Z3alpha Z3-alpha unsat ✅ 1.06221 1.07719
Z3 Z3-alpha-base unsat ✅ 0.75706 0.63218
Z3-Owl-base unsat ✅ 2.44490 2.32213
z3siri-base unsat ✅ 0.81069 0.68194
Z3-Owl Z3-Owl unsat ✅ 1.31450 1.18885