Benchmark

non-incremental/QF_BV/sage/app7/bench_1292.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4420415
Compressed Size274250
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4420407
Compressed Size274256
Max. Term Depth16963
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2710 and1
=3490 let16749 extract1712 bvand45729
bvor30132 bvxor2276 bvadd49132 bvmul8
bvsub16105 bvsdiv23 bvult606 bvule632
bvslt219 bvsle124 bvshl15791 bvashr29848
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70379
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.65143
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.65317
abziz_portfolio_2012_minfeatures default unsat ✅ 0.65432
abziz_portfolio_2012_solvers default unsat ✅ 0.65512
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.64697
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94363
Boolector-SMT-COMP-2011 default unsat ✅ 1.06486
Boolector-SMT-COMP-2012 default unsat ✅ 0.99471
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 241.91400
CVC3-SMT-COMP-2011 default unsat ✅ 204.49100
CVC3-SMT-COMP-2012 default unsat ✅ 213.77000
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.66396
CVC4-SMT-EVAL-2013 default unsat ✅ 5.52275
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.31387
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.26859
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.66284
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.59399
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14746
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.50929
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.17994
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87021
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74030
STP2-SMT-COMP-2012 default unsat ✅ 0.70847
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76450
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.69216
Z3-SMT-COMP-2011 default unsat ✅ 0.64140
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.15525 1.15418
Boolector SMT17 final boolector unsat ✅ 1.20424 1.20342
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.76965 9.17438
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.85518 0.85567
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.69225 3.29138
Q3B Q3B default unsat ✅ 1.12074 2.94000
STP stp_st default unsat ✅ 0.83000 0.82907
stp_mt default unsat ✅ 0.84255 0.84250
Yices2 Yices2-Main default unsat ✅ 0.49045 0.48220
Z3 z3-4.5.0 default unsat ✅ 0.70096 0.70006
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04234 1.04230
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.27165 5.27132
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83102 0.83210
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.69435 1.69411
Minkeyrink ST_st unsat ✅ 1.69257 1.69243
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82392 0.82388
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82412 0.82415
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82253 0.82252
Yices2 Yices 2.6.0_default unsat ✅ 0.47617 0.47605
Z3 z3-4.7.1_default unsat ✅ 0.99269 0.99252
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.67551 1.67534
MathSAT mathsat-5.6.6_default unsat ✅ 0.87821 0.87813
STP STP 2021.0_default unsat ✅ 0.78761 0.78770
Z3 z3-4.8.11_default unsat ✅ 0.54546 0.54548
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.66091 1.66078
Bitwuzla-wrapped_default unsat ✅ 1.85037 1.85012
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.56963 5.56961
MathSAT MathSAT-5.6.8_default unsat ✅ 0.89599 0.89575
STP STP 2022.4_default unsat ✅ 0.85652 0.85528
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.49210 0.49205
Z3++BV z3++bv_0702_default unsat ✅ 0.56646 0.56637
Z3 z3-4.8.17_default unsat ✅ 0.58725 0.58741
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.56826 2.56786
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.20277 4.19777
STP STP 2022.4_default unsat ✅ 0.83874 0.83873
STP 2022.4_default unsat ✅ 0.84351 0.84347
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.06000 1338.90000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.48622 0.48617
Z3-Owl z3-Owl-Final_default unsat ✅ 1.47927 1.47929
z3-Owl-Final_default unsat ✅ 1.50446 1.50458