Benchmark

non-incremental/QF_BV/sage/app11/bench_567.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1528454
Compressed Size150619
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1528446
Compressed Size150627
Max. Term Depth4208
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1271
and1 =2050 let2875 extract1481
bvand954 bvor271 bvxor2269 bvadd14614
bvmul1181 bvsdiv16 bvult1094 bvule1497
bvslt123 bvsle162 bvshl8906 bvashr13272
zero_extend10172

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16414 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40830 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40753 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40576 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40529 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40624 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21691 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30043 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24640 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.83470 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.27770 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.27140 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.69764 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.47570 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45978 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44829 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.11530 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54973 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.47019 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.91186 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.80761 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54977 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.07779 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17359 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25074 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.43698 —
Z3-SMT-COMP-2011 default unsat ✅ 0.39927 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32804 0.32732
Boolector SMT17 final boolector unsat ✅ 0.32239 0.32127
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.56051 6.35842
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.28347 0.28377
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.69245 0.69121
Q3B Q3B default unsat ✅ 19.65520 58.46000
STP stp_st default unsat ✅ 12.90250 12.90150
stp_mt default unsat ✅ 12.90300 12.90210
Yices2 Yices2-Main default unsat ✅ 0.13419 0.13275
Z3 z3-4.5.0 default unsat ✅ 0.35204 0.35023
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29156 0.29146
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.29151 3.29144
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.31422 0.31531
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68442 0.68441
Minkeyrink ST_st unsat ✅ 0.68035 0.68042
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 6.55235 6.55183
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 6.54597 6.54548
STP-Riss-st-2018_riss-no-stderr unsat ✅ 6.51230 6.51221
Yices2 Yices 2.6.0_default unsat ✅ 0.11955 0.11950
Z3 z3-4.7.1_default unsat ✅ 0.30814 0.30780
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.57463 0.57459
Poolector-wrapped-sq_default unsat ✅ 0.78556 2.85892
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.50450 0.50442
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.32824 3.32847
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.36412 1.36436
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.34944 1.34958
Par4 Par4-wrapped-sq_default unsat ✅ 0.13240 0.00607
STP STP-2019-wrapped-sq_default unsat ✅ 19.78760 19.78800
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 19.60510 19.60390
stp-minisat-wrapped-sq_default unsat ✅ 19.64360 19.64140
stp-mt-wrapped-sq_default unsat ✅ 19.73000 19.72950
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 19.62610 19.62740
stp-riss-wrapped-sq_default unsat ✅ 19.65260 19.65250
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12792 0.12785
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12625 0.12629
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12735 0.12735
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12616 0.12615
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12596 0.12598
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.32855 0.32851
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41961 0.41957
Bitwuzla-wrapped_default unsat ✅ 0.43979 0.43972
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.12941 4.12774
MathSAT MathSAT-5.6.8_default unsat ✅ 33.18700 33.17890
STP STP 2022.4_default unsat ✅ 0.23947 0.23661
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.13773 0.13771
Z3++BV z3++bv_0702_default unsat ✅ 0.36152 0.36139
Z3 z3-4.8.17_default unsat ✅ 0.31049 0.31227
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.58454 0.58433
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.35271 3.34788
STP STP 2022.4_default unsat ✅ 0.19204 0.19210
STP 2022.4_default unsat ✅ 0.18905 0.18910
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1236.75000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13623 0.13619
Z3-Owl z3-Owl-Final_default unsat ✅ 0.91198 0.91190
z3-Owl-Final_default unsat ✅ 0.92968 0.92893
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.80719 0.70750
cvc5 cvc5 unsat ✅ 1.63383 1.53386
SMTInterpol SMTInterpol unknown ❌ 1202.76842 2109.85774
STP STP unsat ✅ 8.98177 8.87156
Yices2 Yices2 unsat ✅ 0.30571 0.20539
Z3alpha Z3-alpha unsat ✅ 0.49132 0.39116