Benchmark

non-incremental/QF_BV/Sage2/bench_1811.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size74728
Compressed Size5653
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 74720
Compressed Size5664
Max. Term Depth42
Asserts 169
Declared Functions0
Declared Constants57
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not66 =75 let1546
bvor3 bvadd589 bvmul227 bvult23
bvule25 bvuge19 bvsgt7 bvsge19
bvshl102 zero_extend559

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 10.27900 10.27830
Boolector SMT17 final boolector unsat ✅ 16.11640 16.11170
CVC4 CVC4-smtcomp2017-main default unsat ✅ 153.05700 307.22100
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 221.09200 221.09200
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 31.30850 58.12000
Q3B Q3B default unknown ❌ 600.01500 1799.19000
STP stp_st default unsat ✅ 360.56500 360.53200
stp_mt default unsat ✅ 376.29900 1191.14000
Yices2 Yices2-Main default unsat ✅ 137.24200 137.23800
Z3 z3-4.5.0 default unsat ✅ 110.10800 110.10000
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 23.26640 23.26620
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 62.93690 62.93510
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 627.13400 627.08600
MinkeyRink Minkeyrink MT_mt unsat ✅ 25.59530 101.42200
Minkeyrink ST_st unsat ✅ 21.13230 21.13090
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 608.85500 608.84700
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 695.09900 2765.13000
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.08000 1200.03000
Yices2 Yices 2.6.0_default unsat ✅ 60.19990 60.19020
Z3 z3-4.7.1_default unsat ✅ 438.98200 438.99200
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 21.15660 21.15690
Poolector-wrapped-sq_default unsat ✅ 22.10580 87.17000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 34.56170 34.56140
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 73.44980 73.44020
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 81.22190 322.41300
MinkeyRink ST-wrapped-sq_default unsat ✅ 86.90030 86.89030
Par4 Par4-wrapped-sq_default unsat ✅ 23.89050 71.37000
STP STP-2019-wrapped-sq_default unknown ❌ 2400.01000 2400.03000
stp-mergesat-fixed-wrapped-sq_default unknown ❌ 2400.01000 2399.80000
stp-minisat-wrapped-sq_default unknown ❌ 2400.10000 2399.96000
stp-mt-wrapped-sq_default unknown ❌ 2400.07000 9536.90000
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.05000 7199.23000
stp-riss-wrapped-sq_default unknown ❌ 0.26448 0.26471
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 255.77100 255.77700
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 24.90350 24.89910
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 62.61430 62.61160
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2400.00000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 19.09000 19.09010
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 131.25000 131.23900
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 21.46970 21.46670
Boolector Boolector-wrapped-sq_default unsat ✅ 21.39240 21.39300
Poolector-wrapped-sq_default unsat ✅ 22.52970 88.65600
CVC4 CVC4-sq-final_default unsat ✅ 16.31490 16.31400
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1200.01000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.78000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08915 0.08939
MinkeyRink Solver 2020.3_default unsat ✅ 63.68370 252.56300
STP STP_default unsat ✅ 17.54100 69.32310
STP ++ Mergsat v1_default unsat ✅ 17.23800 17.23660
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 10.13310 10.13370
Z3 z3-4.8.8_default unsat ✅ 458.63900 458.61400
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 19.37450 19.37240
Bitwuzla-wrapped_default unsat ✅ 28.14800 28.14850
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 101.78900 101.75400
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.01000 1199.94000
STP STP 2022.4_default unsat ✅ 4.04381 4.04341
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 12.22800 12.22640
Z3++BV z3++bv_0702_default unsat ✅ 132.64200 132.62600
Z3 z3-4.8.17_default unsat ✅ 450.27500 450.18900
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 10.71698 10.61687
cvc5 cvc5 unsat ✅ 148.01690 147.91387
SMTInterpol SMTInterpol unsat ✅ 22.51980 45.40031
STP STP unsat ✅ 3.43308 3.33296
Yices2 Yices2 unsat ✅ 39.10972 38.98834
Z3alpha Z3-alpha unknown ❌ 1201.71294 1201.01150
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 2.86944 2.75181
Bitwuzla-MachBV-base unsat ✅ 10.82513 10.70459
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 11.73962 11.60689
BVDecide bv_decide unsat ✅ 20.28741 20.15226
bv_decide-nokernel unsat ✅ 17.78190 17.62880
cvc5 cvc5 unsat ✅ 94.24231 94.10013
SMTInterpol SMTInterpol unsat ✅ 8.60200 23.24925
Yices2 Yices2 unsat ✅ 6.39781 6.26908
Z3alpha Z3-alpha unsat ✅ 142.45766 568.24530
Z3 Z3-alpha-base unknown ❌ 1201.26179 1200.95214
Z3-Owl-base unknown ❌ 1201.29562 1200.94106
z3siri-base unknown ❌ 1201.27416 1201.02712
Z3-Owl Z3-Owl unknown ❌ 1201.75671 1200.97434