Benchmark

non-incremental/QF_BV/Sage2/bench_16377.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size35107
Compressed Size2001
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 35099
Compressed Size1994
Max. Term Depth30
Asserts 88
Declared Functions0
Declared Constants9
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not19 =20 let796
bvadd465 bvmul4 bvult15 bvule31
bvugt2 bvuge19 bvlshr9 zero_extend299

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07633 0.07523
Boolector SMT17 final boolector unsat ✅ 0.31992 0.31941
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.87322 1.71932
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08558 0.08558
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.10499 0.07263
Q3B Q3B default unsat ✅ 0.47021 1.12536
STP stp_st default unsat ✅ 0.42870 0.42849
stp_mt default unsat ✅ 1.04514 1.77616
Yices2 Yices2-Main default unsat ✅ 0.00795 0.00702
Z3 z3-4.5.0 default unsat ✅ 505.30000 505.27300
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04348 0.04344
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.16299 0.16312
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08092 0.08197
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.05731 0.06430
Minkeyrink ST_st unsat ✅ 0.05136 0.05156
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.38406 0.38424
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.37710 1.32931
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.76135 0.76128
Yices2 Yices 2.6.0_default unsat ✅ 0.00940 0.00934
Z3 z3-4.7.1_default unsat ✅ 20.49990 20.50070
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.08715 0.08715
Poolector-wrapped-sq_default unsat ✅ 0.17899 0.20260
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.16540 0.16538
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.09961 0.09987
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04080 0.04531
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.03778 0.03787
Par4 Par4-wrapped-sq_default unsat ✅ 0.01940 0.00758
STP STP-2019-wrapped-sq_default unsat ✅ 0.41781 0.41811
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 5.13641 5.13639
stp-minisat-wrapped-sq_default unsat ✅ 0.41426 0.41450
stp-mt-wrapped-sq_default unsat ✅ 0.41729 1.45354
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 5.04309 5.77026
stp-riss-wrapped-sq_default unknown ❌ 0.06101 0.06123
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01034 0.01035
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01441 0.01443
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01269 0.01266
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.08000 2399.75000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01514 0.01515
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 125.49200 125.44100
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.12582 0.12576
MathSAT mathsat-5.6.6_default unsat ✅ 0.04574 0.04572
STP STP 2021.0_default unsat ✅ 0.03453 0.03948
Z3 z3-4.8.11_default unsat ✅ 1055.53000 1055.46000
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03878 0.03876
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.44127 0.44168
STP STP 2022.4_default unsat ✅ 0.03217 0.03218
STP 2022.4_default unsat ✅ 0.03340 0.03346
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.72206 12.72440
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01056 0.00877
Z3-Owl z3-Owl-Final_default unsat ✅ 1103.57000 1103.40000
z3-Owl-Final_default unsat ✅ 168.77000 168.76000
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23024 0.13109
cvc5 cvc5 unsat ✅ 0.81141 0.71103
SMTInterpol SMTInterpol unsat ✅ 0.79187 1.73248
STP STP unsat ✅ 0.27557 0.17571
Yices2 Yices2 unsat ✅ 0.21769 0.11802
Z3alpha Z3-alpha unsat ✅ 39.06621 38.94963
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.25334 0.13855
Bitwuzla-MachBV-base unsat ✅ 0.45334 0.33016
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.57803 0.45416
BVDecide bv_decide unsat ✅ 1.70102 1.53268
bv_decide-nokernel unsat ✅ 1.07540 0.90340
cvc5 cvc5 unsat ✅ 0.63802 0.51321
SMTInterpol SMTInterpol unsat ✅ 0.79850 1.61757
Yices2 Yices2 unsat ✅ 0.29075 0.16394
Z3alpha Z3-alpha unsat ✅ 302.77957 1209.48140
Z3 Z3-alpha-base unsat ✅ 1170.56140 1170.20740
Z3-Owl-base unknown ❌ 1201.24388 1201.00926
z3siri-base unsat ✅ 1185.68556 1185.40584
Z3-Owl Z3-Owl unknown ❌ 1201.75808 1201.04239