Benchmark

non-incremental/QF_BV/Sage2/bench_14528.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size99223
Compressed Size8093
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 99215
Compressed Size8103
Max. Term Depth39
Asserts 333
Declared Functions0
Declared Constants141
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite6 not23 =72
let1812 bvand6 bvor73 bvadd874
bvmul349 bvult72 bvule110 bvugt32
bvuge52 bvshl73 bvlshr13 zero_extend389

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.16382 0.16193
Boolector SMT17 final boolector unsat ✅ 0.52884 0.38996
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.61165 1.16563
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.73986 0.74006
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.20759 0.17016
Q3B Q3B default unknown ❌ 600.03300 1799.36000
STP stp_st default unsat ✅ 1.02240 1.02173
stp_mt default unsat ✅ 1.21957 3.40542
Yices2 Yices2-Main default unsat ✅ 0.02164 0.02024
Z3 z3-4.5.0 default unsat ✅ 0.80872 0.80751
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.13970 0.13964
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.73571 0.73565
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.87610 0.87709
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.10559 0.13453
Minkeyrink ST_st unsat ✅ 0.10089 0.10110
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.55371 0.55363
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.59120 1.84189
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.34882 1.34849
Yices2 Yices 2.6.0_default unsat ✅ 0.02471 0.02465
Z3 z3-4.7.1_default unsat ✅ 5.02038 5.01957
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.21035 0.21032
Poolector-wrapped-sq_default unsat ✅ 0.17477 0.15720
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.24226 0.24226
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.55544 0.55570
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.09614 0.12088
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.08925 0.08935
Par4 Par4-wrapped-sq_default unsat ✅ 0.03463 0.00582
STP STP-2019-wrapped-sq_default unsat ✅ 0.47678 0.47709
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 10.17610 10.17520
stp-minisat-wrapped-sq_default unsat ✅ 0.86228 0.85861
stp-mt-wrapped-sq_default unsat ✅ 0.50247 1.48628
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 10.23680 11.28470
stp-riss-wrapped-sq_default unknown ❌ 0.16538 0.16547
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02484 0.02485
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03479 0.03479
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03251 0.03254
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 964.42800 964.24900
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05175 0.05160
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.41157 0.41156
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.20942 0.20933
Boolector Boolector-wrapped-sq_default unsat ✅ 0.18797 0.18795
Poolector-wrapped-sq_default unsat ✅ 0.17902 0.17092
CVC4 CVC4-sq-final_default unsat ✅ 0.43214 0.43243
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.96000
MathSAT MathSAT5_default.sh unsat ✅ 0.53111 0.53103
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08438 0.08465
MinkeyRink Solver 2020.3_default unsat ✅ 0.09573 0.12519
STP STP_default unsat ✅ 0.09736 0.12590
STP ++ Mergsat v1_default unsat ✅ 0.08678 0.08827
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02757 0.02756
Z3 z3-4.8.8_default unsat ✅ 0.43025 0.43016
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.27789 0.27786
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.46337 0.46399
STP STP 2022.4_default unsat ✅ 0.07771 0.07777
STP 2022.4_default unsat ✅ 0.07769 0.07770
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1241.26000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02539 0.02521
Z3-Owl z3-Owl-Final_default unsat ✅ 129.41500 129.40100
z3-Owl-Final_default unsat ✅ 42.60670 42.60300
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.34743 0.24811
cvc5 cvc5 unsat ✅ 0.57321 0.47303
SMTInterpol SMTInterpol unsat ✅ 16.03852 34.02642
STP STP unsat ✅ 0.25937 0.15973
Yices2 Yices2 unsat ✅ 0.23056 0.13097
Z3alpha Z3-alpha unsat ✅ 4.32991 4.22995