Benchmark

non-incremental/QF_BV/Sage2/bench_17668.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size17079
Compressed Size1499
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 17071
Compressed Size1488
Max. Term Depth21
Asserts 58
Declared Functions0
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not13 =14 let367
bvadd201 bvmul4 bvult9 bvule19
bvugt2 bvuge13 bvlshr6 zero_extend143

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.05850 0.05675
Boolector SMT17 final boolector unsat ✅ 0.15816 0.15800
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.74200 1.46386
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.07779 0.07797
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.10352 0.06303
Q3B Q3B default unsat ✅ 0.13426 0.13383
STP stp_st default unsat ✅ 0.64152 0.61979
stp_mt default unsat ✅ 0.60731 2.28132
Yices2 Yices2-Main default unsat ✅ 0.00920 0.00648
Z3 z3-4.5.0 default unsat ✅ 72.85580 72.84690
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.03728 0.03720
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.11337 0.11350
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.07195 0.07299
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04651 0.05480
Minkeyrink ST_st unsat ✅ 0.04366 0.04389
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.51955 0.51932
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.38591 1.41846
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.51087 0.51096
Yices2 Yices 2.6.0_default unsat ✅ 0.00788 0.00778
Z3 z3-4.7.1_default unsat ✅ 54.87550 54.87700
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.06030 0.06025
Poolector-wrapped-sq_default unsat ✅ 0.17586 0.16981
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.11831 0.11833
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.06224 0.06255
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05220 0.05772
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04985 0.04994
Par4 Par4-wrapped-sq_default unsat ✅ 0.01637 0.00594
STP STP-2019-wrapped-sq_default unsat ✅ 0.48658 0.48685
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 5.23299 5.23319
stp-minisat-wrapped-sq_default unsat ✅ 0.48540 0.48563
stp-mt-wrapped-sq_default unsat ✅ 0.49186 1.80073
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 5.20430 6.11792
stp-riss-wrapped-sq_default unknown ❌ 0.03911 0.03934
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00894 0.00843
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01023 0.01024
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01008 0.01007
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 522.42900 522.34900
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01238 0.01238
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 35.14970 35.14730
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08939 0.08936
Boolector Boolector-wrapped-sq_default unsat ✅ 0.05855 0.05853
Poolector-wrapped-sq_default unsat ✅ 0.17739 0.26466
CVC4 CVC4-sq-final_default unsat ✅ 1.32028 1.32046
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.07411 0.07408
MathSAT MathSAT5_default.sh unsat ✅ 0.04780 0.04776
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.04471 0.04492
MinkeyRink Solver 2020.3_default unsat ✅ 0.04842 0.05331
STP STP_default unsat ✅ 0.02783 0.03292
STP ++ Mergsat v1_default unsat ✅ 0.01927 0.02089
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02501 0.00778
Z3 z3-4.8.8_default unsat ✅ 19.57800 19.57690
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.09077 0.09074
Bitwuzla-wrapped_default unsat ✅ 0.08858 0.08853
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.72766 0.72584
MathSAT MathSAT-5.6.8_default unsat ✅ 0.04638 0.04630
STP STP 2022.4_default unsat ✅ 0.02620 0.02627
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01038 0.00755
Z3++BV z3++bv_0702_default unsat ✅ 8.11394 8.11252
Z3 z3-4.8.17_default unsat ✅ 29.05570 29.05570
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.22374 0.12392
cvc5 cvc5 unsat ✅ 0.70239 0.60268
SMTInterpol SMTInterpol unsat ✅ 0.71268 1.43786
STP STP unsat ✅ 0.22606 0.12613
Yices2 Yices2 unsat ✅ 0.21290 0.11305
Z3alpha Z3-alpha unsat ✅ 12.22592 12.12032