Benchmark

non-incremental/QF_BV/Sage2/bench_10127.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size89426
Compressed Size6485
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 89418
Compressed Size6511
Max. Term Depth633
Asserts 181
Declared Functions0
Declared Constants209
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not60 =60 let1781
bvadd999 bvmul1 bvult40 bvule39
bvuge40 bvsge1 bvshl1 bvlshr41
zero_extend679

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.46199 1.46166
Boolector SMT17 final boolector sat ✅ 20.14650 20.14350
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.32830 2.60341
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.80946 0.80987
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.42311 0.41332
Q3B Q3B default unknown ❌ 600.02700 1799.54000
STP stp_st default sat ✅ 0.57808 0.57808
stp_mt default sat ✅ 0.64987 1.87271
Yices2 Yices2-Main default sat ✅ 0.74950 0.73980
Z3 z3-4.5.0 default sat ✅ 2.11087 2.11017
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.22194 1.22193
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.74313 0.74309
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.46209 0.46312
MinkeyRink Minkeyrink MT_mt sat ✅ 0.43490 1.20796
Minkeyrink ST_st sat ✅ 0.59490 0.59515
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.64922 0.64926
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.52366 1.43768
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.00869 1.00881
Yices2 Yices 2.6.0_default sat ✅ 0.37988 0.37976
Z3 z3-4.7.1_default sat ✅ 3.24591 3.24545
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.17823 0.17808
Poolector-wrapped-sq_default sat ✅ 0.28128 0.29087
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 6.19205 6.19208
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.37649 0.37673
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.41246 1.20825
MinkeyRink ST-wrapped-sq_default sat ✅ 0.38935 0.38942
Par4 Par4-wrapped-sq_default sat ✅ 0.50037 0.00667
STP STP-2019-wrapped-sq_default sat ✅ 0.80046 0.80080
stp-mergesat-fixed-wrapped-sq_default sat ✅ 6.19977 12.27960
stp-minisat-wrapped-sq_default sat ✅ 0.40783 0.40802
stp-mt-wrapped-sq_default sat ✅ 0.93389 3.01724
stp-portfolio-fixed-wrapped-sq_default sat ✅ 6.16772 7.05627
stp-riss-wrapped-sq_default unknown ❌ 0.22150 0.22142
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.47825 0.47829
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.21581 0.21577
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.03458 1.03464
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.86000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.59285 0.59284
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.27018 2.26973
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.17816 0.17807
Boolector Boolector-wrapped-sq_default sat ✅ 0.17151 0.17152
Poolector-wrapped-sq_default sat ✅ 0.28263 0.28555
CVC4 CVC4-sq-final_default sat ✅ 0.45677 0.45427
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.56000
MathSAT MathSAT5_default.sh sat ✅ 0.36103 0.36095
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.13999 0.14021
MinkeyRink Solver 2020.3_default sat ✅ 0.28759 0.73197
STP STP_default sat ✅ 0.56669 1.70851
STP ++ Mergsat v1_default sat ✅ 0.47963 0.48130
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.78437 0.78427
Z3 z3-4.8.8_default sat ✅ 0.68521 0.68515