Benchmark

non-incremental/QF_BV/Sage2/bench_4881.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size193321
Compressed Size18861
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 193313
Compressed Size18926
Max. Term Depth141
Asserts 542
Declared Functions0
Declared Constants509
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite64 not91 =208
let3380 extract17 bvand6 bvor309
bvadd1612 bvmul256 bvudiv37 bvult128
bvule151 bvugt31 bvuge86 bvsle1
bvshl348 bvlshr17 zero_extend559

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.20855 0.20766
Boolector SMT17 final boolector sat ✅ 2.34881 2.34839
CVC4 CVC4-smtcomp2017-main default sat ✅ 13.90370 27.78370
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 5.60394 5.60465
MinkeyRink MinkeyRink 2017.3a default sat ✅ 10.72800 14.85000
Q3B Q3B default unknown ❌ 600.04300 1783.42000
STP stp_st default sat ✅ 36.02720 36.02510
stp_mt default sat ✅ 54.45410 165.00000
Yices2 Yices2-Main default sat ✅ 1.03553 0.61403
Z3 z3-4.5.0 default sat ✅ 11.76930 9.24761
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.15363 0.15356
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 30.92650 30.92340
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 5.26478 5.26568
MinkeyRink Minkeyrink MT_mt sat ✅ 48.77780 188.14900
Minkeyrink ST_st sat ✅ 50.99640 50.99020
STP STP-CMS-st-2018_default-no-stderr sat ✅ 94.42350 94.41110
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 57.86000 224.23700
STP-Riss-st-2018_riss-no-stderr sat ✅ 26.81090 26.80920
Yices2 Yices 2.6.0_default sat ✅ 0.36109 0.36095
Z3 z3-4.7.1_default sat ✅ 3.21726 3.21712
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.20741 0.20740
Poolector-wrapped-sq_default sat ✅ 0.28373 0.26969
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 4.66444 4.66447
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 6.13086 6.13121
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 51.96460 201.68800
MinkeyRink ST-wrapped-sq_default sat ✅ 47.92140 47.91990
Par4 Par4-wrapped-sq_default sat ✅ 0.38537 0.00632
STP STP-2019-wrapped-sq_default sat ✅ 68.33330 68.32880
stp-mergesat-fixed-wrapped-sq_default sat ✅ 12.30220 12.30080
stp-minisat-wrapped-sq_default sat ✅ 3.51250 3.51246
stp-mt-wrapped-sq_default sat ✅ 45.95330 176.97200
stp-portfolio-fixed-wrapped-sq_default sat ✅ 68.02480 81.69370
stp-riss-wrapped-sq_default unknown ❌ 1.84745 1.84730
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.42830 0.42832
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.43795 1.43776
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 90.97690 90.96550
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.44000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 1.31990 1.31979
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.45931 2.45914
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.98547 4.98557
Boolector Boolector-wrapped-sq_default sat ✅ 0.20610 0.20613
Poolector-wrapped-sq_default sat ✅ 0.38161 0.54329
CVC4 CVC4-sq-final_default sat ✅ 7.30299 7.30330
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1200.02000
MathSAT MathSAT5_default.sh sat ✅ 2.58550 2.58510
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.61462 1.59930
MinkeyRink Solver 2020.3_default sat ✅ 7.76552 26.02910
STP STP_default sat ✅ 37.59660 143.12300
STP ++ Mergsat v1_default sat ✅ 2.20833 2.20987
Yices2 Yices 2.6.2 bug fix_default sat ✅ 14.43540 14.43500
Z3 z3-4.8.8_default sat ✅ 2.50825 2.50802
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 4.94804 4.94775
Bitwuzla-wrapped_default sat ✅ 5.33558 5.33119
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 8.21706 8.21390
MathSAT MathSAT-5.6.8_default sat ✅ 6.92393 6.92358
STP STP 2022.4_default sat ✅ 2.41485 2.41474
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 5.27912 5.27906
Z3++BV z3++bv_0702_default sat ✅ 0.61487 0.61479
Z3 z3-4.8.17_default sat ✅ 1.69106 3.28276
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.37979 4.37842
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 9.10042 9.09949
STP STP 2022.4_default sat ✅ 2.28320 2.28306
STP 2022.4_default sat ✅ 2.33197 2.33054
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 6.07632 18.20450
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.39360 0.39350
Z3-Owl z3-Owl-Final_default sat ✅ 16.25570 16.25470
z3-Owl-Final_default sat ✅ 16.10970 16.10810
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.50802 0.40801
cvc5 cvc5 sat ✅ 6.42880 6.32581
SMTInterpol SMTInterpol unknown ❌ 1201.76578 1238.76223
STP STP sat ✅ 3.53167 3.43146
Yices2 Yices2 sat ✅ 1.61595 1.51603
Z3alpha Z3-alpha sat ✅ 22.47789 22.37033