Benchmark

non-incremental/QF_BV/Sage2/bench_8189.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size106743
Compressed Size12680
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 106735
Compressed Size12719
Max. Term Depth17
Asserts 641
Declared Functions0
Declared Constants182
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not124 =194 let1641
extract107 bvand41 bvor106 bvadd591
bvmul233 bvudiv53 bvult123 bvule115
bvugt27 bvuge173 bvslt1 bvsle2
bvsgt5 bvshl134 bvlshr34 zero_extend218

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.11839 0.11716
Boolector SMT17 final boolector unsat ✅ 0.24030 0.23954
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.82879 1.59610
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02100 599.77000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.62380 0.25057
Q3B Q3B default unknown ❌ 0.60508 0.81783
STP stp_st default unsat ✅ 13.20770 13.20840
stp_mt default unsat ✅ 8.81246 33.99030
Yices2 Yices2-Main default unsat ✅ 0.03505 0.03436
Z3 z3-4.5.0 default unsat ✅ 0.87898 0.87892
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.08917 0.08910
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.81656 0.81676
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 232.11500 232.09400
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.16493 0.21305
Minkeyrink ST_st unsat ✅ 0.15693 0.15713
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 28.07950 56.08970
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 15.54270 61.21240
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.04810 12.04860
Yices2 Yices 2.6.0_default unsat ✅ 0.03294 0.03289
Z3 z3-4.7.1_default unsat ✅ 0.80714 0.80708
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.11203 0.11204
Poolector-wrapped-sq_default unsat ✅ 0.17509 0.23655
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.03575 0.03575
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.66320 0.66348
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.16272 0.19084
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.15153 0.15160
Par4 Par4-wrapped-sq_default unsat ✅ 0.04122 0.00600
STP STP-2019-wrapped-sq_default unsat ✅ 24.36490 24.36520
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 204.40900 204.32500
stp-minisat-wrapped-sq_default unknown ❌ 2400.09000 2400.10000
stp-mt-wrapped-sq_default unsat ✅ 13.54640 53.34810
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.03000 2620.12000
stp-riss-wrapped-sq_default unknown ❌ 0.14349 0.14367
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03690 0.03690
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05598 0.05599
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05086 0.05085
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.26484 0.26484
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.06057 0.06055
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.95438 0.95432
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.05230 0.05225
Boolector Boolector-wrapped-sq_default unsat ✅ 0.16032 0.16032
Poolector-wrapped-sq_default unsat ✅ 0.17841 0.24734
CVC4 CVC4-sq-final_default unsat ✅ 657.12100 657.07800
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 968.28400 968.22300
MathSAT MathSAT5_default.sh unsat ✅ 589.03500 588.93900
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.16106 0.16132
MinkeyRink Solver 2020.3_default unsat ✅ 0.16997 0.19590
STP STP_default unsat ✅ 12.42720 48.91450
STP ++ Mergsat v1_default unsat ✅ 44.52440 44.52610
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04473 0.04468
Z3 z3-4.8.8_default unsat ✅ 1.08687 2.13684
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.09179 0.09048
MathSAT mathsat-5.6.6_default unsat ✅ 254.18400 254.12700
STP STP 2021.0_default unsat ✅ 12.48800 49.18000
Z3 z3-4.8.11_default unsat ✅ 0.88935 0.88917
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.06079 0.06077
Bitwuzla-wrapped_default unsat ✅ 0.06084 0.06082
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1199.11000
MathSAT MathSAT-5.6.8_default unsat ✅ 354.23200 354.16800
STP STP 2022.4_default unsat ✅ 0.13682 0.13684
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04518 0.04513
Z3++BV z3++bv_0702_default unsat ✅ 1.17085 1.17077
Z3 z3-4.8.17_default unsat ✅ 0.75152 0.75331
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.33624 0.23650
cvc5 cvc5 unsat ✅ 80.47854 80.34444
SMTInterpol SMTInterpol unknown ❌ 1201.72183 1230.31949
STP STP unsat ✅ 0.35971 0.25990
Yices2 Yices2 unsat ✅ 0.28834 0.18857
Z3alpha Z3-alpha unsat ✅ 81.65075 81.50641
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.33594 0.20959
Bitwuzla-MachBV-base unsat ✅ 0.35605 0.23787
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.43466 0.31412
BVDecide bv_decide unsat ✅ 13.13660 12.96482
bv_decide-nokernel unsat ✅ 7.64974 7.49862
cvc5 cvc5 unsat ✅ 65.42737 65.29288
SMTInterpol SMTInterpol unknown ❌ 1201.48609 1225.69521
Yices2 Yices2 unsat ✅ 0.32916 0.21149
Z3alpha Z3-alpha unsat ✅ 135.39953 538.22880
Z3 Z3-alpha-base unsat ✅ 185.97403 185.81273
Z3-Owl-base unsat ✅ 844.02660 843.82164
z3siri-base unsat ✅ 186.53170 186.36978
Z3-Owl Z3-Owl unsat ✅ 77.74005 77.61175