Benchmark

non-incremental/QF_BV/Sage2/bench_1616.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size17351
Compressed Size1715
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 17343
Compressed Size1709
Max. Term Depth60
Asserts 100
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not75 =80 let333
bvadd62 bvmul62 bvult19 zero_extend134

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 14.03230 14.02770
Boolector SMT17 final boolector sat ✅ 238.21100 238.18200
CVC4 CVC4-smtcomp2017-main default sat ✅ 15.41980 30.68370
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 39.82240 39.81800
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.11778 3.15274
Q3B Q3B default unknown ❌ 600.04800 1788.74000
STP stp_st default sat ✅ 17.36080 17.35190
stp_mt default sat ✅ 32.29950 127.69600
Yices2 Yices2-Main default sat ✅ 112.04900 112.02100
Z3 z3-4.5.0 default sat ✅ 334.41200 334.37400
SMT-COMP 2018 Boolector Boolector_default sat ✅ 11.31120 11.31010
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1129.58000 1129.59000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 12.00470 12.00410
MinkeyRink Minkeyrink MT_mt sat ✅ 1.63849 6.20875
Minkeyrink ST_st sat ✅ 10.82020 10.81930
STP STP-CMS-st-2018_default-no-stderr sat ✅ 93.82720 93.80750
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 22.64010 89.55700
STP-Riss-st-2018_riss-no-stderr sat ✅ 249.66900 249.66000
Yices2 Yices 2.6.0_default sat ✅ 1184.64000 1184.53000
Z3 z3-4.7.1_default sat ✅ 322.92300 322.88400
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 13.33290 13.33190
Poolector-wrapped-sq_default sat ✅ 14.24140 55.97500
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 23.47130 23.46890
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2089.50000 2089.54000
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 18.56610 73.45200
MinkeyRink ST-wrapped-sq_default sat ✅ 26.10190 26.09520
Par4 Par4-wrapped-sq_default sat ✅ 29.12210 87.24000
STP STP-2019-wrapped-sq_default sat ✅ 101.30100 101.28000
stp-mergesat-fixed-wrapped-sq_default sat ✅ 59.52580 59.52020
stp-minisat-wrapped-sq_default sat ✅ 50.65740 50.64970
stp-mt-wrapped-sq_default sat ✅ 30.64880 121.27800
stp-portfolio-fixed-wrapped-sq_default sat ✅ 106.99900 224.29700
stp-riss-wrapped-sq_default unknown ❌ 0.13811 0.13832
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 472.59700 472.58300
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 37.07200 74.09360
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 10.79850 10.79790
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.66000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 106.54200 106.53200
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 306.61200 306.56800
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 9.74483 9.74449
Boolector Boolector-wrapped-sq_default sat ✅ 5.51725 5.51706
Poolector-wrapped-sq_default sat ✅ 5.99240 23.40000
CVC4 CVC4-sq-final_default sat ✅ 74.67300 74.66920
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.78000
MathSAT MathSAT5_default.sh sat ✅ 16.88100 16.87420
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08741 0.08766
MinkeyRink Solver 2020.3_default sat ✅ 24.52700 97.07050
STP STP_default sat ✅ 2.00824 7.69638
STP ++ Mergsat v1_default sat ✅ 10.34510 10.34550
Yices2 Yices 2.6.2 bug fix_default sat ✅ 141.64800 141.63200
Z3 z3-4.8.8_default sat ✅ 579.33300 579.21300
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 3.69441 3.69410
MathSAT mathsat-5.6.6_default sat ✅ 29.02150 29.01920
STP STP 2021.0_default sat ✅ 0.54270 1.93353
Z3 z3-4.8.11_default sat ✅ 135.16300 135.15800
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 8.42749 8.42702
Bitwuzla-wrapped_default sat ✅ 18.18330 18.18400
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 631.80900 631.81400
MathSAT MathSAT-5.6.8_default sat ✅ 133.37700 133.36700
STP STP 2022.4_default sat ✅ 0.93399 0.93401
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 6.73110 6.73009
Z3++BV z3++bv_0702_default sat ✅ 193.33500 193.33400
Z3 z3-4.8.17_default sat ✅ 36.61880 36.61610
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 7.45835 7.45874
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 64.17660 64.17670
STP STP 2022.4_default sat ✅ 4.04461 4.04445
STP 2022.4_default sat ✅ 4.03290 4.03270
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1235.26000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 45.31770 45.31620
Z3-Owl z3-Owl-Final_default sat ✅ 105.50000 105.31000
z3-Owl-Final_default sat ✅ 98.91680 98.90590
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 97.80539 97.67540
Bitwuzla-MachBV-base sat ✅ 3.33279 3.20713
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 26.10112 25.97462
BVDecide bv_decide sat ✅ 12.13870 12.00248
bv_decide-nokernel sat ✅ 12.16713 11.99816
cvc5 cvc5 sat ✅ 459.50095 459.29126
SMTInterpol SMTInterpol unknown ❌ 1201.38584 1223.70841
Yices2 Yices2 sat ✅ 65.15547 65.02000
Z3alpha Z3-alpha sat ✅ 9.22085 35.36494
Z3 Z3-alpha-base sat ✅ 96.43456 96.30742
Z3-Owl-base sat ✅ 408.11339 407.90434
z3siri-base sat ✅ 98.10649 97.96458
Z3-Owl Z3-Owl sat ✅ 6.23059 6.10373