Benchmark

non-incremental/QF_BV/Sage2/bench_2868.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size20527
Compressed Size1914
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 20519
Compressed Size1906
Max. Term Depth57
Asserts 115
Declared Functions0
Declared Constants18
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not93 =96 let405
bvadd74 bvmul74 bvult18 zero_extend164

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 13.09330 13.09270
Boolector SMT17 final boolector sat ✅ 44.96460 44.95250
CVC4 CVC4-smtcomp2017-main default sat ✅ 29.76420 59.67320
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 40.26350 40.26050
MinkeyRink MinkeyRink 2017.3a default sat ✅ 2.99786 3.00053
Q3B Q3B default unknown ❌ 600.05400 1787.09000
STP stp_st default sat ✅ 8.83517 8.83266
stp_mt default sat ✅ 5.01083 14.84600
Yices2 Yices2-Main default sat ✅ 110.42000 110.41900
Z3 z3-4.5.0 default sat ✅ 183.59400 183.59900
SMT-COMP 2018 Boolector Boolector_default sat ✅ 3.34952 3.34911
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 92.17290 92.15930
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 92.90210 92.89480
MinkeyRink Minkeyrink MT_mt sat ✅ 0.33243 1.04056
Minkeyrink ST_st sat ✅ 0.32493 0.32483
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.80385 4.80335
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.42910 5.23532
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.77123 0.77108
Yices2 Yices 2.6.0_default sat ✅ 47.84480 47.84240
Z3 z3-4.7.1_default sat ✅ 438.30700 438.31700
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 16.55450 16.55060
Poolector-wrapped-sq_default sat ✅ 4.23016 16.26000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 130.17000 130.17100
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 81.56800 81.55800
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.13270 4.18294
MinkeyRink ST-wrapped-sq_default sat ✅ 4.87982 4.87958
Par4 Par4-wrapped-sq_default sat ✅ 3.77969 11.10000
STP STP-2019-wrapped-sq_default sat ✅ 10.62850 10.62840
stp-mergesat-fixed-wrapped-sq_default sat ✅ 11.81910 11.81890
stp-minisat-wrapped-sq_default sat ✅ 0.82821 0.82832
stp-mt-wrapped-sq_default sat ✅ 5.30704 20.56240
stp-portfolio-fixed-wrapped-sq_default sat ✅ 12.13340 23.78600
stp-riss-wrapped-sq_default unknown ❌ 0.15587 0.15605
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 3.92977 3.92973
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 8.52025 8.51976
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 20.03720 20.03680
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.89000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 140.69800 140.69100
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 447.48100 447.42500
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 15.47670 15.47190
Boolector Boolector-wrapped-sq_default sat ✅ 13.04270 13.03540
Poolector-wrapped-sq_default sat ✅ 5.99013 23.13000
CVC4 CVC4-sq-final_default sat ✅ 67.82960 67.82460
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.08000 1200.02000
MathSAT MathSAT5_default.sh sat ✅ 61.62890 61.62680
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08611 0.08636
MinkeyRink Solver 2020.3_default sat ✅ 1.98669 7.56728
STP STP_default sat ✅ 0.49903 1.75774
STP ++ Mergsat v1_default sat ✅ 11.66150 11.66290
Yices2 Yices 2.6.2 bug fix_default sat ✅ 39.04550 39.03800
Z3 z3-4.8.8_default sat ✅ 565.94000 565.89300
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 15.40070 15.39950
Bitwuzla-wrapped_default sat ✅ 16.16960 16.17020
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 37.71720 37.71340
MathSAT MathSAT-5.6.8_default sat ✅ 32.66900 32.66800
STP STP 2022.4_default sat ✅ 2.55552 2.55554
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 23.54400 23.54380
Z3++BV z3++bv_0702_default sat ✅ 191.47100 191.45800
Z3 z3-4.8.17_default sat ✅ 92.11260 92.11040
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 3.03858 3.03829
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 104.76700 104.73600
STP STP 2022.4_default sat ✅ 0.82486 0.82481
STP 2022.4_default sat ✅ 0.83306 0.83146
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 96.71060 124.58200
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 23.02580 23.02680
Z3-Owl z3-Owl-Final_default sat ✅ 171.09600 171.06900
z3-Owl-Final_default sat ✅ 83.22170 83.22270
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 71.31277 71.17759
cvc5 cvc5 sat ✅ 107.04024 106.87454
SMTInterpol SMTInterpol unknown ❌ 1201.71964 1220.33735
STP STP sat ✅ 15.25730 15.14105
Yices2 Yices2 sat ✅ 26.10705 26.00572
Z3alpha Z3-alpha sat ✅ 44.27839 44.15811
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 4.48099 4.35818
Bitwuzla-MachBV-base sat ✅ 3.11585 2.99830
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 3.70058 3.57335
BVDecide bv_decide sat ✅ 26.24752 26.10065
bv_decide-nokernel sat ✅ 26.23712 26.10126
cvc5 cvc5 sat ✅ 228.77159 228.60625
SMTInterpol SMTInterpol unknown ❌ 1201.36891 1232.15840
Yices2 Yices2 sat ✅ 25.69027 25.55726
Z3alpha Z3-alpha sat ✅ 54.72131 217.47852
Z3 Z3-alpha-base sat ✅ 58.53896 58.40731
Z3-Owl-base sat ✅ 245.27237 245.09677
z3siri-base sat ✅ 59.07321 58.94790
Z3-Owl Z3-Owl sat ✅ 38.15097 38.02369