Benchmark

non-incremental/QF_BV/Sage2/bench_3616.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size23112
Compressed Size2181
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 23104
Compressed Size2196
Max. Term Depth75
Asserts 139
Declared Functions0
Declared Constants24
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not116 =118 let445
bvadd73 bvmul73 bvult20 zero_extend183

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 35.84620 35.84050
Boolector SMT17 final boolector sat ✅ 78.35290 78.34170
CVC4 CVC4-smtcomp2017-main default sat ✅ 21.12740 42.32950
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 24.03860 24.02910
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.57150 0.55771
Q3B Q3B default unknown ❌ 600.08000 1799.71000
STP stp_st default sat ✅ 2.89346 2.88986
stp_mt default sat ✅ 3.22925 9.09384
Yices2 Yices2-Main default sat ✅ 112.58600 112.55300
Z3 z3-4.5.0 default sat ✅ 75.13780 75.12390
SMT-COMP 2018 Boolector Boolector_default sat ✅ 43.28260 43.28110
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 261.92100 261.92400
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 2.09554 2.09649
MinkeyRink Minkeyrink MT_mt sat ✅ 0.51414 1.69357
Minkeyrink ST_st sat ✅ 0.48791 0.48801
STP STP-CMS-st-2018_default-no-stderr sat ✅ 11.20640 11.20590
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 2.45657 9.18141
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.97901 0.97908
Yices2 Yices 2.6.0_default sat ✅ 1.83851 1.83815
Z3 z3-4.7.1_default sat ✅ 342.98900 342.93600
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 9.76337 9.76361
Poolector-wrapped-sq_default sat ✅ 5.83275 22.51000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 40.65830 40.64730
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 351.89400 351.85000
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.22878 0.56304
MinkeyRink ST-wrapped-sq_default sat ✅ 0.89319 0.89321
Par4 Par4-wrapped-sq_default sat ✅ 57.58310 172.65000
STP STP-2019-wrapped-sq_default sat ✅ 7.84898 7.84938
stp-mergesat-fixed-wrapped-sq_default sat ✅ 9.00046 8.98888
stp-minisat-wrapped-sq_default sat ✅ 19.50990 19.51030
stp-mt-wrapped-sq_default sat ✅ 1.94283 7.13343
stp-portfolio-fixed-wrapped-sq_default sat ✅ 20.40760 39.17590
stp-riss-wrapped-sq_default unknown ❌ 0.18422 0.18440
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 104.45000 104.44700
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 133.40800 133.38300
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 32.53570 32.53340
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.76000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 465.17200 465.14900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 751.83900 751.81200
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 19.40120 19.40070
Boolector Boolector-wrapped-sq_default sat ✅ 9.49728 9.49710
Poolector-wrapped-sq_default sat ✅ 10.60160 41.54040
CVC4 CVC4-sq-final_default sat ✅ 8.62240 8.62270
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.94000
MathSAT MathSAT5_default.sh sat ✅ 19.25180 19.25270
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.11319 0.11342
MinkeyRink Solver 2020.3_default sat ✅ 1.30389 4.80189
STP STP_default sat ✅ 0.59079 2.05946
STP ++ Mergsat v1_default sat ✅ 7.96589 7.96755
Yices2 Yices 2.6.2 bug fix_default sat ✅ 27.50820 27.50630
Z3 z3-4.8.8_default sat ✅ 197.66000 197.63100
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 5.28626 5.28614
MathSAT mathsat-5.6.6_default sat ✅ 3.46885 3.46862
STP STP 2021.0_default sat ✅ 0.51297 1.75245
Z3 z3-4.8.11_default sat ✅ 49.67970 49.66940
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 39.48430 39.36720
cvc5 cvc5 sat ✅ 78.29786 78.16192
SMTInterpol SMTInterpol unknown ❌ 1201.71886 1215.87659
STP STP sat ✅ 9.10740 8.99693
Yices2 Yices2 sat ✅ 11.60653 11.50615
Z3alpha Z3-alpha sat ✅ 231.32339 231.21503
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 4.63120 4.51338
Bitwuzla-MachBV-base sat ✅ 13.41297 13.29546
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 6.10709 5.98948
BVDecide bv_decide sat ✅ 17.90688 17.76432
bv_decide-nokernel sat ✅ 17.83049 17.70459
cvc5 cvc5 sat ✅ 31.98401 31.86581
SMTInterpol SMTInterpol unknown ❌ 1201.40125 1232.73964
Yices2 Yices2 sat ✅ 32.72570 32.59724
Z3alpha Z3-alpha sat ✅ 89.18540 355.26774
Z3 Z3-alpha-base sat ✅ 167.37320 167.22106
Z3-Owl-base sat ✅ 695.45061 695.22014
z3siri-base sat ✅ 167.88198 167.73787
Z3-Owl Z3-Owl sat ✅ 73.14843 73.02444