Benchmark

non-incremental/QF_BV/Sage2/bench_3515.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size34030
Compressed Size2362
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 34022
Compressed Size2371
Max. Term Depth92
Asserts 158
Declared Functions0
Declared Constants25
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not130 =131 let696
extract20 bvadd142 bvmul122 bvult20
bvugt3 bvuge3 bvshl10 zero_extend272

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 106.53000 106.52400
Boolector SMT17 final boolector sat ✅ 110.81000 110.80500
CVC4 CVC4-smtcomp2017-main default sat ✅ 146.31600 293.36300
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 14.83040 14.82980
MinkeyRink MinkeyRink 2017.3a default sat ✅ 5.76885 6.25000
Q3B Q3B default unknown ❌ 600.02800 1799.31000
STP stp_st default sat ✅ 2.45849 2.45807
stp_mt default sat ✅ 11.05940 33.36930
Yices2 Yices2-Main default sat ✅ 185.47900 185.46700
Z3 z3-4.5.0 default sat ✅ 45.37330 45.37190
SMT-COMP 2018 Boolector Boolector_default sat ✅ 2.41191 2.41158
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 23.94220 23.93990
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 9.52071 9.52087
MinkeyRink Minkeyrink MT_mt sat ✅ 1.23247 4.51850
Minkeyrink ST_st sat ✅ 5.13363 5.13233
STP STP-CMS-st-2018_default-no-stderr sat ✅ 15.60130 15.60130
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 21.26610 83.62200
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.21728 4.21690
Yices2 Yices 2.6.0_default sat ✅ 45.03390 45.03220
Z3 z3-4.7.1_default sat ✅ 231.59600 231.58500
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 6.09165 6.09098
Bitwuzla-wrapped_default sat ✅ 15.18580 15.18620
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 19.43300 19.43260
MathSAT MathSAT-5.6.8_default sat ✅ 2.20564 2.20535
STP STP 2022.4_default sat ✅ 7.57386 7.57334
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 176.17700 176.14600
Z3++BV z3++bv_0702_default sat ✅ 244.68900 244.68000
Z3 z3-4.8.17_default sat ✅ 371.25600 371.20500
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 12.66510 12.66550
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 14.18890 14.18720
STP STP 2022.4_default sat ✅ 5.64309 5.64246
STP 2022.4_default sat ✅ 5.65401 5.65115
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1230.51000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.84905 0.84893
Z3-Owl z3-Owl-Final_default sat ✅ 238.44100 238.42700
z3-Owl-Final_default sat ✅ 76.19560 76.18420
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 3.06419 2.94856
Bitwuzla-MachBV-base sat ✅ 19.06023 18.94345
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 11.18199 11.06013
BVDecide bv_decide sat ✅ 21.73293 21.57992
bv_decide-nokernel sat ✅ 22.01862 21.86769
cvc5 cvc5 sat ✅ 151.96659 151.81558
SMTInterpol SMTInterpol unknown ❌ 1201.34812 1223.69195
Yices2 Yices2 sat ✅ 57.36311 57.23243
Z3alpha Z3-alpha sat ✅ 237.70698 949.02756
Z3 Z3-alpha-base sat ✅ 118.72107 118.58185
Z3-Owl-base sat ✅ 482.87885 482.70503
z3siri-base sat ✅ 120.32174 120.19223
Z3-Owl Z3-Owl sat ✅ 20.93173 20.80754