Benchmark

non-incremental/QF_BV/Sage2/bench_2360.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size15254
Compressed Size1618
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 15246
Compressed Size1604
Max. Term Depth51
Asserts 93
Declared Functions0
Declared Constants16
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not74 =76 let293
bvadd49 bvmul49 bvult16 zero_extend121

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 38.86090 38.85400
Boolector SMT17 final boolector sat ✅ 123.76300 123.74300
CVC4 CVC4-smtcomp2017-main default sat ✅ 12.17040 24.36720
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 4.55688 4.55559
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.58410 3.64228
Q3B Q3B default unknown ❌ 600.05300 1799.42000
STP stp_st default sat ✅ 2.40870 2.40794
stp_mt default sat ✅ 2.97180 11.36260
Yices2 Yices2-Main default sat ✅ 8.93681 8.93580
Z3 z3-4.5.0 default sat ✅ 8.71236 8.71144
SMT-COMP 2018 Boolector Boolector_default sat ✅ 140.07400 140.06700
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 274.60900 274.57200
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 13.12210 13.12210
MinkeyRink Minkeyrink MT_mt sat ✅ 1.64092 6.25526
Minkeyrink ST_st sat ✅ 3.53975 3.53982
STP STP-CMS-st-2018_default-no-stderr sat ✅ 6.05429 6.05380
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.88920 7.13950
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.44787 6.44827
Yices2 Yices 2.6.0_default sat ✅ 28.61870 28.61760
Z3 z3-4.7.1_default sat ✅ 212.84900 212.82800
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 2.60586 2.60569
Poolector-wrapped-sq_default sat ✅ 2.82502 10.84320
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 42.48830 42.48720
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 97.42640 97.42180
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 5.04907 19.80300
MinkeyRink ST-wrapped-sq_default sat ✅ 3.30817 3.30806
Par4 Par4-wrapped-sq_default sat ✅ 75.00400 224.84000
STP STP-2019-wrapped-sq_default sat ✅ 0.67701 0.67737
stp-mergesat-fixed-wrapped-sq_default sat ✅ 5.73386 5.73367
stp-minisat-wrapped-sq_default sat ✅ 0.41158 0.41179
stp-mt-wrapped-sq_default sat ✅ 0.69650 2.37936
stp-portfolio-fixed-wrapped-sq_default sat ✅ 5.93275 6.82650
stp-riss-wrapped-sq_default unknown ❌ 0.11771 0.11788
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 271.95400 271.92300
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 18.05800 18.05690
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 26.64450 26.64480
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.04000 2399.67000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 86.73840 86.72760
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 415.05700 415.00100
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 15.55039 15.45006
cvc5 cvc5 sat ✅ 6.19543 6.09562
SMTInterpol SMTInterpol sat ✅ 1044.06569 1076.34388
STP STP sat ✅ 5.96862 5.86581
Yices2 Yices2 sat ✅ 18.64987 18.54926
Z3alpha Z3-alpha sat ✅ 16.13231 16.02524
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 2.27087 2.14471
Bitwuzla-MachBV-base sat ✅ 4.19402 4.06444
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 8.06947 7.94306
BVDecide bv_decide sat ✅ 17.87449 17.72547
bv_decide-nokernel sat ✅ 17.83946 17.72482
cvc5 cvc5 sat ✅ 43.09086 42.95614
SMTInterpol SMTInterpol unknown ❌ 1201.35247 1232.47540
Yices2 Yices2 sat ✅ 26.80937 26.67789
Z3alpha Z3-alpha sat ✅ 52.08367 206.98718
Z3 Z3-alpha-base sat ✅ 44.39441 44.27221
Z3-Owl-base sat ✅ 189.20714 189.05267
z3siri-base sat ✅ 44.95593 44.82851
Z3-Owl Z3-Owl sat ✅ 21.87991 21.74282