Benchmark

non-incremental/QF_BV/Sage2/bench_3463.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size20503
Compressed Size1871
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 20495
Compressed Size1863
Max. Term Depth60
Asserts 112
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not89 =92 let405
bvadd76 bvmul76 bvult19 zero_extend164

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 19.99400 19.99350
Boolector SMT17 final boolector sat ✅ 125.52100 125.51000
CVC4 CVC4-smtcomp2017-main default sat ✅ 88.69280 177.83800
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 20.86900 20.86690
MinkeyRink MinkeyRink 2017.3a default sat ✅ 8.45925 11.92000
Q3B Q3B default unknown ❌ 600.04500 1799.26000
STP stp_st default sat ✅ 11.22140 11.21240
stp_mt default sat ✅ 2.82449 10.74240
Yices2 Yices2-Main default sat ✅ 22.18060 22.17510
Z3 z3-4.5.0 default sat ✅ 407.14100 405.97100
SMT-COMP 2018 Boolector Boolector_default sat ✅ 17.68340 17.67950
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 37.85750 37.85520
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 29.43870 29.43920
MinkeyRink Minkeyrink MT_mt sat ✅ 0.53373 1.82816
Minkeyrink ST_st sat ✅ 4.29941 4.29904
STP STP-CMS-st-2018_default-no-stderr sat ✅ 19.24980 19.24960
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 11.23820 44.22240
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.32033 6.31947
Yices2 Yices 2.6.0_default sat ✅ 34.90770 34.90560
Z3 z3-4.7.1_default sat ✅ 124.74800 124.74800
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 10.71960 10.71910
Boolector Boolector-wrapped-sq_default sat ✅ 3.33218 3.33239
Poolector-wrapped-sq_default sat ✅ 3.69171 14.16000
CVC4 CVC4-sq-final_default sat ✅ 118.46200 118.44800
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1199.96000
MathSAT MathSAT5_default.sh sat ✅ 13.58690 13.58570
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08764 0.08785
MinkeyRink Solver 2020.3_default sat ✅ 2.90803 11.25200
STP STP_default sat ✅ 1.01512 3.77249
STP ++ Mergsat v1_default sat ✅ 15.51580 15.51510
Yices2 Yices 2.6.2 bug fix_default sat ✅ 25.34770 25.34670
Z3 z3-4.8.8_default sat ✅ 426.39000 426.33000
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 27.54580 27.54380
Bitwuzla-wrapped_default sat ✅ 13.50290 13.50130
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 7.76267 7.76300
MathSAT MathSAT-5.6.8_default sat ✅ 12.76930 12.76770
STP STP 2022.4_default sat ✅ 3.13308 3.13282
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 6.50548 6.50498
Z3++BV z3++bv_0702_default sat ✅ 213.66600 213.63500
Z3 z3-4.8.17_default sat ✅ 132.92500 132.88900
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 441.23256 441.12829
cvc5 cvc5 sat ✅ 117.89131 117.79044
SMTInterpol SMTInterpol unknown ❌ 1201.77437 1227.96955
STP STP sat ✅ 13.17827 13.07718
Yices2 Yices2 sat ✅ 2.82506 2.72407
Z3alpha Z3-alpha sat ✅ 199.09743 198.91674
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 9.46183 9.33019
Bitwuzla-MachBV-base sat ✅ 6.75704 6.63465
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 9.90527 9.78321
BVDecide bv_decide sat ✅ 20.02706 19.88738
bv_decide-nokernel sat ✅ 20.08435 19.94717
cvc5 cvc5 sat ✅ 25.47268 25.34061
SMTInterpol SMTInterpol unknown ❌ 1201.38563 1225.92266
Yices2 Yices2 sat ✅ 63.87489 63.75088
Z3alpha Z3-alpha sat ✅ 8.59851 33.10884
Z3 Z3-alpha-base sat ✅ 218.86899 218.73595
Z3-Owl-base sat ✅ 905.21617 905.02877
z3siri-base sat ✅ 221.98097 221.81226
Z3-Owl Z3-Owl sat ✅ 103.77283 103.62598