Benchmark

non-incremental/QF_BV/Sage2/bench_1722.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size22340
Compressed Size2063
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 22332
Compressed Size2079
Max. Term Depth60
Asserts 129
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not104 =109 let439
bvadd77 bvmul77 bvult19 zero_extend181

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 44.01170 44.00930
Boolector SMT17 final boolector sat ✅ 18.55680 18.55590
CVC4 CVC4-smtcomp2017-main default sat ✅ 11.74410 23.51380
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 7.13487 7.13331
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.12139 3.14919
Q3B Q3B default unknown ❌ 600.05100 1786.45000
STP stp_st default sat ✅ 3.07581 3.06575
stp_mt default sat ✅ 6.96452 15.32160
Yices2 Yices2-Main default sat ✅ 30.68830 30.68610
Z3 z3-4.5.0 default sat ✅ 156.85000 156.82000
SMT-COMP 2018 Boolector Boolector_default sat ✅ 17.92920 17.92930
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 55.21470 55.20760
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 10.53740 10.53770
MinkeyRink Minkeyrink MT_mt sat ✅ 1.32663 4.97463
Minkeyrink ST_st sat ✅ 7.87092 7.86951
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.40698 3.40478
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.05144 11.67550
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.21365 6.21361
Yices2 Yices 2.6.0_default sat ✅ 62.91250 62.91260
Z3 z3-4.7.1_default sat ✅ 222.27100 222.27800
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 3.16594 3.16599
Poolector-wrapped-sq_default sat ✅ 3.53417 13.61000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 26.29760 26.29570
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 69.57520 69.57460
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 3.05025 11.78980
MinkeyRink ST-wrapped-sq_default sat ✅ 2.16819 2.16790
Par4 Par4-wrapped-sq_default sat ✅ 22.10870 66.06000
STP STP-2019-wrapped-sq_default sat ✅ 1.88607 1.88642
stp-mergesat-fixed-wrapped-sq_default sat ✅ 7.81078 7.81004
stp-minisat-wrapped-sq_default sat ✅ 14.16850 14.16650
stp-mt-wrapped-sq_default sat ✅ 7.40758 28.89510
stp-portfolio-fixed-wrapped-sq_default sat ✅ 14.51660 24.37320
stp-riss-wrapped-sq_default unknown ❌ 0.15268 0.15288
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 321.69900 321.62100
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 146.14800 146.13000
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 20.41670 20.41420
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2400.00000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 39.98790 39.98800
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 358.39400 358.32900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 15.79820 15.79740
Boolector Boolector-wrapped-sq_default sat ✅ 18.07210 18.07140
Poolector-wrapped-sq_default sat ✅ 19.32030 76.24000
CVC4 CVC4-sq-final_default sat ✅ 17.44690 17.44460
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1200.04000
MathSAT MathSAT5_default.sh sat ✅ 20.44210 20.44160
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08831 0.08848
MinkeyRink Solver 2020.3_default sat ✅ 0.99450 3.64179
STP STP_default sat ✅ 1.59439 6.08306
STP ++ Mergsat v1_default sat ✅ 15.89220 15.89270
Yices2 Yices 2.6.2 bug fix_default sat ✅ 67.55900 67.55230
Z3 z3-4.8.8_default sat ✅ 226.45600 226.40900
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.66411 2.66367
MathSAT mathsat-5.6.6_default sat ✅ 94.27110 94.26830
STP STP 2021.0_default sat ✅ 4.82647 18.93150
Z3 z3-4.8.11_default sat ✅ 854.24000 854.12400
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 11.70990 11.70930
Bitwuzla-wrapped_default sat ✅ 17.75680 17.75640
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 28.57080 28.57280
MathSAT MathSAT-5.6.8_default sat ✅ 20.09340 20.09040
STP STP 2022.4_default sat ✅ 5.95174 5.95113
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 15.56540 15.55590
Z3++BV z3++bv_0702_default sat ✅ 72.47340 72.45900
Z3 z3-4.8.17_default sat ✅ 11.98500 11.98590
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 12.07391 11.96926
cvc5 cvc5 sat ✅ 6.73029 6.63063
SMTInterpol SMTInterpol unknown ❌ 1201.74886 1216.19193
STP STP sat ✅ 11.54963 11.44429
Yices2 Yices2 sat ✅ 19.31095 19.20308
Z3alpha Z3-alpha sat ✅ 228.40860 228.15820
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 5.32709 5.20595
Bitwuzla-MachBV-base sat ✅ 13.83656 13.71645
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 13.82815 13.70128
BVDecide bv_decide sat ✅ 47.29523 47.13219
bv_decide-nokernel sat ✅ 47.18064 47.06176
cvc5 cvc5 sat ✅ 56.43451 56.30008
SMTInterpol SMTInterpol unknown ❌ 1201.38597 1231.81189
Yices2 Yices2 sat ✅ 19.81909 19.70157
Z3alpha Z3-alpha sat ✅ 37.36039 147.70922
Z3 Z3-alpha-base sat ✅ 104.36339 104.21650
Z3-Owl-base sat ✅ 431.07401 430.91884
z3siri-base sat ✅ 104.69769 104.56630
Z3-Owl Z3-Owl sat ✅ 114.32852 114.20081