Benchmark

non-incremental/QF_BV/Sage2/bench_12861.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1384542
Compressed Size19995
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1384534
Compressed Size19986
Max. Term Depth720
Asserts 399
Declared Functions0
Declared Constants364
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 ite420 not49
=54 let31991 extract5 bvand4
bvor4 bvadd10402 bvmul3053 bvudiv8
bvult484 bvule122 bvugt8 bvuge148
bvsge3 bvshl7327 bvlshr29 zero_extend10269

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 7.90209 7.89963
Boolector SMT17 final boolector unsat ✅ 20.91990 20.91930
CVC4 CVC4-smtcomp2017-main default unsat ✅ 327.39100 657.35500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 475.93000 475.73700
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 3.65215 3.67685
Q3B Q3B default unknown ❌ 600.04700 1799.70000
STP stp_st default unsat ✅ 144.55900 144.52300
stp_mt default unsat ✅ 55.53130 212.24100
Yices2 Yices2-Main default unsat ✅ 1.94568 1.94457
Z3 z3-4.5.0 default unsat ✅ 58.56030 58.54910
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 4.71478 4.71452
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 19.59440 19.59350
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 538.83100 538.70200
MinkeyRink Minkeyrink MT_mt unsat ✅ 2.07754 4.34970
Minkeyrink ST_st unsat ✅ 23.77510 23.77460
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 50.80770 50.79790
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 34.84500 131.40500
STP-Riss-st-2018_riss-no-stderr unsat ✅ 17.61770 17.61790
Yices2 Yices 2.6.0_default unsat ✅ 7.36454 7.36448
Z3 z3-4.7.1_default unsat ✅ 54.41120 54.41100
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 15.02880 15.02960
Poolector-wrapped-sq_default unsat ✅ 11.17200 43.78000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 29.92200 29.91930
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 48.69600 48.67040
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 2.25570 5.45523
MinkeyRink ST-wrapped-sq_default unsat ✅ 21.70610 21.70450
Par4 Par4-wrapped-sq_default unsat ✅ 5.01723 14.86000
STP STP-2019-wrapped-sq_default unsat ✅ 172.92600 172.88700
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 103.87500 103.86100
stp-minisat-wrapped-sq_default unsat ✅ 133.07400 133.02500
stp-mt-wrapped-sq_default unsat ✅ 82.31350 315.31700
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 198.57800 481.48900
stp-riss-wrapped-sq_default unknown ❌ 2.44836 2.44871
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 7.79925 7.79869
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 8.75471 8.75377
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 3.42727 3.42740
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.07000 2399.99000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 5.19230 5.19110
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 217.16500 217.05100
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 7.76173 7.75944
Boolector Boolector-wrapped-sq_default unsat ✅ 16.95340 16.95420
Poolector-wrapped-sq_default unsat ✅ 18.62480 73.24400
CVC4 CVC4-sq-final_default unsat ✅ 133.30300 133.27000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.91000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.76000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.23662 1.23688
MinkeyRink Solver 2020.3_default unsat ✅ 4.81759 15.36710
STP STP_default unsat ✅ 2.18490 5.56471
STP ++ Mergsat v1_default unsat ✅ 17.58470 17.58510
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 6.21823 12.40840
Z3 z3-4.8.8_default unsat ✅ 242.55500 242.52400
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 16.04660 16.04540
Bitwuzla-wrapped_default unsat ✅ 15.76840 15.76700
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 174.82100 174.77700
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.06000 1199.85000
STP STP 2022.4_default unsat ✅ 10.77890 10.77900
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 6.03074 6.03034
Z3++BV z3++bv_0702_default unsat ✅ 67.78860 67.76570
Z3 z3-4.8.17_default unsat ✅ 35.97720 35.97780
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 6.26319 6.16023
cvc5 cvc5 unsat ✅ 645.58957 645.39508
SMTInterpol SMTInterpol unsat ✅ 29.55710 53.25707
STP STP unsat ✅ 5.18516 5.08489
Yices2 Yices2 unsat ✅ 3.79339 3.69338
Z3alpha Z3-alpha unsat ✅ 24.86636 24.76388
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 8.51506 8.39735
Bitwuzla-MachBV-base unsat ✅ 11.09633 10.96560
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 11.04286 10.91098
BVDecide bv_decide unsat ✅ 43.31101 43.15630
bv_decide-nokernel unsat ✅ 29.33704 29.18067
cvc5 cvc5 unsat ✅ 260.49586 260.31615
SMTInterpol SMTInterpol unsat ✅ 27.64131 44.82306
Yices2 Yices2 unsat ✅ 4.72827 4.58667
Z3alpha Z3-alpha unsat ✅ 181.98402 724.54219
Z3 Z3-alpha-base unsat ✅ 241.57185 241.42640
Z3-Owl-base unsat ✅ 975.44811 975.23856
z3siri-base unsat ✅ 246.96520 246.81802
Z3-Owl Z3-Owl unsat ✅ 165.60930 165.46258