Benchmark

non-incremental/QF_BV/Sage2/bench_6253.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3009931
Compressed Size31057
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3009923
Compressed Size31067
Max. Term Depth654
Asserts 690
Declared Functions0
Declared Constants172
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite40 not159 =276
let65435 extract39 bvand2 bvor60
bvadd48496 bvmul6055 bvult127 bvule116
bvugt4 bvuge188 bvsgt18 bvshl60
bvlshr19 zero_extend10465

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.96764 0.96632
Boolector SMT17 final boolector unsat ✅ 1.47158 1.47048
CVC4 CVC4-smtcomp2017-main default unsat ✅ 58.82860 116.85500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 69.86690 69.85680
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.59554 0.57618
Q3B Q3B default unknown ❌ 600.09800 1799.84000
STP stp_st default unsat ✅ 1.69774 1.69696
stp_mt default unsat ✅ 0.86510 1.53611
Yices2 Yices2-Main default unsat ✅ 27.65440 27.64770
Z3 z3-4.5.0 default unsat ✅ 114.01900 114.00800
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.90935 0.90926
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 208.62300 208.60800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 115.44400 115.32400
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.65634 1.14696
Minkeyrink ST_st unsat ✅ 0.97366 0.96972
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.53837 0.53853
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.54722 0.56803
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.66132 0.66145
Yices2 Yices 2.6.0_default unsat ✅ 21.93590 21.93590
Z3 z3-4.7.1_default unsat ✅ 353.10200 353.08100
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.98984 0.98986
Poolector-wrapped-sq_default unsat ✅ 0.89074 3.14000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.69705 0.69703
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 154.33400 154.31600
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.94340 2.38858
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.71838 1.71834
Par4 Par4-wrapped-sq_default unsat ✅ 0.87997 2.55000
STP STP-2019-wrapped-sq_default unsat ✅ 0.57179 0.55591
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.57003 0.57019
stp-minisat-wrapped-sq_default unsat ✅ 0.55964 0.55987
stp-mt-wrapped-sq_default unsat ✅ 0.55983 0.57712
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.60325 0.65029
stp-riss-wrapped-sq_default unknown ❌ 0.54824 0.54837
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 26.32030 26.31990
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 5.33098 5.33066
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 13.08090 13.08020
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.98000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 4.93993 4.93926
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 450.02400 449.97900
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.10138 1.10135
MathSAT mathsat-5.6.6_default unsat ✅ 915.80400 915.49400
STP STP 2021.0_default unsat ✅ 0.48550 0.50636
Z3 z3-4.8.11_default unsat ✅ 393.20300 393.08300
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21797 1.21788
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 21.70170 21.70130
STP STP 2022.4_default unsat ✅ 0.37594 0.37598
STP 2022.4_default unsat ✅ 0.37709 0.37716
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 219.66400 261.09300
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 26.80010 26.79740
Z3-Owl z3-Owl-Final_default unsat ✅ 18.73880 18.73730
z3-Owl-Final_default unsat ✅ 18.50650 18.50340
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.59068 0.49071
cvc5 cvc5 unsat ✅ 15.65915 15.55893
SMTInterpol SMTInterpol unsat ✅ 69.91505 98.79382
STP STP unsat ✅ 1.58304 1.48306
Yices2 Yices2 unsat ✅ 4.50880 4.40912
Z3alpha Z3-alpha unsat ✅ 17.85714 17.75666