Benchmark

non-incremental/QF_BV/Sage2/bench_2905.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size15930
Compressed Size1992
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 15922
Compressed Size1978
Max. Term Depth20
Asserts 40
Declared Functions0
Declared Constants48
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 =11 let302 bvor28
bvadd191 bvmul16 bvult8 bvule8
bvuge11 bvsge1 bvshl28 zero_extend39

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 3.34050 2.90549
Boolector SMT17 final boolector unsat ✅ 3.87943 3.87805
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.20700 1204.89000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.76171 0.76190
MinkeyRink MinkeyRink 2017.3a default unknown ❌ 600.03300 1207.28000
Q3B Q3B default unsat ✅ 390.52500 773.79000
STP stp_st default unknown ❌ 600.08700 600.04300
stp_mt default unknown ❌ 600.07000 2386.45000
Yices2 Yices2-Main default unsat ✅ 0.00861 0.00813
Z3 z3-4.5.0 default unknown ❌ 600.01900 599.93600
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 2.11208 2.11135
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.87641 4.87607
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 10.61120 10.61110
MinkeyRink Minkeyrink MT_mt unknown ❌ 1200.07000 4775.44000
Minkeyrink ST_st unknown ❌ 1200.02000 1200.00000
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 278.10000 278.06600
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 111.71200 444.10500
STP-Riss-st-2018_riss-no-stderr unsat ✅ 72.02320 72.02150
Yices2 Yices 2.6.0_default unsat ✅ 0.01135 0.01126
Z3 z3-4.7.1_default unsat ✅ 842.49000 842.43400
SMT-COMP 2019 0.25 (6/8) Boolector Boolector-wrapped-sq_default unsat ✅ 2.97543 2.97492
Poolector-wrapped-sq_default unsat ✅ 3.20653 12.34000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 3.32831 3.32786
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 22.94780 22.93580
MinkeyRink MinkeyRink MT-wrapped-sq_default unknown ❌ 2400.06000 9537.97000
MinkeyRink ST-wrapped-sq_default unknown ❌ 2400.02000 2400.01000
Par4 Par4-wrapped-sq_default unsat ✅ 0.02049 0.00803
STP STP-2019-wrapped-sq_default unsat ✅ 1208.27000 1208.08000
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 1870.00000 1869.85000
stp-minisat-wrapped-sq_default unknown ❌ 2400.02000 2399.67000
stp-mt-wrapped-sq_default unsat ✅ 951.84200 3771.84000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.02000 5943.30000
stp-riss-wrapped-sq_default unknown ❌ 0.14083 0.14105
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01121 0.01121
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01695 0.01693
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01877 0.01876
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2400.11000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.02420 0.02421
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.03000 2400.04000
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.89130 2.89120
Bitwuzla-wrapped_default unsat ✅ 3.13132 3.13110
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 31.53290 31.52960
MathSAT MathSAT-5.6.8_default unsat ✅ 2.87814 2.87798
STP STP 2022.4_default unsat ✅ 1.99972 1.99949
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01300 0.01297
Z3++BV z3++bv_0702_default unsat ✅ 4.80956 4.80887
Z3 z3-4.8.17_default unsat ✅ 26.52870 26.53150
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 2.59090 2.49096
cvc5 cvc5 unsat ✅ 16.97996 16.87998
SMTInterpol SMTInterpol unsat ✅ 5.86047 16.97824
STP STP unsat ✅ 2.66565 2.56556
Yices2 Yices2 unsat ✅ 0.22260 0.12263
Z3alpha Z3-alpha unsat ✅ 37.51443 37.41414