Benchmark

non-incremental/QF_BV/Sage2/bench_12530.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3446850
Compressed Size32284
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3446842
Compressed Size32279
Max. Term Depth729
Asserts 778
Declared Functions0
Declared Constants190
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite143 not174 =304
let74045 extract43 bvand2 bvor66
bvadd55434 bvmul6457 bvult218 bvule143
bvugt5 bvuge227 bvsle2 bvsgt19
bvsge2 bvshl66 bvlshr23 zero_extend11494

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 2.16669 2.15405
Boolector SMT17 final boolector unsat ✅ 20.67510 20.67310
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.07100 1204.64000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.10000 599.91000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.03341 1.03316
Q3B Q3B default unknown ❌ 600.05500 1786.75000
STP stp_st default unsat ✅ 0.92649 0.92519
stp_mt default unsat ✅ 0.95972 1.84604
Yices2 Yices2-Main default unsat ✅ 0.26607 0.26542
Z3 z3-4.5.0 default unsat ✅ 2.73800 2.73734
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.30986 1.30961
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.43614 4.43598
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 507.18700 507.01900
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.77982 1.40989
Minkeyrink ST_st unsat ✅ 0.76046 0.76068
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.70202 0.70220
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.70613 0.88595
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.30737 1.30708
Yices2 Yices 2.6.0_default unsat ✅ 0.27551 0.27545
Z3 z3-4.7.1_default unsat ✅ 1.75505 1.75477
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.25583 2.25591
Poolector-wrapped-sq_default unsat ✅ 1.39850 5.11000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 12.74200 12.74250
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 103.91500 103.90000
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.03766 2.59354
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.03162 1.03161
Par4 Par4-wrapped-sq_default unsat ✅ 0.27420 0.00613
STP STP-2019-wrapped-sq_default unsat ✅ 0.70683 0.70717
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 4.53453 4.51687
stp-minisat-wrapped-sq_default unsat ✅ 0.72524 0.72542
stp-mt-wrapped-sq_default unsat ✅ 0.70338 0.85092
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 4.52434 4.70352
stp-riss-wrapped-sq_default unknown ❌ 0.64444 0.64466
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.26032 0.26032
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34149 0.34148
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.27308 0.27303
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.84000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.26503 0.26502
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 15.08770 15.08650
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.55230 2.55212
Bitwuzla-wrapped_default unsat ✅ 3.34848 3.34832
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.97162 4.97019
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.73000
STP STP 2022.4_default unsat ✅ 0.62789 0.62438
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.33852 0.33851
Z3++BV z3++bv_0702_default unsat ✅ 2.95475 2.95470
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.84000