Benchmark

non-incremental/QF_BV/sage/app7/bench_258.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3308671
Compressed Size210007
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3308663
Compressed Size210014
Max. Term Depth12666
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2126 and1
=2811 let12561 extract1547 bvand34103
bvor22404 bvxor1963 bvadd36553 bvmul2
bvsub11905 bvsdiv5 bvult487 bvule526
bvslt212 bvsle121 bvshl11680 bvashr21976
zero_extend1310

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49072 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.49967 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.49989 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.49494 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49914 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.49483 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65599 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79251 —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.55600 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.76400 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.33500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.85610 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.43884 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98404 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.94311 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23229 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.85750 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.00480 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.14972 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34346 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51847 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49254 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50901 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.51690 —
Z3-SMT-COMP-2011 default unsat ✅ 0.48548 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.87542 0.87468
Boolector SMT17 final boolector unsat ✅ 0.93736 0.93632
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.29700 6.90117
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.69210 0.69222
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.31274 1.31188
Q3B Q3B default unsat ✅ 0.86913 2.15824
STP stp_st default unsat ✅ 0.57351 0.57368
stp_mt default unsat ✅ 0.60716 0.60635
Yices2 Yices2-Main default unsat ✅ 0.20735 0.20631
Z3 z3-4.5.0 default unsat ✅ 0.70914 0.70815
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78701 0.78685
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.95391 3.95407
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62658 0.62762
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26818 1.26823
Minkeyrink ST_st unsat ✅ 1.27576 1.27566
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57486 0.57488
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57569 0.57551
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57466 0.57468
Yices2 Yices 2.6.0_default unsat ✅ 0.20271 0.20259
Z3 z3-4.7.1_default unsat ✅ 0.72192 0.72170
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.50020 1.50013
Poolector-wrapped-sq_default unsat ✅ 1.79171 6.67000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.22524 1.22501
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.16900 4.16876
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.89356 0.89366
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.89391 0.89373
Par4 Par4-wrapped-sq_default unsat ✅ 0.21418 0.00609
STP STP-2019-wrapped-sq_default unsat ✅ 0.58838 0.58851
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.59455 0.59458
stp-minisat-wrapped-sq_default unsat ✅ 0.58806 0.58800
stp-mt-wrapped-sq_default unsat ✅ 0.58714 0.58728
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58276 0.58286
stp-riss-wrapped-sq_default unsat ✅ 0.58775 0.58785
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.21144 0.21141
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.20890 0.20889
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.20826 0.20822
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.20541 0.20541
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.20805 0.20803
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.76932 0.76930
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21925 1.21915
Bitwuzla-wrapped_default unsat ✅ 1.31673 1.31673
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.18366 4.18380
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66921 0.66916
STP STP 2022.4_default unsat ✅ 0.62120 0.62008
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.24162 0.24157
Z3++BV z3++bv_0702_default unsat ✅ 0.47896 0.47889
Z3 z3-4.8.17_default unsat ✅ 0.47388 0.47567
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.15225 1.05261
cvc5 cvc5 unsat ✅ 1.92992 1.82908
SMTInterpol SMTInterpol unknown ❌ 1202.74906 1369.38137
STP STP unsat ✅ 32.50129 32.38383
Yices2 Yices2 unsat ✅ 0.37278 0.27287
Z3alpha Z3-alpha unsat ✅ 0.64736 0.54761
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.96500 0.84281
Bitwuzla-MachBV-base unsat ✅ 1.22686 1.09866
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.38460 1.25551
BVDecide bv_decide unknown ❌ 1201.38174 1200.94968
bv_decide-nokernel unknown ❌ 1201.35938 1200.91366
cvc5 cvc5 unsat ✅ 0.76867 0.65187
SMTInterpol SMTInterpol unknown ❌ 1201.85770 2368.81014
Yices2 Yices2 unsat ✅ 0.41662 0.28170
Z3alpha Z3-alpha unsat ✅ 0.95990 0.94522
Z3 Z3-alpha-base unsat ✅ 0.52603 0.40650
Z3-Owl-base unsat ✅ 1.30292 1.18834
z3siri-base unsat ✅ 0.52778 0.40457
Z3-Owl Z3-Owl unsat ✅ 1.07932 0.94490