Benchmark

non-incremental/QF_BV/sage/app1/bench_2070.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size19286
Compressed Size3293
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 19278
Compressed Size3305
Max. Term Depth65
Asserts 1
Declared Functions0
Declared Constants5
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite51 not20 and1
=22 let55 bvor3 bvadd138
bvsub103 bvsdiv42 bvult94 bvule89
bvslt3 bvsle159 bvshl3 zero_extend55

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.32180 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.02439 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.02360 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.03044 —
abziz_portfolio_2012_solvers default unsat ✅ 0.02770 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.03935 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.30017 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.01746 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.26755 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 55.48130 —
CVC3-SMT-COMP-2011 default unsat ✅ 49.47590 —
CVC3-SMT-COMP-2012 default unsat ✅ 51.16240 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.03210 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.03144 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 2.61166 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 5.81816 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.02141 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 2.27485 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.23808 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.87304 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.86558 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.24934 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.01828 —
STP2-SMT-COMP-2012 default unsat ✅ 0.01368 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.01779 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01498 —
Z3-SMT-COMP-2011 default unsat ✅ 0.01928 —
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.79322 0.79263
Boolector SMT17 final boolector unsat ✅ 0.72681 0.72607
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.04051 0.05579
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 4.67526 4.67581
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.01565 0.01519
Q3B Q3B default unknown ❌ 600.07700 1786.63000
STP stp_st default unsat ✅ 0.01486 0.01376
stp_mt default unsat ✅ 0.01717 0.01378
Yices2 Yices2-Main default unsat ✅ 0.01405 0.00439
Z3 z3-4.5.0 default unsat ✅ 0.04955 0.03660
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.72932 0.72897
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.08232 0.08250
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 4.68532 4.68571
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.01537 0.01541
Minkeyrink ST_st unsat ✅ 0.01530 0.01539
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.01202 0.01061
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.01123 0.01072
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.01033 0.01031
Yices2 Yices 2.6.0_default unsat ✅ 0.01900 0.00676
Z3 z3-4.7.1_default unsat ✅ 0.03766 0.03756
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.98019 0.98015
Poolector-wrapped-sq_default unsat ✅ 0.48097 0.48946
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.36423 0.36417
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.03739 0.03765
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.02150 0.02169
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.02012 0.02019
Par4 Par4-wrapped-sq_default unsat ✅ 0.01651 0.00581
STP STP-2019-wrapped-sq_default unsat ✅ 0.01825 0.01842
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.01829 0.01840
stp-minisat-wrapped-sq_default unsat ✅ 0.01860 0.01875
stp-mt-wrapped-sq_default unsat ✅ 0.01890 0.01905
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.01843 0.01858
stp-riss-wrapped-sq_default unsat ✅ 0.01848 0.01862
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01061 0.00685
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01152 0.00696
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01380 0.00697
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.01792 0.01788
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.00909 0.00723
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03951 0.03947
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.29689 0.16755
Bitwuzla-MachBV-base unsat ✅ 0.68853 0.56305
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.61520 0.47804
BVDecide bv_decide unsat ✅ 20.32102 20.14161
bv_decide-nokernel unsat ✅ 8.40258 8.23464
cvc5 cvc5 unsat ✅ 2.14577 2.02127
SMTInterpol SMTInterpol unsat ✅ 1.50485 4.14255
Yices2 Yices2 unsat ✅ 0.24724 0.12729
Z3alpha Z3-alpha unsat ✅ 0.40155 0.28434
Z3 Z3-alpha-base unsat ✅ 0.29124 0.16682
Z3-Owl-base unsat ✅ 0.27536 0.15478
z3siri-base unsat ✅ 0.35854 0.22573
Z3-Owl Z3-Owl unsat ✅ 0.79157 0.66094