Benchmark

non-incremental/QF_BV/sage/app7/bench_77.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3330958
Compressed Size210487
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3330950
Compressed Size210495
Max. Term Depth12800
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2211 and1
=2906 let12695 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36757 bvmul4
bvsub11941 bvsdiv9 bvult517 bvule557
bvslt213 bvsle123 bvshl11740 bvashr22016
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49858 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.51079 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.50013 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.50348 —
abziz_portfolio_2012_solvers default unsat ✅ 0.50440 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50426 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66324 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.80944 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69591 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.65500 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.97400 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.59600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.84581 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.52809 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.00196 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95922 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23643 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20642 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.88154 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.03333 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.16792 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34747 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51681 —
STP2-SMT-COMP-2012 default unsat ✅ 0.50116 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52900 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54076 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49845 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.89023 0.88916
Boolector SMT17 final boolector unsat ✅ 0.92190 0.91987
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.40250 7.08844
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64304 0.64401
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.26429 1.26463
Q3B Q3B default unsat ✅ 0.87121 2.24000
STP stp_st default unsat ✅ 0.64520 0.64409
stp_mt default unsat ✅ 0.60363 0.60279
Yices2 Yices2-Main default unsat ✅ 0.37111 0.37100
Z3 z3-4.5.0 default unsat ✅ 0.54998 0.54922
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78518 0.78512
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.97631 3.97656
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63319 0.63417
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26407 1.26407
Minkeyrink ST_st unsat ✅ 1.26534 1.26531
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57687 0.57683
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57625 0.57613
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57619 0.57619
Yices2 Yices 2.6.0_default unsat ✅ 0.37395 0.37393
Z3 z3-4.7.1_default unsat ✅ 0.59009 0.58989
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.50495 1.50491
Poolector-wrapped-sq_default unsat ✅ 1.79045 6.58662
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.19330 1.19340
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.22767 4.22794
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.89304 0.89313
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.88994 0.89007
Par4 Par4-wrapped-sq_default unsat ✅ 0.38177 0.00589
STP STP-2019-wrapped-sq_default unsat ✅ 0.59323 0.59331
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58731 0.58728
stp-minisat-wrapped-sq_default unsat ✅ 0.58567 0.58586
stp-mt-wrapped-sq_default unsat ✅ 0.58665 0.58680
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58553 0.58566
stp-riss-wrapped-sq_default unsat ✅ 0.59336 0.59355
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34437 0.34436
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34585 0.34580
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34292 0.34294
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.34285 0.34288
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34551 0.34546
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.55231 0.55235
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.26677 1.26631
Boolector Boolector-wrapped-sq_default unsat ✅ 1.49732 1.49738
Poolector-wrapped-sq_default unsat ✅ 1.78705 6.62854
CVC4 CVC4-sq-final_default unsat ✅ 5.41626 5.41089
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.80090 0.80082
MathSAT MathSAT5_default.sh unsat ✅ 0.65986 0.65980
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73925 0.73929
MinkeyRink Solver 2020.3_default unsat ✅ 0.76545 0.76524
STP STP_default unsat ✅ 0.55230 0.55238
STP ++ Mergsat v1_default unsat ✅ 0.54190 0.54365
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37855 0.37844
Z3 z3-4.8.8_default unsat ✅ 0.64591 0.64586
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24440 1.24429
Bitwuzla-wrapped_default unsat ✅ 1.34962 1.34932
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.22305 4.21955
MathSAT MathSAT-5.6.8_default unsat ✅ 0.68506 0.68489
STP STP 2022.4_default unsat ✅ 0.60133 0.60134
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37511 0.37506
Z3++BV z3++bv_0702_default unsat ✅ 0.47294 0.47275
Z3 z3-4.8.17_default unsat ✅ 0.44532 0.44714
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.97609 1.97602
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.05290 3.05313
STP STP 2022.4_default unsat ✅ 0.60503 0.60491
STP 2022.4_default unsat ✅ 0.60732 0.60728
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1312.86000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.36884 0.36876
Z3-Owl z3-Owl-Final_default unsat ✅ 1.05327 1.05303
z3-Owl-Final_default unsat ✅ 1.06834 1.06866