Benchmark

non-incremental/QF_BV/sage/app11/bench_430.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1530480
Compressed Size151176
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1530472
Compressed Size151185
Max. Term Depth4211
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1284
and1 =2072 let2878 extract1485
bvand963 bvor273 bvxor2281 bvadd14626
bvmul1182 bvsdiv16 bvult1096 bvule1501
bvslt122 bvsle162 bvshl8908 bvashr13274
zero_extend10174

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16022 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.41748 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40610 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.41400 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41125 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40602 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21951 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.29942 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24081 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 8.63716 —
CVC3-SMT-COMP-2011 default unsat ✅ 7.54452 —
CVC3-SMT-COMP-2012 default unsat ✅ 7.71480 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.70276 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.66110 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46330 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45444 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.29520 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54975 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46616 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.93214 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.80858 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.55101 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.08130 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16746 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25373 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.44386 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40218 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.34952 0.34731
Boolector SMT17 final boolector unsat ✅ 0.32039 0.31868
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.59573 6.41747
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.34175 0.34258
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.69667 0.69595
Q3B Q3B default unsat ✅ 16.47220 48.86000
STP stp_st default unsat ✅ 6.78944 6.78756
stp_mt default unsat ✅ 6.78522 6.78425
Yices2 Yices2-Main default unsat ✅ 0.12591 0.12504
Z3 z3-4.5.0 default unsat ✅ 0.30707 0.30620
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29123 0.29112
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.32317 3.32336
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.32493 0.32602
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68045 0.68031
Minkeyrink ST_st unsat ✅ 0.68120 0.68123
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 6.20955 6.20933
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 6.24635 6.24665
STP-Riss-st-2018_riss-no-stderr unsat ✅ 6.23082 6.23010
Yices2 Yices 2.6.0_default unsat ✅ 0.12164 0.12135
Z3 z3-4.7.1_default unsat ✅ 0.30073 0.30040
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.59262 0.58407
Poolector-wrapped-sq_default unsat ✅ 0.78262 2.84216
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.52141 0.52134
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.33806 3.33813
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.36611 1.36625
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.34273 1.34289
Par4 Par4-wrapped-sq_default unsat ✅ 0.13727 0.00934
STP STP-2019-wrapped-sq_default unsat ✅ 6.56315 6.56331
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.53733 6.53679
stp-minisat-wrapped-sq_default unsat ✅ 6.57591 6.57612
stp-mt-wrapped-sq_default unsat ✅ 6.54690 13.01650
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.53902 6.53866
stp-riss-wrapped-sq_default unsat ✅ 6.58959 6.58868
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12683 0.12678
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12616 0.12614
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12766 0.12762
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12557 0.12559
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12728 0.12727
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27275 0.27266
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41785 0.41783
Boolector Boolector-wrapped-sq_default unsat ✅ 0.58125 0.58121
Poolector-wrapped-sq_default unsat ✅ 0.78096 2.84036
CVC4 CVC4-sq-final_default unsat ✅ 3.77895 3.77883
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 88.07810 88.07550
MathSAT MathSAT5_default.sh unsat ✅ 0.31503 0.31497
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 1.05043 1.05048
MinkeyRink Solver 2020.3_default unsat ✅ 1.11698 1.11702
STP STP_default unsat ✅ 5.70275 5.70245
STP ++ Mergsat v1_default unsat ✅ 5.94375 5.94466
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.13914 0.13907
Z3 z3-4.8.8_default unsat ✅ 0.26191 0.26186
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42065 0.42057
MathSAT mathsat-5.6.6_default unsat ✅ 36.06000 36.02990
STP STP 2021.0_default unsat ✅ 6.17729 6.17707
Z3 z3-4.8.11_default unsat ✅ 0.29143 0.29126