Benchmark

non-incremental/QF_BV/sage/app1/bench_348.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size85409
Compressed Size12156
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 85401
Compressed Size12190
Max. Term Depth216
Asserts 1
Declared Functions0
Declared Constants320
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite91 not78 and1
=217 let206 extract1 bvand50
bvor192 bvadd410 bvmul5 bvsub293
bvult293 bvule637 bvslt1 bvsle73
bvshl193 bvashr5 zero_extend347

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.25559 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04995 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05301 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05036 —
abziz_portfolio_2012_solvers default unsat ✅ 0.05102 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.05093 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.16180 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.14427 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.15913 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 4.59815 —
CVC3-SMT-COMP-2011 default unsat ✅ 4.07385 —
CVC3-SMT-COMP-2012 default unsat ✅ 4.19142 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.68995 —
CVC4-SMT-EVAL-2013 default unsat ✅ 9.07228 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.50447 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.09374 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.47793 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.49125 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.27282 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.30750 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.02118 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.26709 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04026 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17679 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.09866 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03931 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04551 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02889 0.02799
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.19346 2.32565
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.23100 2.40463
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.08452 1.08383
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.00000
STP stp-cryptominisat4 default unsat ✅ 0.16021 0.15898
stp-cmsat4-v15 default unsat ✅ 0.15953 0.15898
stp-cmsat4-mt-v15 default unsat ✅ 0.15956 0.15898
stp-minisat-v15 default unsat ✅ 0.15777 0.15698
Yices2 Yices default unsat ✅ 0.05007 0.04899
Z3 z3 4.4.0 default unsat ✅ 0.38662 0.38694
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.04808 1.04838
ABC_glucose glucose unsat ✅ 14.07450 14.08180
Boolector Boolector boolector unsat ✅ 0.03701 0.03698
Boolector preprop boolector unsat ✅ 0.03574 0.03613
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.14731 2.23456
MapleSTP MapleSTP default unsat ✅ 0.13169 0.13207
MapleSTP-mt default unsat ✅ 0.13102 0.13108
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.05365 1.05509
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.13638 0.13639
Q3B Q3B default unsat ✅ 0.64728 1.66955
STP stp-cms-exp-2016 default unsat ✅ 0.13553 0.13576
stp-cms-mt-2016 default unsat ✅ 0.13331 0.13337
stp-cms-st-2016 default unsat ✅ 0.13398 0.13396
stp-minisat-st-2016 default unsat ✅ 0.13475 0.13480
Yices2 Yices-2.4.2 default unsat ✅ 0.05318 0.05314
Z3 z3-4.4.1 default unsat ✅ 0.37291 0.37431
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.03560 0.03399
Boolector SMT17 final boolector unsat ✅ 0.03706 0.03590
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.22258 2.37075
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.98418 0.98346
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04258 0.04268
Q3B Q3B default unsat ✅ 0.63734 1.63459
STP stp_st default unsat ✅ 0.81295 0.81255
stp_mt default unsat ✅ 0.81274 0.81192
Yices2 Yices2-Main default unsat ✅ 0.05201 0.05197
Z3 z3-4.5.0 default unsat ✅ 0.41408 0.41402
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04915 0.04910
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.34531 2.34540
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.96668 0.96669
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04891 0.04897
Minkeyrink ST_st unsat ✅ 0.04813 0.04813
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.35469 0.35474
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.35465 0.35466
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.35428 0.35437
Yices2 Yices 2.6.0_default unsat ✅ 0.04701 0.04688
Z3 z3-4.7.1_default unsat ✅ 0.39072 0.39056
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.05781 0.05780
Poolector-wrapped-sq_default unsat ✅ 0.17784 0.32230
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.04720 0.04721
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.20275 1.20274
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05773 0.05790
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.05626 0.05631
Par4 Par4-wrapped-sq_default unsat ✅ 0.05389 0.00595
STP STP-2019-wrapped-sq_default unsat ✅ 0.20694 0.20706
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20627 0.20638
stp-minisat-wrapped-sq_default unsat ✅ 0.20628 0.20643
stp-mt-wrapped-sq_default unsat ✅ 0.20583 0.20600
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.20555 0.20569
stp-riss-wrapped-sq_default unsat ✅ 0.20641 0.20655
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05211 0.05210
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05103 0.05103
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05126 0.05123
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.11451 0.11447
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05075 0.05074
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.43878 0.43876
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.05599 0.05592
MathSAT mathsat-5.6.6_default unsat ✅ 0.61572 0.61557
STP STP 2021.0_default unsat ✅ 0.61686 0.61698
Z3 z3-4.8.11_default unsat ✅ 0.40219 0.40205
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.25574 0.15606
cvc5 cvc5 unsat ✅ 1.33655 1.23612
SMTInterpol SMTInterpol unsat ✅ 904.48446 942.98039
STP STP unsat ✅ 0.32348 0.22366
Yices2 Yices2 unsat ✅ 0.28651 0.18678
Z3alpha Z3-alpha unsat ✅ 0.29887 0.19915