Benchmark

non-incremental/QF_BV/sage/app7/bench_1057.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2454321
Compressed Size158821
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2454313
Compressed Size158827
Max. Term Depth9458
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1759 and1
=2364 let9359 extract1293 bvand25236
bvor16552 bvxor1534 bvadd26980 bvmul1
bvsub8726 bvult443 bvule484 bvslt205
bvsle103 bvshl8559 bvashr16127 zero_extend1016

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.37036 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40315 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.39895 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40370 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40686 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40724 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.49583 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.57938 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.52528 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 211.25900 —
CVC3-SMT-COMP-2011 default unsat ✅ 177.54200 —
CVC3-SMT-COMP-2012 default unsat ✅ 185.30500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.03263 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.15895 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.75066 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.71635 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.92355 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.91043 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.64563 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.11886 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.57570 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.00714 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.39382 —
STP2-SMT-COMP-2012 default unsat ✅ 0.36904 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.38332 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.46157 —
Z3-SMT-COMP-2011 default unsat ✅ 0.39788 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.71440 0.71389
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.20863 5.18121
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.19949 5.17621
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.50607 0.50492
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.17000
STP stp-cryptominisat4 default unsat ✅ 0.35084 0.34995
stp-cmsat4-v15 default unsat ✅ 0.34924 0.34795
stp-cmsat4-mt-v15 default unsat ✅ 0.34876 0.34795
stp-minisat-v15 default unsat ✅ 0.35065 0.34895
Yices2 Yices default unsat ✅ 0.14298 0.14198
Z3 z3 4.4.0 default unsat ✅ 0.42198 0.42194
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.40058 1.40132
ABC_glucose glucose unsat ✅ 1.42133 1.39010
Boolector Boolector boolector unsat ✅ 0.81289 0.81329
Boolector preprop boolector unsat ✅ 0.79095 0.79183
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.16808 5.13658
MapleSTP MapleSTP default unsat ✅ 0.33472 0.33487
MapleSTP-mt default unsat ✅ 0.33424 0.33456
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.45049 0.45157
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.45356 0.45381
Q3B Q3B default unsat ✅ 0.68633 1.61000
STP stp-cms-exp-2016 default unsat ✅ 0.33992 0.34005
stp-cms-mt-2016 default unsat ✅ 0.34916 0.34934
stp-cms-st-2016 default unsat ✅ 0.34593 0.34607
stp-minisat-st-2016 default unsat ✅ 0.34519 0.34535
Yices2 Yices-2.4.2 default unsat ✅ 0.14243 0.14245
Z3 z3-4.4.1 default unsat ✅ 0.40838 0.40981
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.65181 0.65101
Boolector SMT17 final boolector unsat ✅ 0.65834 0.65666
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.16801 5.07359
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.46742 0.46772
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.93593 0.93615
Q3B Q3B default unsat ✅ 0.67103 1.53972
STP stp_st default unsat ✅ 0.42400 0.42290
stp_mt default unsat ✅ 0.41995 0.41841
Yices2 Yices2-Main default unsat ✅ 0.13600 0.13464
Z3 z3-4.5.0 default unsat ✅ 0.41157 0.41072
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.59325 0.59311
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.92074 2.92070
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.45028 0.45138
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.94863 0.94862
Minkeyrink ST_st unsat ✅ 0.96770 0.96768
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.43024 0.43025
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.43257 0.43260
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.43317 0.43322
Yices2 Yices 2.6.0_default unsat ✅ 0.13012 0.13002
Z3 z3-4.7.1_default unsat ✅ 0.43570 0.43554
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.08928 2.07921
Poolector-wrapped-sq_default unsat ✅ 1.31558 4.66248
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.90773 0.90771
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.02381 3.02390
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.67420 0.67432
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.67804 0.67816
Par4 Par4-wrapped-sq_default unsat ✅ 0.14354 0.00762
STP STP-2019-wrapped-sq_default unsat ✅ 0.43574 0.43586
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.43289 0.43303
stp-minisat-wrapped-sq_default unsat ✅ 0.43618 0.43629
stp-mt-wrapped-sq_default unsat ✅ 0.43438 0.43448
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.43100 0.43113
stp-riss-wrapped-sq_default unsat ✅ 0.43455 0.43469
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.13626 0.13625
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.13516 0.13515
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.13605 0.13607
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.13459 0.13455
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.13607 0.13604
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.42359 0.42353
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.91547 0.91531
Boolector Boolector-wrapped-sq_default unsat ✅ 1.09883 1.09850
Poolector-wrapped-sq_default unsat ✅ 1.38496 4.53838
CVC4 CVC4-sq-final_default unsat ✅ 3.99049 3.99019
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.57212 0.57196
MathSAT MathSAT5_default.sh unsat ✅ 0.47035 0.47025
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.55685 0.55687
MinkeyRink Solver 2020.3_default unsat ✅ 0.57878 0.57885
STP STP_default unsat ✅ 0.40835 0.40842
STP ++ Mergsat v1_default unsat ✅ 0.40429 0.40607
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.16196 0.16186
Z3 z3-4.8.8_default unsat ✅ 0.29520 0.29515
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90195 0.90184
MathSAT mathsat-5.6.6_default unsat ✅ 0.47488 0.47486
STP STP 2021.0_default unsat ✅ 0.41942 0.41950
Z3 z3-4.8.11_default unsat ✅ 0.33938 0.33929
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.92924 0.82891
cvc5 cvc5 unsat ✅ 0.77278 0.67349
SMTInterpol SMTInterpol unknown ❌ 1202.74473 1829.61142
STP STP unsat ✅ 17.62486 17.52466
Yices2 Yices2 unsat ✅ 0.31568 0.21570
Z3alpha Z3-alpha unsat ✅ 0.54318 0.44409