Benchmark

non-incremental/QF_BV/sage/app7/bench_1125.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2227091
Compressed Size147035
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2227083
Compressed Size147039
Max. Term Depth8574
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1728 and1
=2327 let8475 extract1280 bvand22689
bvor14852 bvxor1512 bvadd24401 bvmul1
bvsub7874 bvult440 bvule481 bvslt205
bvsle102 bvshl7709 bvashr14450 zero_extend999

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.34473 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.38814 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.37859 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.36487 —
abziz_portfolio_2012_solvers default unsat ✅ 0.37075 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.37674 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.46609 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.52467 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.49044 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 94.55960 —
CVC3-SMT-COMP-2011 default unsat ✅ 79.95740 —
CVC3-SMT-COMP-2012 default unsat ✅ 83.61370 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.89813 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.94164 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.65243 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.63368 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.82689 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.80445 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.59487 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.93708 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.14617 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.94797 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.37049 —
STP2-SMT-COMP-2012 default unsat ✅ 0.34108 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.35624 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.42770 —
Z3-SMT-COMP-2011 default unsat ✅ 0.36559 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.61234 0.61191
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.95104 4.76327
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.94391 4.76127
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.46307 0.46193
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.99000
STP stp-cryptominisat4 default unsat ✅ 0.29921 0.29795
stp-cmsat4-v15 default unsat ✅ 0.30156 0.30095
stp-cmsat4-mt-v15 default unsat ✅ 0.29861 0.29795
stp-minisat-v15 default unsat ✅ 0.29980 0.29895
Yices2 Yices default unsat ✅ 0.13076 0.12998
Z3 z3 4.4.0 default unsat ✅ 0.44994 0.44993
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.26353 1.26389
ABC_glucose glucose unsat ✅ 1.24933 1.24999
Boolector Boolector boolector unsat ✅ 0.71242 0.71276
Boolector preprop boolector unsat ✅ 0.72291 0.72328
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.87135 4.64421
MapleSTP MapleSTP default unsat ✅ 0.28666 0.28679
MapleSTP-mt default unsat ✅ 0.30627 0.30642
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.41600 0.41729
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.41031 0.41048
Q3B Q3B default unsat ✅ 0.64764 1.62000
STP stp-cms-exp-2016 default unsat ✅ 0.29342 0.29353
stp-cms-mt-2016 default unsat ✅ 0.29803 0.29816
stp-cms-st-2016 default unsat ✅ 0.29786 0.29800
stp-minisat-st-2016 default unsat ✅ 0.29946 0.29965
Yices2 Yices-2.4.2 default unsat ✅ 0.13067 0.13073
Z3 z3-4.4.1 default unsat ✅ 0.41988 0.42144
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.57737 0.57654
Boolector SMT17 final boolector unsat ✅ 0.56573 0.56414
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.05700 4.90049
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.42548 0.42526
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.86291 0.86236
Q3B Q3B default unsat ✅ 0.61788 1.37000
STP stp_st default unsat ✅ 0.43458 0.43303
stp_mt default unsat ✅ 0.39060 0.39053
Yices2 Yices2-Main default unsat ✅ 0.12671 0.12535
Z3 z3-4.5.0 default unsat ✅ 0.50400 0.50005
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.50066 0.50052
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.63009 2.63008
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.41263 0.41364
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.88015 0.88020
Minkeyrink ST_st unsat ✅ 0.86351 0.86353
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.39177 0.39174
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.39336 0.39341
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.39147 0.39151
Yices2 Yices 2.6.0_default unsat ✅ 0.11978 0.11968
Z3 z3-4.7.1_default unsat ✅ 0.54144 0.54127
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.95193 0.95194
Poolector-wrapped-sq_default unsat ✅ 1.19023 4.31061
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.77205 0.77199
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.73950 2.73949
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.61884 0.61901
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.61891 0.61891
Par4 Par4-wrapped-sq_default unsat ✅ 0.13149 0.00588
STP STP-2019-wrapped-sq_default unsat ✅ 0.38957 0.38959
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.39404 0.39417
stp-minisat-wrapped-sq_default unsat ✅ 0.39491 0.39506
stp-mt-wrapped-sq_default unsat ✅ 0.39651 0.39665
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.39347 0.39341
stp-riss-wrapped-sq_default unsat ✅ 0.39677 0.39688
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12510 0.12505
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12487 0.12487
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12459 0.12460
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12302 0.12301
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12499 0.12497
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.45894 0.45884
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.78690 0.78684
MathSAT mathsat-5.6.6_default unsat ✅ 0.46128 0.45938
STP STP 2021.0_default unsat ✅ 0.37791 0.37797
Z3 z3-4.8.11_default unsat ✅ 0.31537 0.31528
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.81976 0.81965
Bitwuzla-wrapped_default unsat ✅ 0.87619 0.87620
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.71096 2.70171
MathSAT MathSAT-5.6.8_default unsat ✅ 0.45824 0.45066
STP STP 2022.4_default unsat ✅ 0.40619 0.40615
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14940 0.14923
Z3++BV z3++bv_0702_default unsat ✅ 0.32459 0.32454
Z3 z3-4.8.17_default unsat ✅ 0.33950 0.33828