Benchmark

non-incremental/QF_BV/sage/app7/bench_918.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2647963
Compressed Size169228
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2647955
Compressed Size169233
Max. Term Depth10176
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1805 and1
=2421 let10077 extract1315 bvand27355
bvor17972 bvxor1575 bvadd29155 bvmul1
bvsub9437 bvult445 bvule490 bvslt206
bvsle105 bvshl9266 bvashr17509 zero_extend1038

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.39754 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.42361 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.42150 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.42896 —
abziz_portfolio_2012_solvers default unsat ✅ 0.42044 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.42896 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.53308 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.62907 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.56469 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 225.18400 —
CVC3-SMT-COMP-2011 default unsat ✅ 189.26100 —
CVC3-SMT-COMP-2012 default unsat ✅ 198.02300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.16523 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.39692 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.81015 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.77597 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.00226 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.96850 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.69524 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.29977 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.94007 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.08152 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.42714 —
STP2-SMT-COMP-2012 default unsat ✅ 0.39696 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.40496 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.48434 —
Z3-SMT-COMP-2011 default unsat ✅ 0.42458 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.77097 0.76988
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.44542 5.57215
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.44840 5.57515
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.53524 0.53392
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.81000
STP stp-cryptominisat4 default unsat ✅ 0.37339 0.37294
stp-cmsat4-v15 default unsat ✅ 0.37450 0.37394
stp-cmsat4-mt-v15 default unsat ✅ 0.37678 0.37594
stp-minisat-v15 default unsat ✅ 0.37385 0.37294
Yices2 Yices default unsat ✅ 0.15434 0.15398
Z3 z3 4.4.0 default unsat ✅ 0.47451 0.47493
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.50810 1.50922
ABC_glucose glucose unsat ✅ 1.50327 1.50471
Boolector Boolector boolector unsat ✅ 0.87461 0.87516
Boolector preprop boolector unsat ✅ 0.85357 0.85398
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.42469 5.54914
MapleSTP MapleSTP default unsat ✅ 0.35766 0.35784
MapleSTP-mt default unsat ✅ 0.38047 0.38062
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.48520 0.48642
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.48919 0.48948
Q3B Q3B default unsat ✅ 0.72078 1.68000
STP stp-cms-exp-2016 default unsat ✅ 0.36417 0.36434
stp-cms-mt-2016 default unsat ✅ 0.37007 0.37023
stp-cms-st-2016 default unsat ✅ 0.36933 0.36951
stp-minisat-st-2016 default unsat ✅ 0.37120 0.37155
Yices2 Yices-2.4.2 default unsat ✅ 0.15452 0.15458
Z3 z3-4.4.1 default unsat ✅ 0.56087 0.56261
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.69833 0.69775
Boolector SMT17 final boolector unsat ✅ 0.71678 0.71667
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.46948 5.55555
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.52713 0.52700
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.03406 1.03434
Q3B Q3B default unsat ✅ 0.70389 1.54000
STP stp_st default unsat ✅ 0.48372 0.48253
stp_mt default unsat ✅ 0.45458 0.45262
Yices2 Yices2-Main default unsat ✅ 0.14680 0.14588
Z3 z3-4.5.0 default unsat ✅ 0.41853 0.41765
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.63592 0.63578
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.15700 3.15124
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.48137 0.48245
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.01683 1.01680
Minkeyrink ST_st unsat ✅ 1.01989 1.01963
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.46336 0.46339
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.46466 0.46468
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.46276 0.46274
Yices2 Yices 2.6.0_default unsat ✅ 0.13932 0.13928
Z3 z3-4.7.1_default unsat ✅ 0.45582 0.45570
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.18666 1.18639
Poolector-wrapped-sq_default unsat ✅ 1.48880 5.39020
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.97120 0.97122
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.29128 3.29129
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.72180 0.72199
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.72066 0.72068
Par4 Par4-wrapped-sq_default unsat ✅ 0.14946 0.00592
STP STP-2019-wrapped-sq_default unsat ✅ 0.46791 0.46803
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.46371 0.46380
stp-minisat-wrapped-sq_default unsat ✅ 0.46823 0.46816
stp-mt-wrapped-sq_default unsat ✅ 0.46875 0.46889
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.46377 0.46388
stp-riss-wrapped-sq_default unsat ✅ 0.46961 0.46976
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.14618 0.14613
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.14526 0.14525
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.14885 0.14883
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.14613 0.14610
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.14619 0.14618
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.41020 0.41001
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.97633 0.97630
Boolector Boolector-wrapped-sq_default unsat ✅ 1.18024 2.26014
Poolector-wrapped-sq_default unsat ✅ 1.49527 5.36836
CVC4 CVC4-sq-final_default unsat ✅ 4.30061 4.30012
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.61526 0.61525
MathSAT MathSAT5_default.sh unsat ✅ 0.55691 0.55344
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.59640 0.59654
MinkeyRink Solver 2020.3_default unsat ✅ 0.61996 0.62003
STP STP_default unsat ✅ 0.44014 0.44022
STP ++ Mergsat v1_default unsat ✅ 0.43223 0.43378
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.17336 0.17328
Z3 z3-4.8.8_default unsat ✅ 0.30748 0.30738
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.52091 1.52076
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.45088 2.45128
STP STP 2022.4_default unsat ✅ 0.47495 0.47494
STP 2022.4_default unsat ✅ 0.47580 0.47579
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 637.60000 734.54700
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.16865 0.16855
Z3-Owl z3-Owl-Final_default unsat ✅ 1.02673 1.02678
z3-Owl-Final_default unsat ✅ 1.03107 1.03132