Benchmark

non-incremental/QF_BV/sage/app1/bench_1896.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size79459
Compressed Size11355
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 79451
Compressed Size11342
Max. Term Depth194
Asserts 1
Declared Functions0
Declared Constants300
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite85 not75 and1
=202 let184 extract1 bvand44
bvor180 bvadd387 bvmul5 bvsub265
bvult275 bvule598 bvslt2 bvsle57
bvshl181 bvashr5 zero_extend325

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.96082 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04811 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.04908 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05348 —
abziz_portfolio_2012_solvers default unsat ✅ 0.05064 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unsat ✅ 0.12797 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.12533 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.83082 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.45481 —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.64220 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.25838 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.41569 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.91403 —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.39928 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.25360 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.28606 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.24322 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04300 —
STP2-SMT-COMP-2012 default unsat ✅ 0.07395 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.09287 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.04046 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04350 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02339 0.02300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.12389 2.18767
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.13005 2.20266
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.89540 0.89486
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.09000
STP stp-cryptominisat4 default unsat ✅ 0.05827 0.05699
stp-cmsat4-v15 default unsat ✅ 0.05662 0.05599
stp-cmsat4-mt-v15 default unsat ✅ 0.05665 0.05599
stp-minisat-v15 default unsat ✅ 0.05629 0.05499
Yices2 Yices default unsat ✅ 0.04467 0.04399
Z3 z3 4.4.0 default unsat ✅ 0.31648 0.31695
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.95994 0.96005
ABC_glucose glucose unsat ✅ 12.70440 12.71180
Boolector Boolector boolector unsat ✅ 0.02941 0.02985
Boolector preprop boolector unsat ✅ 0.02831 0.02863
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.09931 2.14324
MapleSTP MapleSTP default unsat ✅ 0.08462 0.08459
MapleSTP-mt default unsat ✅ 0.08374 0.08406
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.90836 0.90988
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.09464 0.09466
Q3B Q3B default unsat ✅ 0.52855 1.31438
STP stp-cms-exp-2016 default unsat ✅ 0.08342 0.08373
stp-cms-mt-2016 default unsat ✅ 0.08382 0.08383
stp-cms-st-2016 default unsat ✅ 0.08300 0.08303
stp-minisat-st-2016 default unsat ✅ 0.08254 0.08256
Yices2 Yices-2.4.2 default unsat ✅ 0.04688 0.04669
Z3 z3-4.4.1 default unsat ✅ 0.35363 0.35518
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02837 0.02661
Boolector SMT17 final boolector unsat ✅ 0.02889 0.02737
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.17806 2.28765
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.81478 0.81477
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04271 0.04231
Q3B Q3B default unknown ❌ 600.04100 1799.64000
STP stp_st default unsat ✅ 0.10869 0.10812
stp_mt default unsat ✅ 0.11284 0.11200
Yices2 Yices2-Main default unsat ✅ 0.04297 0.04239
Z3 z3-4.5.0 default unsat ✅ 0.30609 0.30537
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.02804 0.02794
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.23578 2.23575
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.78984 0.79081
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04636 0.04639
Minkeyrink ST_st unsat ✅ 0.04743 0.04744
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.23717 0.23716
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.23681 0.23689
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.23698 0.23704
Yices2 Yices 2.6.0_default unsat ✅ 0.04222 0.04217
Z3 z3-4.7.1_default unsat ✅ 0.35142 0.35133
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04279 0.04277
Boolector Boolector-wrapped-sq_default unsat ✅ 0.04704 0.04707
Poolector-wrapped-sq_default unsat ✅ 0.17872 0.27930
CVC4 CVC4-sq-final_default unsat ✅ 1.16918 2.22947
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 141.03600 141.02000
MathSAT MathSAT5_default.sh unsat ✅ 0.50178 0.50174
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.04576 0.04583
MinkeyRink Solver 2020.3_default unsat ✅ 0.04838 0.04852
STP STP_default unsat ✅ 0.07742 0.07754
STP ++ Mergsat v1_default unsat ✅ 0.07294 0.07469
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04970 0.04965
Z3 z3-4.8.8_default unsat ✅ 0.35029 0.35022
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04285 0.04278
MathSAT mathsat-5.6.6_default unsat ✅ 0.51434 0.51430
STP STP 2021.0_default unsat ✅ 0.06475 0.06488
Z3 z3-4.8.11_default unsat ✅ 0.37805 0.37798
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04088 0.04085
Bitwuzla-wrapped_default unsat ✅ 0.04416 0.04410
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.01208 1.01251
MathSAT MathSAT-5.6.8_default unsat ✅ 0.54710 0.54706
STP STP 2022.4_default unsat ✅ 0.03783 0.03788
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04843 0.04827
Z3++BV z3++bv_0702_default unsat ✅ 0.49663 0.49650
Z3 z3-4.8.17_default unsat ✅ 0.55579 0.55761
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.17165 2.17127
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.12165 1.12213
STP STP 2022.4_default unsat ✅ 0.03758 0.03759
STP 2022.4_default unsat ✅ 0.03746 0.03752
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 828.99300 884.66200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.04919 0.04915
Z3-Owl z3-Owl-Final_default unsat ✅ 0.72010 0.72010
z3-Owl-Final_default unsat ✅ 0.72035 0.72056
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23595 0.13645
cvc5 cvc5 unsat ✅ 1.25639 1.15692
SMTInterpol SMTInterpol unsat ✅ 304.66880 340.34014
STP STP unsat ✅ 0.27542 0.17557
Yices2 Yices2 unsat ✅ 0.24506 0.14505
Z3alpha Z3-alpha unsat ✅ 0.29850 0.19838