Benchmark

non-incremental/QF_BV/sage/app7/bench_492.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4425237
Compressed Size274308
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4425229
Compressed Size274314
Max. Term Depth16888
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2722 and1
=3504 let16769 extract1712 bvand45742
bvor30132 bvxor2276 bvadd49192 bvmul9
bvsub16111 bvsdiv28 bvult636 bvule651
bvslt220 bvsle126 bvshl15791 bvashr29862
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70606 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.64445 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.64722 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.65675 —
abziz_portfolio_2012_solvers default unsat ✅ 0.66551 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.65439 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94741 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06555 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.01026 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 243.07200 —
CVC3-SMT-COMP-2011 default unsat ✅ 205.36000 —
CVC3-SMT-COMP-2012 default unsat ✅ 214.88100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.58063 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.53079 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.29760 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.28647 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.62959 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60185 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14506 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.53481 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.17333 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87107 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.73562 —
STP2-SMT-COMP-2012 default unsat ✅ 0.71122 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77120 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.70361 —
Z3-SMT-COMP-2011 default unsat ✅ 0.64428 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.16421 1.16298
Boolector SMT17 final boolector unsat ✅ 1.16524 1.16410
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.74051 9.12479
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.84846 0.84829
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.66799 1.66779
Q3B Q3B default unsat ✅ 1.12893 2.97000
STP stp_st default unsat ✅ 0.80526 0.80431
stp_mt default unsat ✅ 0.81153 0.81144
Yices2 Yices2-Main default unsat ✅ 0.47612 0.47495
Z3 z3-4.5.0 default unsat ✅ 0.81165 0.80310
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04343 1.04334
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.32012 5.32006
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.82664 0.82770
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.69549 1.69541
Minkeyrink ST_st unsat ✅ 1.69572 1.69558
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82269 0.82269
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82498 0.82509
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82553 0.82554
Yices2 Yices 2.6.0_default unsat ✅ 0.48046 0.48040
Z3 z3-4.7.1_default unsat ✅ 0.72737 0.72725
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.02179 2.02177
Poolector-wrapped-sq_default unsat ✅ 2.40289 9.10000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.64271 1.64261
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.56569 5.56533
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.14675 1.14696
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.14184 1.14188
Par4 Par4-wrapped-sq_default unsat ✅ 0.49130 0.00611
STP STP-2019-wrapped-sq_default unsat ✅ 0.82699 0.82708
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.81609 0.81617
stp-minisat-wrapped-sq_default unsat ✅ 0.82531 0.82530
stp-mt-wrapped-sq_default unsat ✅ 0.82355 0.82371
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.82356 0.82365
stp-riss-wrapped-sq_default unsat ✅ 0.82598 0.82602
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.44898 0.44896
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.44857 0.44861
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.44744 0.44739
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.44272 0.44270
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.44672 0.44669
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.79721 0.79704
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.64996 1.64979
Boolector Boolector-wrapped-sq_default unsat ✅ 1.98387 1.98392
Poolector-wrapped-sq_default unsat ✅ 2.38314 8.89000
CVC4 CVC4-sq-final_default unsat ✅ 7.24262 7.24092
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.04844 1.04833
MathSAT MathSAT5_default.sh unsat ✅ 0.84789 0.84768
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.94726 0.94728
MinkeyRink Solver 2020.3_default unsat ✅ 0.97940 0.97946
STP STP_default unsat ✅ 0.78390 0.78311
STP ++ Mergsat v1_default unsat ✅ 0.76377 0.76543
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.49628 0.49622
Z3 z3-4.8.8_default unsat ✅ 0.78182 0.78163
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.65884 1.65874
MathSAT mathsat-5.6.6_default unsat ✅ 0.87415 0.87405
STP STP 2021.0_default unsat ✅ 0.79555 0.79571
Z3 z3-4.8.11_default unsat ✅ 0.50018 0.50005
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.66428 1.66415
Bitwuzla-wrapped_default unsat ✅ 1.83017 1.83011
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.65375 5.64830
MathSAT MathSAT-5.6.8_default unsat ✅ 0.88365 0.88358
STP STP 2022.4_default unsat ✅ 0.85603 0.85603
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.49667 0.49660
Z3++BV z3++bv_0702_default unsat ✅ 0.55681 0.55680
Z3 z3-4.8.17_default unsat ✅ 0.54423 0.54582
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.75190 2.75186
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.21315 4.21148
STP STP 2022.4_default unsat ✅ 0.83894 0.83893
STP 2022.4_default unsat ✅ 0.83728 0.83729
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1334.27000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.48852 0.48833
Z3-Owl z3-Owl-Final_default unsat ✅ 1.46949 1.46927
z3-Owl-Final_default unsat ✅ 1.49584 1.49617
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.48547 1.38518
cvc5 cvc5 unsat ✅ 2.35956 2.25884
SMTInterpol SMTInterpol unknown ❌ 1202.74160 1439.52965
STP STP unsat ✅ 74.74007 74.61881
Yices2 Yices2 unsat ✅ 0.54366 0.44331
Z3alpha Z3-alpha unsat ✅ 0.62706 0.52741