Benchmark

non-incremental/QF_BV/sage/app7/bench_995.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2459599
Compressed Size158987
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2459591
Compressed Size158994
Max. Term Depth9453
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1770 and1
=2376 let9355 extract1298 bvand25291
bvor16597 bvxor1538 bvadd27043 bvmul1
bvsub8737 bvult442 bvule487 bvslt206
bvsle104 bvshl8571 bvashr16144 zero_extend1021

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.36912 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.36923 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.36742 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.36318 —
abziz_portfolio_2012_solvers default unsat ✅ 0.35978 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.36067 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.50237 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.58056 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.53995 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 117.05400 —
CVC3-SMT-COMP-2011 default unsat ✅ 98.96680 —
CVC3-SMT-COMP-2012 default unsat ✅ 103.50700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.04050 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.16099 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.74942 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.73187 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.93366 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.90615 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.64805 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.15290 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.60009 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.01147 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.39034 —
STP2-SMT-COMP-2012 default unsat ✅ 0.36997 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.38504 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.39117 —
Z3-SMT-COMP-2011 default unsat ✅ 0.35675 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.72218 0.72189
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.23687 5.22421
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.27290 5.30019
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.50358 0.50292
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.18000
STP stp-cryptominisat4 default unsat ✅ 0.35212 0.35095
stp-cmsat4-v15 default unsat ✅ 0.35261 0.35195
stp-cmsat4-mt-v15 default unsat ✅ 0.35370 0.35295
stp-minisat-v15 default unsat ✅ 0.35152 0.35095
Yices2 Yices default unsat ✅ 0.14380 0.14298
Z3 z3 4.4.0 default unsat ✅ 0.56299 0.56291
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.42341 1.41874
ABC_glucose glucose unsat ✅ 1.40144 1.40326
Boolector Boolector boolector unsat ✅ 0.81944 0.81982
Boolector preprop boolector unsat ✅ 0.79709 0.79812
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.20869 5.20022
MapleSTP MapleSTP default unsat ✅ 0.33443 0.33463
MapleSTP-mt default unsat ✅ 0.33501 0.33517
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.45626 0.45584
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.45972 0.45934
Q3B Q3B default unsat ✅ 0.68651 1.55000
STP stp-cms-exp-2016 default unsat ✅ 0.34237 0.34267
stp-cms-mt-2016 default unsat ✅ 0.34799 0.34813
stp-cms-st-2016 default unsat ✅ 0.34791 0.34810
stp-minisat-st-2016 default unsat ✅ 0.34660 0.34674
Yices2 Yices-2.4.2 default unsat ✅ 0.14208 0.14212
Z3 z3-4.4.1 default unsat ✅ 0.39230 0.39387
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.68959 0.68533
Boolector SMT17 final boolector unsat ✅ 0.66781 0.66684
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.38646 5.44065
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49825 0.49791
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.94854 0.94741
Q3B Q3B default unsat ✅ 0.71295 1.67000
STP stp_st default unsat ✅ 0.43829 0.43620
stp_mt default unsat ✅ 0.42703 0.42630
Yices2 Yices2-Main default unsat ✅ 0.13656 0.13497
Z3 z3-4.5.0 default unsat ✅ 0.37683 0.37675
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.58839 0.58826
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.89575 2.89600
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.45363 0.45471
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.95010 0.95017
Minkeyrink ST_st unsat ✅ 0.94884 0.94888
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.47400 0.47404
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.47516 0.47527
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.43130 0.43130
Yices2 Yices 2.6.0_default unsat ✅ 0.13087 0.13079
Z3 z3-4.7.1_default unsat ✅ 0.48873 0.48860
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.09291 1.09289
Poolector-wrapped-sq_default unsat ✅ 1.38824 4.94226
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.91429 0.91423
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.03901 3.03911
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.67683 0.67697
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.67235 0.67239
Par4 Par4-wrapped-sq_default unsat ✅ 0.15107 0.00613
STP STP-2019-wrapped-sq_default unsat ✅ 0.43622 0.43628
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.43235 0.43249
stp-minisat-wrapped-sq_default unsat ✅ 0.43728 0.43739
stp-mt-wrapped-sq_default unsat ✅ 0.43632 0.43641
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.43166 0.43182
stp-riss-wrapped-sq_default unsat ✅ 0.43954 0.43965
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.13403 0.13400
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.13739 0.13739
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.13596 0.13596
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.13410 0.13406
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.13571 0.13566
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.40977 0.40976
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90881 0.90873
Boolector Boolector-wrapped-sq_default unsat ✅ 1.08642 1.08640
Poolector-wrapped-sq_default unsat ✅ 1.37963 4.90561
CVC4 CVC4-sq-final_default unsat ✅ 4.01611 4.01583
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.57661 0.57659
MathSAT MathSAT5_default.sh unsat ✅ 0.46678 0.46676
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.56182 0.56188
MinkeyRink Solver 2020.3_default unsat ✅ 0.58341 0.58353
STP STP_default unsat ✅ 0.40930 0.40941
STP ++ Mergsat v1_default unsat ✅ 0.40364 0.40542
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.16253 0.16249
Z3 z3-4.8.8_default unsat ✅ 0.30989 0.30984
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.31449 1.31431
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.27560 2.27408
STP STP 2022.4_default unsat ✅ 0.44466 0.44471
STP 2022.4_default unsat ✅ 0.44727 0.44730
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 611.52600 710.05100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.15874 0.15869
Z3-Owl z3-Owl-Final_default unsat ✅ 1.09795 1.09786
z3-Owl-Final_default unsat ✅ 1.10864 1.10887
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.78973 0.65797
Bitwuzla-MachBV-base unsat ✅ 0.92316 0.78855
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.06894 0.93734
BVDecide bv_decide unknown ❌ 1201.39139 1201.00331
bv_decide-nokernel unknown ❌ 1201.39382 1200.96771
cvc5 cvc5 unsat ✅ 0.85656 0.72502
SMTInterpol SMTInterpol unknown ❌ 1201.85388 2775.79752
Yices2 Yices2 unsat ✅ 0.32990 0.21095
Z3alpha Z3-alpha unsat ✅ 0.74116 0.70433
Z3 Z3-alpha-base unsat ✅ 0.46916 0.35063
Z3-Owl-base unsat ✅ 1.13126 1.00448
z3siri-base unsat ✅ 0.50053 0.36783
Z3-Owl Z3-Owl unsat ✅ 0.99188 0.86865