Benchmark

non-incremental/QF_BV/sage/app11/bench_517.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1529055
Compressed Size150771
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1529047
Compressed Size150777
Max. Term Depth4209
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1274
and1 =2056 let2876 extract1482
bvand957 bvor272 bvxor2275 bvadd14618
bvmul1181 bvsdiv16 bvult1094 bvule1497
bvslt123 bvsle162 bvshl8906 bvashr13273
zero_extend10172

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.15981 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.41715 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.41753 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.43632 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41824 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40738 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.22339 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.29848 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.23611 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.84110 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.24960 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.29260 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.70106 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.52100 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45679 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44903 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.33140 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54543 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46781 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.92085 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.80247 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54238 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.08717 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16435 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25063 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.43922 —
Z3-SMT-COMP-2011 default unsat ✅ 0.39974 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.36843 0.36708
Boolector SMT17 final boolector unsat ✅ 0.35704 0.35620
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.55225 6.33602
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.36335 0.36294
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.69221 0.69055
Q3B Q3B default unsat ✅ 36.48660 108.04000
STP stp_st default unsat ✅ 17.53680 17.53460
stp_mt default unsat ✅ 17.44480 17.44550
Yices2 Yices2-Main default unsat ✅ 0.12454 0.12339
Z3 z3-4.5.0 default unsat ✅ 0.38492 0.38400
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29041 0.29032
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.32111 3.32099
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.27984 0.28082
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.70014 0.70014
Minkeyrink ST_st unsat ✅ 0.68402 0.68408
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.37110 12.36900
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.55620 12.55660
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.38330 12.38390
Yices2 Yices 2.6.0_default unsat ✅ 0.12036 0.12025
Z3 z3-4.7.1_default unsat ✅ 0.34225 0.34196
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41777 0.41767
Boolector Boolector-wrapped-sq_default unsat ✅ 0.58434 0.58424
Poolector-wrapped-sq_default unsat ✅ 0.78363 2.71501
CVC4 CVC4-sq-final_default unsat ✅ 3.81995 3.81943
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 88.63510 88.63280
MathSAT MathSAT5_default.sh unsat ✅ 0.32704 0.32683
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 1.05535 1.05539
MinkeyRink Solver 2020.3_default unsat ✅ 1.11786 1.11796
STP STP_default unsat ✅ 10.78360 10.78390
STP ++ Mergsat v1_default unsat ✅ 11.38510 11.38240
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.13872 0.13861
Z3 z3-4.8.8_default unsat ✅ 0.24231 0.24221
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41545 0.41536
Bitwuzla-wrapped_default unsat ✅ 0.44858 0.44846
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.05435 4.05463
MathSAT MathSAT-5.6.8_default unsat ✅ 36.66930 36.66280
STP STP 2022.4_default unsat ✅ 0.19008 0.19010
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.13715 0.13711
Z3++BV z3++bv_0702_default unsat ✅ 0.36859 0.36849
Z3 z3-4.8.17_default unsat ✅ 0.30508 0.30691
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.58267 0.58260
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.36785 3.35947
STP STP 2022.4_default unsat ✅ 0.18993 0.18997
STP 2022.4_default unsat ✅ 0.18989 0.18990
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1235.89000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13482 0.13479
Z3-Owl z3-Owl-Final_default unsat ✅ 0.97249 0.97227
z3-Owl-Final_default unsat ✅ 1.01997 1.01604
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 5.03801 4.93776
cvc5 cvc5 unsat ✅ 1.03149 0.93145
SMTInterpol SMTInterpol unknown ❌ 1202.71914 1969.27091
STP STP unsat ✅ 9.07555 8.97106
Yices2 Yices2 unsat ✅ 0.31131 0.21085
Z3alpha Z3-alpha unsat ✅ 0.51737 0.41755
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.73901 0.61933
Bitwuzla-MachBV-base unsat ✅ 0.84758 0.71855
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.87659 0.75849
BVDecide bv_decide unknown ❌ 1201.38833 1201.04008
bv_decide-nokernel unknown ❌ 1201.39070 1201.00979
cvc5 cvc5 unsat ✅ 1.14037 1.01015
SMTInterpol SMTInterpol unknown ❌ 1201.89477 2870.25835
Yices2 Yices2 unsat ✅ 0.35955 0.23723
Z3alpha Z3-alpha unsat ✅ 0.61904 0.53480
Z3 Z3-alpha-base unsat ✅ 0.40594 0.28706
Z3-Owl-base unsat ✅ 1.00567 0.88092
z3siri-base unsat ✅ 0.41902 0.29680
Z3-Owl Z3-Owl unsat ✅ 0.96248 0.84171