Benchmark

non-incremental/QF_BV/sage/app7/bench_1214.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4420754
Compressed Size274756
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4420746
Compressed Size274762
Max. Term Depth16964
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2714 and1
=3493 let16750 extract1712 bvand45729
bvor30132 bvxor2276 bvadd49138 bvmul8
bvsub16105 bvsdiv23 bvult609 bvule632
bvslt219 bvsle124 bvshl15791 bvashr29848
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.69451 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.65935 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.64909 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.64530 —
abziz_portfolio_2012_solvers default unsat ✅ 0.65504 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.65864 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.93889 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.05515 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.99805 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 241.87300 —
CVC3-SMT-COMP-2011 default unsat ✅ 204.54700 —
CVC3-SMT-COMP-2012 default unsat ✅ 213.86500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.64146 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.54304 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.30110 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.26465 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.63841 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60799 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14971 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.41805 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.19324 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87381 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74345 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70413 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76504 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.69605 —
Z3-SMT-COMP-2011 default unsat ✅ 0.64092 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.16478 1.16312
Boolector SMT17 final boolector unsat ✅ 1.16385 1.16290
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.72970 9.09765
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.85090 0.85034
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.75212 1.75031
Q3B Q3B default unsat ✅ 1.11726 2.93000
STP stp_st default unsat ✅ 0.83358 0.83007
stp_mt default unsat ✅ 0.87891 0.87812
Yices2 Yices2-Main default unsat ✅ 0.47705 0.47607
Z3 z3-4.5.0 default unsat ✅ 0.66167 0.66062
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04268 1.04247
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.30035 5.29972
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83615 0.83710
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.70162 1.70138
Minkeyrink ST_st unsat ✅ 1.69475 1.69473
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82267 0.82277
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82164 0.82164
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.81939 0.81935
Yices2 Yices 2.6.0_default unsat ✅ 0.48183 0.48168
Z3 z3-4.7.1_default unsat ✅ 0.96152 0.96130
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.00899 2.00885
Poolector-wrapped-sq_default unsat ✅ 2.40641 9.05933
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.64216 1.64204
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.55003 5.54927
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.16049 1.16064
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.14169 1.14173
Par4 Par4-wrapped-sq_default unsat ✅ 0.48759 0.00624
STP STP-2019-wrapped-sq_default unsat ✅ 0.82997 0.82994
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.82031 0.82039
stp-minisat-wrapped-sq_default unsat ✅ 0.82362 0.82369
stp-mt-wrapped-sq_default unsat ✅ 0.82959 0.82969
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.81557 0.81565
stp-riss-wrapped-sq_default unsat ✅ 0.82517 0.82531
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.44144 0.44148
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.44430 0.44425
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.44213 0.44212
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.43761 0.43760
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.44499 0.44493
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.89292 0.89284
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.64841 1.64823
Boolector Boolector-wrapped-sq_default unsat ✅ 1.98016 1.98009
Poolector-wrapped-sq_default unsat ✅ 2.29132 8.55000
CVC4 CVC4-sq-final_default unsat ✅ 7.27806 7.27703
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.04793 1.04776
MathSAT MathSAT5_default.sh unsat ✅ 0.84650 0.84642
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.94753 0.94764
MinkeyRink Solver 2020.3_default unsat ✅ 0.98108 0.98109
STP STP_default unsat ✅ 0.78551 0.78554
STP ++ Mergsat v1_default unsat ✅ 0.77828 0.77770
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.49743 0.49733
Z3 z3-4.8.8_default unsat ✅ 0.72075 0.72071
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.56613 2.56596
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.19733 4.19740
STP STP 2022.4_default unsat ✅ 0.84156 0.84153
STP 2022.4_default unsat ✅ 0.83724 0.83725
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.10000 1335.56000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.48314 0.48308
Z3-Owl z3-Owl-Final_default unsat ✅ 1.43218 1.43204
z3-Owl-Final_default unsat ✅ 1.45250 1.45173
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.42695 1.32722
cvc5 cvc5 unsat ✅ 2.50704 2.40744
SMTInterpol SMTInterpol unknown ❌ 1202.71830 1428.65557
STP STP unsat ✅ 67.13136 66.98875
Yices2 Yices2 unsat ✅ 0.60618 0.50655
Z3alpha Z3-alpha unsat ✅ 0.62819 0.52864
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.17767 1.05487
Bitwuzla-MachBV-base unsat ✅ 1.40710 1.29160
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.79609 1.67097
BVDecide bv_decide unknown ❌ 1201.38537 1201.03442
bv_decide-nokernel unknown ❌ 1201.38987 1201.03113
cvc5 cvc5 unsat ✅ 1.42780 1.31134
SMTInterpol SMTInterpol unknown ❌ 1201.87149 1641.43686
Yices2 Yices2 unsat ✅ 0.55802 0.43833
Z3alpha Z3-alpha unsat ✅ 1.08677 1.09944
Z3 Z3-alpha-base unsat ✅ 0.67829 0.55085
Z3-Owl-base unsat ✅ 2.14505 2.01561
z3siri-base unsat ✅ 0.68349 0.55425
Z3-Owl Z3-Owl unsat ✅ 1.32521 1.19680