Benchmark

non-incremental/QF_BV/sage/app7/bench_4080.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3597832
Compressed Size231692
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3597824
Compressed Size231701
Max. Term Depth13830
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2508 and1
=3277 let13646 extract1705 bvand36532
bvor24019 bvxor2273 bvadd39709 bvmul7
bvsub13100 bvsdiv19 bvult603 bvule626
bvslt219 bvsle124 bvshl12794 bvashr23760
zero_extend1509

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.53589 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.58825 —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.60355 —
abziz_portfolio_2012_solvers default unsat ✅ 0.58858 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.58059 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.71383 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.85908 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.75780 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unsat ✅ 147.97200 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.68900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.16457 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.84225 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.07787 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.03081 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.34626 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.31554 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.93487 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.77859 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.56437 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.48363 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.62105 —
STP2-SMT-COMP-2012 default unsat ✅ 0.53681 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.57042 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.63433 —
Z3-SMT-COMP-2011 default unsat ✅ 0.57440 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.94096 0.94087
Boolector SMT17 final boolector unsat ✅ 0.94316 0.94244
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.64092 7.47326
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.69379 0.69421
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.37052 1.36934
Q3B Q3B default unsat ✅ 0.92332 2.43000
STP stp_st default unsat ✅ 0.61664 0.61554
stp_mt default unsat ✅ 0.62133 0.62090
Yices2 Yices2-Main default unsat ✅ 0.39084 0.38915
Z3 z3-4.5.0 default unsat ✅ 0.53911 0.53731
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.84817 0.84800
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.39075 4.39034
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67802 0.67910
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.38764 1.38760
Minkeyrink ST_st unsat ✅ 1.42117 1.42104
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.62837 0.62844
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.62816 0.62826
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.62932 0.62938
Yices2 Yices 2.6.0_default unsat ✅ 0.39111 0.39096
Z3 z3-4.7.1_default unsat ✅ 0.83628 0.83613
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.62632 1.62499
Poolector-wrapped-sq_default unsat ✅ 1.89481 7.12000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.31119 1.31109
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.58968 4.58970
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.96113 0.96133
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.96130 0.96134
Par4 Par4-wrapped-sq_default unsat ✅ 0.40058 0.00597
STP STP-2019-wrapped-sq_default unsat ✅ 0.63967 0.63977
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.62314 0.62318
stp-minisat-wrapped-sq_default unsat ✅ 0.63952 0.63958
stp-mt-wrapped-sq_default unsat ✅ 0.64496 0.64502
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.63487 0.63498
stp-riss-wrapped-sq_default unsat ✅ 0.64822 0.64786
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.36960 0.36960
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36831 0.36828
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.36807 0.36807
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.36288 0.36284
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.36968 0.36966
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.80490 0.80483
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.34311 1.34309
MathSAT mathsat-5.6.6_default unsat ✅ 0.72101 0.72086
STP STP 2021.0_default unsat ✅ 0.61198 0.61200
Z3 z3-4.8.11_default unsat ✅ 0.40520 0.40514
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.33997 1.33979
Bitwuzla-wrapped_default unsat ✅ 1.42252 1.42229
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.72398 4.72410
MathSAT MathSAT-5.6.8_default unsat ✅ 0.74919 0.74906
STP STP 2022.4_default unsat ✅ 0.74420 0.74426
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.39996 0.39988
Z3++BV z3++bv_0702_default unsat ✅ 0.49289 0.49280
Z3 z3-4.8.17_default unsat ✅ 0.50416 0.50580
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.21036 4.30006
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.43456 3.43484
STP STP 2022.4_default unsat ✅ 0.68934 0.68936
STP 2022.4_default unsat ✅ 0.69597 0.69605
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1323.22000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39940 0.39921
Z3-Owl z3-Owl-Final_default unsat ✅ 1.36821 1.36807
z3-Owl-Final_default unsat ✅ 1.37991 1.38006
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.21107 1.11059
cvc5 cvc5 unsat ✅ 0.85686 0.75677
SMTInterpol SMTInterpol unknown ❌ 1202.71999 1417.94468
STP STP unsat ✅ 40.63183 40.53026
Yices2 Yices2 unsat ✅ 0.49941 0.39924
Z3alpha Z3-alpha unsat ✅ 0.62734 0.52607
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.10311 0.97011
Bitwuzla-MachBV-base unsat ✅ 1.25377 1.13329
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.46486 1.33554
BVDecide bv_decide unknown ❌ 1201.38843 1200.98468
bv_decide-nokernel unknown ❌ 1201.39052 1200.94086
cvc5 cvc5 unsat ✅ 1.42163 1.28983
SMTInterpol SMTInterpol unknown ❌ 1201.88771 1733.16122
Yices2 Yices2 unsat ✅ 0.48481 0.37018
Z3alpha Z3-alpha unsat ✅ 1.02077 1.00756
Z3 Z3-alpha-base unsat ✅ 0.64955 0.52513
Z3-Owl-base unsat ✅ 2.00293 1.88274
z3siri-base unsat ✅ 0.62066 0.50104
Z3-Owl Z3-Owl unsat ✅ 1.26543 1.14107