Benchmark

non-incremental/QF_BV/sage/app11/bench_181.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1533994
Compressed Size153726
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1533986
Compressed Size153736
Max. Term Depth4220
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1302
and1 =2103 let2887 extract1494
bvand981 bvor277 bvxor2294 bvadd14651
bvmul1186 bvsdiv16 bvult1099 bvule1512
bvslt123 bvsle162 bvshl8913 bvashr13280
zero_extend10181

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16084 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40786 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.42750 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40578 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40844 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.41776 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21880 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30570 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.23978 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.93980 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.33390 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.34650 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.69924 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.55270 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45892 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45056 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.40900 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54707 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46665 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 8.01595 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.81177 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54556 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.08696 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16536 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25409 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.44642 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40239 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.34606 0.34471
Boolector SMT17 final boolector unsat ✅ 0.32203 0.32183
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.60902 6.43719
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.32072 0.31364
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.68988 0.68887
Q3B Q3B default unsat ✅ 10.80500 31.80000
STP stp_st default unsat ✅ 16.53550 16.53080
stp_mt default unsat ✅ 16.46590 16.45770
Yices2 Yices2-Main default unsat ✅ 0.12698 0.12650
Z3 z3-4.5.0 default unsat ✅ 0.27902 0.27783
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29152 0.29139
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.28427 3.28394
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.29490 0.29600
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68351 0.68341
Minkeyrink ST_st unsat ✅ 0.68504 0.68507
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.41080 12.41090
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.40430 12.40400
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.42970 12.43000
Yices2 Yices 2.6.0_default unsat ✅ 0.12000 0.11990
Z3 z3-4.7.1_default unsat ✅ 0.29686 0.29672
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.58305 0.58304
Poolector-wrapped-sq_default unsat ✅ 0.79299 2.86305
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.52086 0.52081
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.37919 3.37945
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.36976 1.36984
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.36560 1.36558
Par4 Par4-wrapped-sq_default unsat ✅ 0.13545 0.00609
STP STP-2019-wrapped-sq_default unsat ✅ 6.27296 6.27292
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.26180 6.26230
stp-minisat-wrapped-sq_default unsat ✅ 6.26379 6.26352
stp-mt-wrapped-sq_default unsat ✅ 6.24580 6.24253
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.27030 6.26358
stp-riss-wrapped-sq_default unsat ✅ 6.27392 6.27380
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12734 0.12731
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12831 0.12829
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12760 0.12756
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12585 0.12582
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12937 0.12937
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27709 0.27708
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42831 0.42811
MathSAT mathsat-5.6.6_default unsat ✅ 35.28680 35.28140
STP STP 2021.0_default unsat ✅ 5.87021 5.87016
Z3 z3-4.8.11_default unsat ✅ 0.30174 0.30170
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42354 0.42344
Bitwuzla-wrapped_default unsat ✅ 0.45264 0.45257
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.07099 4.07125
MathSAT MathSAT-5.6.8_default unsat ✅ 57.40650 114.78900
STP STP 2022.4_default unsat ✅ 0.19019 0.19023
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14056 0.14053
Z3++BV z3++bv_0702_default unsat ✅ 0.30424 0.30418
Z3 z3-4.8.17_default unsat ✅ 0.29549 0.29728
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.58393 0.58385
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.34273 3.34306
STP STP 2022.4_default unsat ✅ 0.19083 0.19087
STP 2022.4_default unsat ✅ 0.19299 0.19303
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1234.77000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13521 0.13518
Z3-Owl z3-Owl-Final_default unsat ✅ 0.95256 0.95243
z3-Owl-Final_default unsat ✅ 0.96169 0.96192
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.75031 0.63480
Bitwuzla-MachBV-base unsat ✅ 2.95445 2.82649
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 3.01482 2.89104
BVDecide bv_decide unknown ❌ 1201.40710 1201.08439
bv_decide-nokernel unknown ❌ 1201.38827 1201.05712
cvc5 cvc5 unsat ✅ 0.82272 0.70487
SMTInterpol SMTInterpol unknown ❌ 1201.87557 2803.61232
Yices2 Yices2 unsat ✅ 0.35844 0.23264
Z3alpha Z3-alpha unsat ✅ 0.64204 0.55579
Z3 Z3-alpha-base unsat ✅ 0.45489 0.32874
Z3-Owl-base unsat ✅ 1.08162 0.94840
z3siri-base unsat ✅ 0.51968 0.39220
Z3-Owl Z3-Owl unsat ✅ 0.95186 0.82662