Benchmark

non-incremental/QF_BV/sage/app7/bench_1726.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1213051
Compressed Size94954
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1213043
Compressed Size94960
Max. Term Depth4654
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1518 and1
=2058 let4597 extract1198 bvand11334
bvor7304 bvxor1368 bvadd12818 bvmul1
bvsub4121 bvult426 bvule449 bvslt193
bvsle97 bvshl3963 bvashr6984 zero_extend914

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.17256 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22177 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.22337 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.22364 —
abziz_portfolio_2012_solvers default unsat ✅ 0.22438 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.22333 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.23425 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.28510 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.25677 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 9.91255 —
CVC3-SMT-COMP-2011 default unsat ✅ 8.48073 —
CVC3-SMT-COMP-2012 default unsat ✅ 8.78010 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.03592 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.75534 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.37384 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.36161 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.46833 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.45287 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.32816 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.81729 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.16389 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.47780 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.18069 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17270 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.17669 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.25165 —
Z3-SMT-COMP-2011 default unsat ✅ 0.21800 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.32953 0.32895
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.66124 2.72458
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.66982 2.74158
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.25968 0.25896
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.97000
STP stp-cryptominisat4 default unsat ✅ 0.16527 0.16397
stp-cmsat4-v15 default unsat ✅ 0.16343 0.16197
stp-cmsat4-mt-v15 default unsat ✅ 0.16299 0.16197
stp-minisat-v15 default unsat ✅ 0.16377 0.16298
Yices2 Yices default unsat ✅ 0.07575 0.07499
Z3 z3 4.4.0 default unsat ✅ 0.20651 0.20597
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.68621 0.68659
ABC_glucose glucose unsat ✅ 0.68027 0.68021
Boolector Boolector boolector unsat ✅ 0.40300 0.40341
Boolector preprop boolector unsat ✅ 0.39509 0.39524
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.63203 2.68565
MapleSTP MapleSTP default unsat ✅ 0.16102 0.16105
MapleSTP-mt default unsat ✅ 0.15467 0.15470
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.23406 0.23522
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.20713 0.20718
Q3B Q3B default unsat ✅ 0.42501 0.71518
STP stp-cms-exp-2016 default unsat ✅ 0.15968 0.15973
stp-cms-mt-2016 default unsat ✅ 0.16277 0.16283
stp-cms-st-2016 default unsat ✅ 0.16299 0.16335
stp-minisat-st-2016 default unsat ✅ 0.16167 0.16171
Yices2 Yices-2.4.2 default unsat ✅ 0.07717 0.07718
Z3 z3-4.4.1 default unsat ✅ 0.23095 0.23277
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.30072 0.29987
Boolector SMT17 final boolector unsat ✅ 0.30332 0.30268
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.73672 2.82914
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.23768 0.23785
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.47780 0.47713
Q3B Q3B default unsat ✅ 0.39803 0.92129
STP stp_st default unsat ✅ 0.20086 0.20032
stp_mt default unsat ✅ 0.20082 0.19977
Yices2 Yices2-Main default unsat ✅ 0.07307 0.07300
Z3 z3-4.5.0 default unsat ✅ 0.23717 0.23650
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.27365 0.27341
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.46757 1.46764
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.22883 0.22989
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.46767 0.46769
Minkeyrink ST_st unsat ✅ 0.46882 0.46885
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.20007 0.19989
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.21063 0.21074
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19973 0.19979
Yices2 Yices 2.6.0_default unsat ✅ 0.07070 0.07060
Z3 z3-4.7.1_default unsat ✅ 0.26602 0.26593
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40601 0.40596
MathSAT mathsat-5.6.6_default unsat ✅ 0.24613 0.24612
STP STP 2021.0_default unsat ✅ 0.19804 0.19812
Z3 z3-4.8.11_default unsat ✅ 0.15954 0.15950
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.46241 0.45949
Bitwuzla-wrapped_default unsat ✅ 0.42044 0.42041
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.62088 1.61894
MathSAT MathSAT-5.6.8_default unsat ✅ 0.26540 0.25451
STP STP 2022.4_default unsat ✅ 0.21401 0.21395
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.08650 0.08648
Z3++BV z3++bv_0702_default unsat ✅ 0.26730 0.26722
Z3 z3-4.8.17_default unsat ✅ 0.25547 0.25231
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.53889 0.43904
cvc5 cvc5 unsat ✅ 0.59910 0.49950
SMTInterpol SMTInterpol unsat ✅ 809.67494 1185.64578
STP STP unsat ✅ 5.04549 4.94545
Yices2 Yices2 unsat ✅ 0.26555 0.16530
Z3alpha Z3-alpha unsat ✅ 0.35384 0.25442
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.52350 0.39814
Bitwuzla-MachBV-base unsat ✅ 0.52408 0.41083
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.66939 0.53009
BVDecide bv_decide unsat ✅ 220.99319 220.81517
bv_decide-nokernel unsat ✅ 193.12965 192.98614
cvc5 cvc5 unsat ✅ 0.56971 0.45119
SMTInterpol SMTInterpol unknown ❌ 1201.93363 3276.22751
Yices2 Yices2 unsat ✅ 0.31056 0.19205
Z3alpha Z3-alpha unsat ✅ 0.55021 0.46373
Z3 Z3-alpha-base unsat ✅ 0.42763 0.30287
Z3-Owl-base unsat ✅ 0.91046 0.78274
z3siri-base unsat ✅ 0.40253 0.28177
Z3-Owl Z3-Owl unsat ✅ 0.89660 0.77463