Benchmark

non-incremental/QF_BV/sage/app12/bench_5775.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size52817
Compressed Size7294
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 52809
Compressed Size7300
Max. Term Depth54
Asserts 1
Declared Functions0
Declared Constants300
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite37 not208 and1
=376 let44 bvor140 bvadd153
bvsub188 bvult152 bvule135 bvslt32
bvsle32 bvshl146 zero_extend308

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.36136 —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.28099 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.27677 —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.28221 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.12108 —
Boolector-SMT-COMP-2011 default sat ✅ 2.79908 —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 11.10420 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default sat ✅ 10.26090 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.59566 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.14577 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.60927 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.10630 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.37878 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.12720 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.08449 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.27407 —
Z3-SMT-COMP-2011 default sat ✅ 0.27308 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.42142 3.42248
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.54037 1.03784
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.67521 1.31080
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.67988 0.67890
SMT-RAT SMT-RAT-final default sat ✅ 161.42700 161.45300
STP stp-cryptominisat4 default sat ✅ 0.14060 0.13998
stp-cmsat4-v15 default sat ✅ 0.15022 0.14898
stp-cmsat4-mt-v15 default unknown ❌ 0.11689 0.11598
stp-minisat-v15 default sat ✅ 0.12959 0.12898
Yices2 Yices default sat ✅ 0.01908 0.01800
Z3 z3 4.4.0 default sat ✅ 0.16844 0.16797
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 22.54120 22.55120
ABC_glucose glucose sat ✅ 4.19367 4.19619
Boolector Boolector boolector sat ✅ 4.74414 4.74688
Boolector preprop boolector sat ✅ 4.65508 4.65809
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.60040 1.16413
MapleSTP MapleSTP default sat ✅ 0.23072 0.23082
MapleSTP-mt default sat ✅ 0.24160 0.55819
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.60840 0.60976
MinkeyRink Minkeyrink 2016 default sat ✅ 0.31145 0.45837
Q3B Q3B default unknown ❌ 2400.03000 7203.62000
STP stp-cms-exp-2016 default sat ✅ 0.29301 0.29316
stp-cms-mt-2016 default sat ✅ 0.23858 0.56804
stp-cms-st-2016 default sat ✅ 0.23680 0.23688
stp-minisat-st-2016 default sat ✅ 0.64837 0.64737
Yices2 Yices-2.4.2 default sat ✅ 0.01685 0.01680
Z3 z3-4.4.1 default sat ✅ 0.15632 0.15756
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.48996 1.48975
Boolector SMT17 final boolector sat ✅ 4.91467 4.91269
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.59872 1.15665
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.82549 0.81591
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.18578 0.13798
Q3B Q3B default unknown ❌ 600.05600 1786.97000
STP stp_st default sat ✅ 1.37213 1.37052
stp_mt default sat ✅ 1.78093 3.84322
Yices2 Yices2-Main default sat ✅ 0.01689 0.01708
Z3 z3-4.5.0 default sat ✅ 0.56259 0.56059
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.55011 0.55003
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.71947 0.71968
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.64420 0.64531
MinkeyRink Minkeyrink MT_mt sat ✅ 0.09027 0.10577
Minkeyrink ST_st sat ✅ 0.08513 0.08531
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.54056 0.54033
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.50511 0.83138
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.31215 1.31210
Yices2 Yices 2.6.0_default sat ✅ 0.01844 0.01835
Z3 z3-4.7.1_default sat ✅ 0.43302 0.43284
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 1.00870 1.00872
Poolector-wrapped-sq_default sat ✅ 0.69997 2.21147
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 3.01113 3.01093
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.46290 0.46267
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.09924 0.12683
MinkeyRink ST-wrapped-sq_default sat ✅ 0.09203 0.09213
Par4 Par4-wrapped-sq_default sat ✅ 0.02604 0.00579
STP STP-2019-wrapped-sq_default sat ✅ 0.27267 0.27299
stp-mergesat-fixed-wrapped-sq_default sat ✅ 4.39740 4.39215
stp-minisat-wrapped-sq_default sat ✅ 0.32731 0.32749
stp-mt-wrapped-sq_default sat ✅ 0.27513 0.37810
stp-portfolio-fixed-wrapped-sq_default sat ✅ 4.50112 4.72623
stp-riss-wrapped-sq_default unknown ❌ 0.23438 0.23457
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.01965 0.01969
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.03897 0.03895
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.08363 0.08365
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.48576 0.48577
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.03487 0.03490
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.44979 0.44977
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.07272 1.07268
Bitwuzla-wrapped_default sat ✅ 0.80998 0.80992
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.48420 0.48461
MathSAT MathSAT-5.6.8_default sat ✅ 0.56099 0.56081
STP STP 2022.4_default sat ✅ 0.08864 0.08869
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.03892 0.03889
Z3++BV z3++bv_0702_default sat ✅ 0.15336 0.15328
Z3 z3-4.8.17_default sat ✅ 0.48146 0.48223
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.27767 0.17802
cvc5 cvc5 sat ✅ 0.64397 0.54484
SMTInterpol SMTInterpol unknown ❌ 1201.71927 1229.83385
STP STP sat ✅ 0.41930 0.31952
Yices2 Yices2 sat ✅ 0.25099 0.14951
Z3alpha Z3-alpha sat ✅ 0.39574 0.29649