Benchmark

non-incremental/QF_BV/sage/app7/bench_2148.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size848717
Compressed Size74981
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 848709
Compressed Size74988
Max. Term Depth3213
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1353 and1
=1853 let3156 extract1139 bvand7360
bvor4691 bvxor1257 bvadd8687 bvmul1
bvsub2833 bvult410 bvule394 bvslt185
bvsle95 bvshl2677 bvashr4398 zero_extend860

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.11663 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.16836 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.16693 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.17601 —
abziz_portfolio_2012_solvers default unsat ✅ 0.16769 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.17330 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.15602 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.19162 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.16240 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 102.91500 —
CVC3-SMT-COMP-2011 default unsat ✅ 85.63580 —
CVC3-SMT-COMP-2012 default unsat ✅ 89.07480 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.76065 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.27066 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.26622 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.24672 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.32982 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.31799 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.23658 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.36147 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.45836 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.32228 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.12651 —
STP2-SMT-COMP-2012 default unsat ✅ 0.11610 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.11437 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.18638 —
Z3-SMT-COMP-2011 default unsat ✅ 0.16353 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.21141 0.20997
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.19495 1.97470
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.18449 1.96170
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.19364 0.19297
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.20000
STP stp-cryptominisat4 default unsat ✅ 0.11239 0.11098
stp-cmsat4-v15 default unsat ✅ 0.11132 0.10998
stp-cmsat4-mt-v15 default unsat ✅ 0.11224 0.11098
stp-minisat-v15 default unsat ✅ 0.11248 0.11098
Yices2 Yices default unsat ✅ 0.05496 0.05399
Z3 z3 4.4.0 default unsat ✅ 0.18039 0.17997
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.48535 0.48564
ABC_glucose glucose unsat ✅ 0.47707 0.47768
Boolector Boolector boolector unsat ✅ 0.24354 0.24363
Boolector preprop boolector unsat ✅ 0.23697 0.23707
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.28275 2.15574
MapleSTP MapleSTP default unsat ✅ 0.10678 0.10681
MapleSTP-mt default unsat ✅ 0.10655 0.10659
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.17130 0.17233
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.14051 0.14050
Q3B Q3B default unsat ✅ 0.34548 0.76904
STP stp-cms-exp-2016 default unsat ✅ 0.10918 0.10920
stp-cms-mt-2016 default unsat ✅ 0.11070 0.11099
stp-cms-st-2016 default unsat ✅ 0.11230 0.11229
stp-minisat-st-2016 default unsat ✅ 0.11063 0.11065
Yices2 Yices-2.4.2 default unsat ✅ 0.05539 0.05535
Z3 z3-4.4.1 default unsat ✅ 0.18271 0.18389
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.20073 0.19982
Boolector SMT17 final boolector unsat ✅ 0.20584 0.20484
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.22621 2.01813
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.17936 0.17869
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.34740 0.34656
Q3B Q3B default unsat ✅ 0.32592 0.70567
STP stp_st default unsat ✅ 0.16664 0.15879
stp_mt default unsat ✅ 0.15710 0.15707
Yices2 Yices2-Main default unsat ✅ 0.05530 0.05522
Z3 z3-4.5.0 default unsat ✅ 0.23316 0.23181
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.17624 0.17620
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.05174 1.05188
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.16754 0.16858
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.32961 0.32937
Minkeyrink ST_st unsat ✅ 0.33027 0.32994
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.13442 0.13445
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.13395 0.13402
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.13421 0.13422
Yices2 Yices 2.6.0_default unsat ✅ 0.05277 0.05272
Z3 z3-4.7.1_default unsat ✅ 0.18621 0.18615
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.26710 0.26698
Boolector Boolector-wrapped-sq_default unsat ✅ 0.31978 0.31979
Poolector-wrapped-sq_default unsat ✅ 0.47735 1.50832
CVC4 CVC4-sq-final_default unsat ✅ 1.34886 1.34907
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.21319 0.21309
MathSAT MathSAT5_default.sh unsat ✅ 0.17660 0.17656
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.22626 0.22629
MinkeyRink Solver 2020.3_default unsat ✅ 0.23505 0.23519
STP STP_default unsat ✅ 0.13159 0.13172
STP ++ Mergsat v1_default unsat ✅ 0.12682 0.12856
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.06288 0.06279
Z3 z3-4.8.8_default unsat ✅ 0.20132 0.20126
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.26792 0.26790
MathSAT mathsat-5.6.6_default unsat ✅ 0.18141 0.18141
STP STP 2021.0_default unsat ✅ 0.13681 0.13691
Z3 z3-4.8.11_default unsat ✅ 0.12635 0.12620
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.45287 0.45279
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.80187 0.80245
STP STP 2022.4_default unsat ✅ 0.14304 0.14309
STP 2022.4_default unsat ✅ 0.14683 0.14683
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 298.67300 353.12000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06152 0.06148
Z3-Owl z3-Owl-Final_default unsat ✅ 0.82063 0.82063
z3-Owl-Final_default unsat ✅ 0.83365 0.83390
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.44754 0.34739
cvc5 cvc5 unsat ✅ 0.52895 0.42930
SMTInterpol SMTInterpol unsat ✅ 679.23731 960.76365
STP STP unsat ✅ 2.59660 2.49582
Yices2 Yices2 unsat ✅ 0.25360 0.15375
Z3alpha Z3-alpha unsat ✅ 0.33398 0.23432