Benchmark

non-incremental/QF_BV/sage/app7/bench_964.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2522371
Compressed Size162573
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2522363
Compressed Size162579
Max. Term Depth9687
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1785 and1
=2398 let9588 extract1307 bvand25971
bvor17043 bvxor1554 bvadd27750 bvmul1
bvsub8979 bvult443 bvule490 bvslt206
bvsle104 bvshl8805 bvashr16599 zero_extend1027

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.37761 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40578 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40566 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40975 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41376 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40508 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.51086 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.60045 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.53961 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 266.18100 —
CVC3-SMT-COMP-2011 default unsat ✅ 223.07900 —
CVC3-SMT-COMP-2012 default unsat ✅ 232.38200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.08241 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.20051 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.77349 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.74042 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.95340 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.93276 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.66475 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.21680 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.71309 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.01928 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.40094 —
STP2-SMT-COMP-2012 default unsat ✅ 0.37767 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.39207 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.46662 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40627 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.73207 0.73089
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.33176 5.38618
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.28332 5.31419
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.51692 0.51592
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.52000
STP stp-cryptominisat4 default unsat ✅ 0.36020 0.35895
stp-cmsat4-v15 default unsat ✅ 0.36166 0.36094
stp-cmsat4-mt-v15 default unsat ✅ 0.35868 0.35795
stp-minisat-v15 default unsat ✅ 0.35896 0.35794
Yices2 Yices default unsat ✅ 0.14759 0.14698
Z3 z3 4.4.0 default unsat ✅ 0.42893 0.42893
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.44164 1.44247
ABC_glucose glucose unsat ✅ 1.43101 1.43229
Boolector Boolector boolector unsat ✅ 0.83911 0.83959
Boolector preprop boolector unsat ✅ 0.81869 0.81913
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.30020 5.35101
MapleSTP MapleSTP default unsat ✅ 0.34315 0.34331
MapleSTP-mt default unsat ✅ 0.34887 0.34838
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.46689 0.46816
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.47669 0.47691
Q3B Q3B default unsat ✅ 0.70152 1.62000
STP stp-cms-exp-2016 default unsat ✅ 0.35752 0.35770
stp-cms-mt-2016 default unsat ✅ 0.35621 0.35638
stp-cms-st-2016 default unsat ✅ 0.35696 0.35716
stp-minisat-st-2016 default unsat ✅ 0.35746 0.35766
Yices2 Yices-2.4.2 default unsat ✅ 0.14659 0.14658
Z3 z3-4.4.1 default unsat ✅ 0.36934 0.37071
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.68726 0.68085
Boolector SMT17 final boolector unsat ✅ 0.66791 0.66777
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.33046 5.32738
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.51098 0.50859
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.01209 1.00572
Q3B Q3B default unsat ✅ 0.73716 1.79000
STP stp_st default unsat ✅ 0.43875 0.43899
stp_mt default unsat ✅ 0.51292 0.50340
Yices2 Yices2-Main default unsat ✅ 0.14794 0.14667
Z3 z3-4.5.0 default unsat ✅ 0.44796 0.44680
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.59940 0.59928
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.96233 2.96202
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.46301 0.46402
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.97772 0.97766
Minkeyrink ST_st unsat ✅ 0.97434 0.97431
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.44508 0.44506
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.44101 0.44101
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.44235 0.44237
Yices2 Yices 2.6.0_default unsat ✅ 0.13394 0.13386
Z3 z3-4.7.1_default unsat ✅ 0.51606 0.51599
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.12702 1.12703
Poolector-wrapped-sq_default unsat ✅ 1.40766 5.16017
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.92809 0.92797
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.12862 3.12867
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.68297 0.68303
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.68973 0.68977
Par4 Par4-wrapped-sq_default unsat ✅ 0.22395 0.00616
STP STP-2019-wrapped-sq_default unsat ✅ 0.44844 0.44856
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.44359 0.44376
stp-minisat-wrapped-sq_default unsat ✅ 0.44198 0.44210
stp-mt-wrapped-sq_default unsat ✅ 0.44334 0.44346
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.44360 0.44372
stp-riss-wrapped-sq_default unsat ✅ 0.44294 0.44306
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.13939 0.13938
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.14090 0.14092
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.13931 0.13933
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.13781 0.13782
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.13934 0.13932
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.44095 0.44093
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.92214 0.92197
Bitwuzla-wrapped_default unsat ✅ 1.05986 1.05604
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.12730 3.12714
MathSAT MathSAT-5.6.8_default unsat ✅ 0.50634 0.50618
STP STP 2022.4_default unsat ✅ 0.47100 0.47053
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.16745 0.16735
Z3++BV z3++bv_0702_default unsat ✅ 0.40181 0.40169
Z3 z3-4.8.17_default unsat ✅ 0.39888 0.40052
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.38003 1.37218
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.32673 2.32724
STP STP 2022.4_default unsat ✅ 0.45401 0.45407
STP 2022.4_default unsat ✅ 0.45642 0.45643
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 616.38000 702.74500
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.16191 0.16189
Z3-Owl z3-Owl-Final_default unsat ✅ 1.00497 1.00496
z3-Owl-Final_default unsat ✅ 1.03171 1.03188