Benchmark

non-incremental/QF_BV/bruttomesso/core/ext_con_060_016_1024.smt2 

Generated by Roberto Bruttomesso
Benchmark
Size168743
Compressed Size6285
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 168735
Compressed Size6232
Max. Term Depth9
Asserts 1
Declared Functions0
Declared Constants77
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not960 or61 and1021 =2880
let1 concat1920 extract3872

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 2.90369 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 2.90398 —
abziz_portfolio_2012_minfeatures default unsat ✅ 2.92781 —
abziz_portfolio_2012_solvers default unsat ✅ 2.90753 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 2.87149 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 62.58420 —
Boolector-SMT-COMP-2011 default unsat ✅ 109.28200 —
Boolector-SMT-COMP-2012 default unsat ✅ 249.22200 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 380.06100 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 12.36180 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.52263 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 164.76500 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 8.99165 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 366.60200 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 904.25100 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unsat ✅ 305.09100 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 59.04180 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 3.03801 —
Z3-SMT-COMP-2011 default unsat ✅ 2.71714 —
SMT-COMP 2014 0.22 (7/9) 4Simp 4Simp - 2014 default unknown ❌ 2399.12000 2400.05000
Abziz abziz_portfolio_all_features default unsat ✅ 4.16903 4.15537
abziz_portfolio_min_features default unsat ✅ 4.20193 4.18936
Boolector Boolector boolector unsat ✅ 30.85240 30.85130
CVC4 CVC4 f7118b2 default unsat ✅ 5.45420 10.79740
MathSAT MathSAT-5.2.12-Main default unsat ✅ 151.65500 151.66100
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2398.91000 2400.05000
STP stp-cryptominisat4 default unsat ✅ 219.41900 219.48800
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 37.97980 37.98920
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 2.17061 2.16367
SMT-COMP 2015 0.43 (4/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 29.23940 29.24460
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.46833 8.83766
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.27568 8.44671
MathSAT MathSat 5.3.6 main smtcomp2015_main unknown ❌ 2400.01000 2400.80000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.69000
STP stp-cryptominisat4 default unsat ✅ 286.34400 286.48700
stp-cmsat4-v15 default unsat ✅ 22.41170 22.41160
stp-cmsat4-mt-v15 default unknown ❌ 1.12920 1.12783
stp-minisat-v15 default unknown ❌ 2400.01000 2400.85000
Yices2 Yices default unknown ❌ 2400.01000 2401.05000
Z3 z3 4.4.0 default unsat ✅ 2.24614 2.24666
SMT-COMP 2016 0.30 (7/10) ABC ABC_default default_abc unknown ❌ 2400.03000 2401.34000
ABC_glucose glucose unknown ❌ 2400.02000 2401.62000
Boolector Boolector boolector unsat ✅ 19.87580 19.88700
Boolector preprop boolector unsat ✅ 19.95140 19.96250
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.50930 8.92512
MapleSTP MapleSTP default unsat ✅ 29.02280 29.03980
MapleSTP-mt default unsat ✅ 32.66900 124.98000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unknown ❌ 2400.03000 2401.17000
MinkeyRink Minkeyrink 2016 default unsat ✅ 25.24050 88.34860
Q3B Q3B default unknown ❌ 2400.05000 7203.65000
STP stp-cms-exp-2016 default unsat ✅ 21.95980 21.97420
stp-cms-mt-2016 default unsat ✅ 21.56640 81.50050
stp-cms-st-2016 default unsat ✅ 29.54000 29.55920
stp-minisat-st-2016 default unknown ❌ 2400.03000 2401.39000
Yices2 Yices-2.4.2 default unsat ✅ 55.49600 55.53270
Z3 z3-4.4.1 default unsat ✅ 2.65134 2.65430
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 24.69920 24.67140
Boolector SMT17 final boolector unsat ✅ 21.33780 14.15020
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.88305 11.67020
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01500 599.87000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 43.26730 81.61000
Q3B Q3B default unknown ❌ 600.07800 1799.82000
STP stp_st default unsat ✅ 41.09600 41.07030
stp_mt default unsat ✅ 27.82680 81.09330
Yices2 Yices2-Main default unknown ❌ 600.10500 599.97800
Z3 z3-4.5.0 default unsat ✅ 2.76670 2.76600
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default unsat ✅ 40.20330 40.20010
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 101.00500 101.01000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.11000 1199.96000
MinkeyRink Minkeyrink MT_mt unsat ✅ 20.51820 78.23600
Minkeyrink ST_st unsat ✅ 19.73270 19.73180
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 27.87700 27.87220
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 21.76240 82.90010
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.02000 1200.02000
Yices2 Yices 2.6.0_default unknown ❌ 1200.10000 1200.04000
Z3 z3-4.7.1_default unsat ✅ 2.88240 2.87957
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 18.30220 18.30180
Poolector-wrapped-sq_default unsat ✅ 15.33600 60.39000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 22.83650 22.83570
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 6.66699 6.66760
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 17.43480 66.54660
MinkeyRink ST-wrapped-sq_default unsat ✅ 26.04690 26.04780
Par4 Par4-wrapped-sq_default unsat ✅ 14.27700 42.64000
STP STP-2019-wrapped-sq_default unsat ✅ 19.62240 19.62210
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 7.84295 7.84234
stp-minisat-wrapped-sq_default unknown ❌ 2400.02000 2399.89000
stp-mt-wrapped-sq_default unsat ✅ 19.45270 72.39350
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.02000 2427.57000
stp-riss-wrapped-sq_default unknown ❌ 1.07586 1.07605
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 46.49750 46.49760
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 5.76027 5.76000
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 15.86950 15.86850
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 191.26800 191.25900
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 79.87920 79.86040
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 2.69864 2.69848
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 10.42720 10.42370
Boolector Boolector-wrapped-sq_default unsat ✅ 10.37430 10.37350
Poolector-wrapped-sq_default unsat ✅ 12.91500 50.80000
CVC4 CVC4-sq-final_default unsat ✅ 8.60275 8.60272
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.91000
MathSAT MathSAT5_default.sh unsat ✅ 828.96200 828.66600
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.83522 0.83548
MinkeyRink Solver 2020.3_default unsat ✅ 17.08570 64.89500
STP STP_default unsat ✅ 15.88440 60.29240
STP ++ Mergsat v1_default unsat ✅ 27.89350 27.89670
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 5.27065 5.26969
Z3 z3-4.8.8_default unsat ✅ 2.62976 2.62977
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 10.67090 10.66960
Bitwuzla-wrapped_default unsat ✅ 11.36040 11.36020
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 8.14936 8.14957
MathSAT MathSAT-5.6.8_default unsat ✅ 313.83500 313.76100
STP STP 2022.4_default unsat ✅ 9.58169 9.58220
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 2.31023 2.30995
Z3++BV z3++bv_0702_default unsat ✅ 2.96149 2.96107
Z3 z3-4.8.17_default unsat ✅ 2.92894 2.93025