Benchmark

non-incremental/QF_BV/uclid_contrib_smtcomp09/nt_bv_formula.smt2 

Generated by ATLAS/UCLID; contributed by B. Brady, R. E. Bryant, S. A. Seshia.
Benchmark
Size94014
Compressed Size16345
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 94006
Compressed Size16388
Max. Term Depth778
Asserts 1
Declared Functions0
Declared Constants142
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite800 not481 or1032 and760
=1500 let415 concat46 extract104
bvnot10 bvand11 bvxor11 bvneg1
bvadd53 bvsub11 sign_extend170

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 0.50 (4/8) Beaver beaver-smtcomp-2009 unsat ✅ 278.40000 —
Boolector Boolector unsat ✅ 732.90000 —
Boolector 1.2 unsat ✅ 135.90000 —
CVC3 CVC3 2.0 unknown ❌ 886.20000 —
MathSAT MathSAT 4.3 unsat ✅ 46.90000 —
OpenSMT OpenSMT 0.2 unknown ❌ 900.00000 —
STP STP #101 unknown ❌ 900.00000 —
SWORD sword-1.0 unsat ✅ 389.00000 —
Yices2 Yices 2 proto unknown ❌ 900.00000 —
SMT-COMP 2010 0.33 (2/3) CVC3 CVC3 2.3 unknown ❌ 1200.30000 —
SONOLAR SONOLAR r252 unsat ✅ 260.20000 —
STP simplifyingSTP unsat ✅ 288.10000 —
SMT-COMP 2012 4Simp 4Simp unsat ✅ 64.30000 —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 473.80000 —
Boolector Boolector unsat ✅ 283.60000 —
CVC3 CVC3 v2.4.2 unknown ❌ 1102.70000 —
CVC4 1.0rc.3931 unsat ✅ 393.70000 —
MathSAT MathSAT-HeavyBV unsat ✅ 493.80000 —
SONOLAR SONOLAR unsat ✅ 105.20000 —
Z3 Z3 unsat ✅ 282.90000 —
SMT-COMP 2011 0.17 (5/6) Boolector Boolector 1.5.23-833 unsat ✅ 161.20000 —
CVC3 CVC3 v2.4 unknown ❌ 626.80000 —
MathSAT MathSAT5 unsat ✅ 169.90000 —
SONOLAR SONOLAR unsat ✅ 77.10000 —
STP simplifyingSTP unknown ❌ 1200.00000 —
STP2 unsat ✅ 196.80000 —
Z3 Z3 unsat ✅ 291.20000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 20.66770 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 158.81800 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 39.53530 —
abziz_portfolio_2012_minfeatures default unsat ✅ 265.59200 —
abziz_portfolio_2012_solvers default unsat ✅ 25.32140 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 33.23000 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 90.76930 —
Boolector-SMT-COMP-2011 default unsat ✅ 113.17600 —
Boolector-SMT-COMP-2012 default unsat ✅ 259.24100 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 756.27800 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 49.80250 —
CVC4-SMT-EVAL-2013 default unsat ✅ 724.63900 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 28.89170 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 110.82600 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 34.57110 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 37.36600 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 16.76770 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 152.67900 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 27.92260 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 59.18660 —
STP STP2-SMT-COMP-2011 default unsat ✅ 96.71670 —
STP2-SMT-COMP-2012 default unsat ✅ 28.08710 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 168.94300 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 127.44600 —
Z3-SMT-COMP-2011 default unsat ✅ 148.65700 —
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 18.74970 18.74710
Abziz abziz_portfolio_all_features default unsat ✅ 39.53790 39.44080
abziz_portfolio_min_features default unsat ✅ 39.59190 39.49770
Boolector Boolector boolector unsat ✅ 145.93400 145.97800
CVC4 CVC4 f7118b2 default unsat ✅ 210.80800 423.01400
MathSAT MathSAT-5.2.12-Main default unsat ✅ 28.66680 28.67260
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 19.26170 19.25710
STP stp-cryptominisat4 default unsat ✅ 160.33800 160.38900
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 391.64100 391.77400
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 156.51800 156.52500
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 51.68390 51.70410
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 239.67300 480.97900
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 225.96100 453.18000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 14.80720 14.81270
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.85000
STP stp-cryptominisat4 default unsat ✅ 131.35000 131.37900
stp-cmsat4-v15 default unsat ✅ 33.78030 33.77190
stp-cmsat4-mt-v15 default unknown ❌ 0.58230 0.58091
stp-minisat-v15 default unsat ✅ 137.65900 137.72700
Yices2 Yices default unsat ✅ 301.77900 301.89300
Z3 z3 4.4.0 default unsat ✅ 149.36200 149.43600
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 229.78300 229.89100
ABC_glucose glucose unsat ✅ 28.11290 28.12710
Boolector Boolector boolector unsat ✅ 41.75430 41.77780
Boolector preprop boolector unsat ✅ 41.92830 41.95230
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 189.32300 380.02900
MapleSTP MapleSTP default unknown ❌ 2400.10000 2401.65000
MapleSTP-mt default unsat ✅ 1846.45000 7338.96000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 20.15620 20.16890
MinkeyRink Minkeyrink 2016 default unsat ✅ 40.03800 146.38900
Q3B Q3B default unknown ❌ 2400.12000 7203.80000
STP stp-cms-exp-2016 default unsat ✅ 53.86800 53.89620
stp-cms-mt-2016 default unsat ✅ 27.93040 108.97300
stp-cms-st-2016 default unsat ✅ 52.35950 52.37460
stp-minisat-st-2016 default unsat ✅ 899.69800 900.20300
Yices2 Yices-2.4.2 default unsat ✅ 468.84500 469.06200
Z3 z3-4.4.1 default unsat ✅ 127.94100 127.98600
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 9.77256 9.76847
Boolector SMT17 final boolector unsat ✅ 42.79720 42.79810
CVC4 CVC4-smtcomp2017-main default unsat ✅ 245.51400 492.50200
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 14.72330 14.72410
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 46.15150 87.71000
Q3B Q3B default unknown ❌ 600.04600 1799.72000
STP stp_st default unsat ✅ 53.30840 53.29980
stp_mt default unsat ✅ 29.91030 116.38800
Yices2 Yices2-Main default unsat ✅ 487.71000 487.64100
Z3 z3-4.5.0 default unsat ✅ 169.83900 169.81200
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 7.64791 7.64724
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 20.39360 20.39280
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 23.07360 23.07260
MinkeyRink Minkeyrink MT_mt unsat ✅ 40.08870 157.12700
Minkeyrink ST_st unsat ✅ 38.50510 38.49980
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 37.94870 37.94230
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 31.62060 123.57600
STP-Riss-st-2018_riss-no-stderr unsat ✅ 43.62670 43.62220
Yices2 Yices 2.6.0_default unsat ✅ 338.83800 338.67300
Z3 z3-4.7.1_default unsat ✅ 146.03500 146.01900
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 19.23960 19.23630
Poolector-wrapped-sq_default unsat ✅ 21.44890 84.57000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 33.22900 33.23100
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 62.08540 62.07970
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 29.05620 113.78600
MinkeyRink ST-wrapped-sq_default unsat ✅ 33.73610 33.73310
Par4 Par4-wrapped-sq_default unsat ✅ 9.62083 28.77000
STP STP-2019-wrapped-sq_default unsat ✅ 33.46000 33.45700
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 119.69300 119.68000
stp-minisat-wrapped-sq_default unsat ✅ 53.40720 53.40440
stp-mt-wrapped-sq_default unsat ✅ 30.51520 119.13700
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 124.13900 217.22500
stp-riss-wrapped-sq_default unknown ❌ 0.67866 0.67876
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 318.82900 318.78600
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 40.06990 40.06510
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 47.02840 47.02240
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.11000 2399.93000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 25.92560 25.92430
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 129.71700 129.69500
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 16.64440 16.63460
Boolector Boolector-wrapped-sq_default unsat ✅ 15.40770 15.40370
Poolector-wrapped-sq_default unsat ✅ 17.22030 67.83000
CVC4 CVC4-sq-final_default unsat ✅ 56.01850 55.96620
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.08000 1199.88000
MathSAT MathSAT5_default.sh unsat ✅ 52.72640 52.72240
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.56546 0.56563
MinkeyRink Solver 2020.3_default unsat ✅ 27.87000 108.96500
STP STP_default unsat ✅ 29.07600 113.81500
STP ++ Mergsat v1_default unsat ✅ 54.28950 54.28230
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 20.51110 20.50820
Z3 z3-4.8.8_default unsat ✅ 155.74600 155.75200
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 40.86340 40.86520
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 63.80850 63.80000
STP STP 2022.4_default unsat ✅ 22.15600 22.15380
STP 2022.4_default unsat ✅ 22.12740 22.12660
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1238.84000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 428.39500 428.37300
Z3-Owl z3-Owl-Final_default unsat ✅ 62.88720 62.88590
z3-Owl-Final_default unsat ✅ 55.95760 55.94630