Benchmark

non-incremental/QF_BV/uclid_contrib_smtcomp09/std_bv_formula.smt2 

Generated by ATLAS/UCLID; contributed by B. Brady, R. E. Bryant, S. A. Seshia.
Benchmark
Size92878
Compressed Size16213
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 92870
Compressed Size16230
Max. Term Depth765
Asserts 1
Declared Functions0
Declared Constants141
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite789 not482 or1023 and740
=1485 let402 concat46 extract103
bvnot10 bvand11 bvxor11 bvneg1
bvadd53 bvsub11 sign_extend169

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.33 (2/3) CVC3 CVC3 2.3 unknown ❌ 1200.20000 —
SONOLAR SONOLAR r252 unsat ✅ 349.90000 —
STP simplifyingSTP unsat ✅ 321.00000 —
SMT-COMP 2012 4Simp 4Simp unsat ✅ 55.30000 —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 506.60000 —
Boolector Boolector unsat ✅ 257.20000 —
CVC3 CVC3 v2.4.2 unknown ❌ 699.40000 —
CVC4 1.0rc.3931 unsat ✅ 526.10000 —
MathSAT MathSAT-HeavyBV unsat ✅ 415.80000 —
SONOLAR SONOLAR unsat ✅ 87.00000 —
Z3 Z3 unsat ✅ 308.00000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 24.44340 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 166.00500 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 31.48490 —
abziz_portfolio_2012_minfeatures default unsat ✅ 38.19230 —
abziz_portfolio_2012_solvers default unsat ✅ 29.68020 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 52.99690 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 88.93000 —
Boolector-SMT-COMP-2011 default unsat ✅ 121.91300 —
Boolector-SMT-COMP-2012 default unsat ✅ 225.59200 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 38.19600 —
CVC4-SMT-EVAL-2013 default unsat ✅ 749.49500 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 16.25500 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 245.87400 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 25.00220 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 32.45160 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 24.71640 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 94.92720 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 50.25880 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 44.78470 —
STP STP2-SMT-COMP-2011 default unsat ✅ 73.20480 —
STP2-SMT-COMP-2012 default unsat ✅ 36.77860 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 169.25200 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 127.14500 —
Z3-SMT-COMP-2011 default unsat ✅ 165.13600 —
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 18.42370 18.41120
Abziz abziz_portfolio_all_features default unsat ✅ 29.26410 29.14930
abziz_portfolio_min_features default unsat ✅ 27.91600 27.82150
Boolector Boolector boolector unsat ✅ 101.72300 101.74700
CVC4 CVC4 f7118b2 default unsat ✅ 201.99800 405.31900
MathSAT MathSAT-5.2.12-Main default unsat ✅ 30.85310 30.85730
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 13.78330 13.77390
STP stp-cryptominisat4 default unsat ✅ 142.34500 142.36500
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 455.96600 456.16700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 137.58900 137.58700
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 57.30160 57.30530
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 255.25100 512.13400
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 205.38800 412.00200
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 19.64330 19.65000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.74000
STP stp-cryptominisat4 default unsat ✅ 120.33100 120.35800
stp-cmsat4-v15 default unsat ✅ 38.01910 38.02620
stp-cmsat4-mt-v15 default unknown ❌ 0.57063 0.56991
stp-minisat-v15 default unsat ✅ 64.46490 64.49020
Yices2 Yices default unsat ✅ 366.12800 366.27700
Z3 z3 4.4.0 default unsat ✅ 116.70700 116.75500
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unsat ✅ 251.71900 251.83500
ABC_glucose glucose unsat ✅ 34.14460 34.16270
Boolector Boolector boolector unsat ✅ 56.02190 56.05700
Boolector preprop boolector unsat ✅ 55.50430 55.52840
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 188.20800 377.86600
MapleSTP MapleSTP default unknown ❌ 2400.10000 2401.69000
MapleSTP-mt default unknown ❌ 2400.06000 9524.93000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 12.31370 12.32220
MinkeyRink Minkeyrink 2016 default unsat ✅ 29.12840 103.23900
Q3B Q3B default unknown ❌ 2400.04000 7204.04000
STP stp-cms-exp-2016 default unsat ✅ 53.43090 53.44310
stp-cms-mt-2016 default unsat ✅ 21.62550 83.94280
stp-cms-st-2016 default unsat ✅ 22.78620 22.79910
stp-minisat-st-2016 default unsat ✅ 725.90300 726.38000
Yices2 Yices-2.4.2 default unsat ✅ 261.63700 261.76900
Z3 z3-4.4.1 default unsat ✅ 148.94600 149.04800
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 8.85507 8.85384
Boolector SMT17 final boolector unsat ✅ 39.85790 39.85690
CVC4 CVC4-smtcomp2017-main default unsat ✅ 267.54900 538.04800
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 16.19840 16.19650
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 44.94050 85.24000
Q3B Q3B default unknown ❌ 600.04700 1795.53000
STP stp_st default unsat ✅ 39.39780 39.39220
stp_mt default unsat ✅ 38.27720 119.15600
Yices2 Yices2-Main default unsat ✅ 312.69500 312.62200
Z3 z3-4.5.0 default unsat ✅ 107.83700 107.82400
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 7.73157 7.73085
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 29.42730 29.42440
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 18.66880 18.66720
MinkeyRink Minkeyrink MT_mt unsat ✅ 28.26360 110.49700
Minkeyrink ST_st unsat ✅ 40.85690 40.84250
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 36.94880 36.93830
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 33.07910 129.51900
STP-Riss-st-2018_riss-no-stderr unsat ✅ 43.66420 43.66110
Yices2 Yices 2.6.0_default unsat ✅ 288.23900 288.22900
Z3 z3-4.7.1_default unsat ✅ 144.00600 144.00300
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 13.48780 13.48670
Poolector-wrapped-sq_default unsat ✅ 15.23700 59.86000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 38.26180 38.25970
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 69.23630 69.17980
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 30.83310 121.00500
MinkeyRink ST-wrapped-sq_default unsat ✅ 45.50700 45.50130
Par4 Par4-wrapped-sq_default unsat ✅ 9.59705 28.46000
STP STP-2019-wrapped-sq_default unsat ✅ 32.29180 32.28680
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 72.96320 72.94130
stp-minisat-wrapped-sq_default unsat ✅ 33.55530 33.54490
stp-mt-wrapped-sq_default unsat ✅ 25.36640 98.79390
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 75.14760 145.24300
stp-riss-wrapped-sq_default unknown ❌ 0.68391 0.66595
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 317.65100 317.61900
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 53.16210 53.16350
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 44.58910 44.58800
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.93000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 18.02680 18.02770
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 108.86500 108.84400
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 20.50320 20.49970
Boolector Boolector-wrapped-sq_default unsat ✅ 15.16610 15.16610
Poolector-wrapped-sq_default unsat ✅ 17.53810 68.57080
CVC4 CVC4-sq-final_default unsat ✅ 58.44190 58.44020
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1199.80000
MathSAT MathSAT5_default.sh unsat ✅ 47.62210 47.61970
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.54245 0.54261
MinkeyRink Solver 2020.3_default unsat ✅ 27.15060 106.26700
STP STP_default unsat ✅ 27.66440 108.17900
STP ++ Mergsat v1_default unsat ✅ 47.79180 47.79310
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 18.38500 18.38440
Z3 z3-4.8.8_default unsat ✅ 182.21400 182.17400
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 16.41940 16.41920
MathSAT mathsat-5.6.6_default unsat ✅ 68.15320 68.14780
STP STP 2021.0_default unsat ✅ 29.52970 115.20100
Z3 z3-4.8.11_default unsat ✅ 159.51400 159.51400
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 20.59450 20.59050
Bitwuzla-wrapped_default unsat ✅ 15.42080 15.41660
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 67.34840 67.34320
MathSAT MathSAT-5.6.8_default unsat ✅ 46.60090 46.59790
STP STP 2022.4_default unsat ✅ 19.49140 19.48870
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 20.78300 20.78160
Z3++BV z3++bv_0702_default unsat ✅ 32.75490 32.74490
Z3 z3-4.8.17_default unsat ✅ 166.93800 166.88000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 19.70137 19.60078
cvc5 cvc5 unsat ✅ 57.29418 57.16401
SMTInterpol SMTInterpol unknown ❌ 1201.74393 1276.74143
STP STP unsat ✅ 20.42653 20.32595
Yices2 Yices2 unsat ✅ 25.97194 25.86537
Z3alpha Z3-alpha unsat ✅ 179.47705 179.37513
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 15.75121 15.62772
Bitwuzla-MachBV-base unsat ✅ 14.76092 14.63232
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 14.32932 14.20641
BVDecide bv_decide unknown ❌ 1201.39695 1201.03546
bv_decide-nokernel unsat ✅ 229.29124 229.13819
cvc5 cvc5 unsat ✅ 42.23424 42.09329
SMTInterpol SMTInterpol unknown ❌ 1201.38903 1235.67797
Yices2 Yices2 unsat ✅ 18.73137 18.60541
Z3alpha Z3-alpha unsat ✅ 166.31514 663.63437
Z3 Z3-alpha-base unsat ✅ 438.51362 438.32711
Z3-Owl-base unknown ❌ 1201.29347 1200.94258
z3siri-base unsat ✅ 446.18599 445.97076
Z3-Owl Z3-Owl unsat ✅ 175.91201 175.76710