Benchmark

non-incremental/QF_BV/brummayerbiere4/unconstrained10.smt2 

This benchmark demonstrates the need for propagating unconstrained bit-vectors.

Contributed by Robert Brummayer (robert.brummayer@gmail.com)
Benchmark
Size631
Compressed Size335
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2013-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 623
Compressed Size335
Max. Term Depth8
Asserts 1
Declared Functions0
Declared Constants5
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1 not2 =2 extract1
bvmul1 bvudiv5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 354.17000 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.02187 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.02804 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.02194 —
abziz_portfolio_2012_solvers default sat ✅ 0.02356 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.02167 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default sat ✅ 940.95100 —
Boolector-SMT-COMP-2012 default sat ✅ 249.78400 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 974.52700 —
CVC3-SMT-COMP-2011 default sat ✅ 918.83200 —
CVC3-SMT-COMP-2012 default sat ✅ 947.75700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ 105.53700 —
MathSAT5-SMT-COMP-2012 default unknown ❌ 65.44120 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default sat ✅ 0.00970 —
STP2-SMT-COMP-2012 default sat ✅ 0.01325 —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 448.63600 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.01996 —
Z3-SMT-COMP-2011 default sat ✅ 0.01680 —
SMT-COMP 2014 0.22 (7/9) 4Simp 4Simp - 2014 default sat ✅ 1834.39000 1825.83000
Abziz abziz_portfolio_all_features default sat ✅ 0.04855 0.03599
abziz_portfolio_min_features default sat ✅ 0.04893 0.03499
Boolector Boolector boolector sat ✅ 0.01023 0.00200
CVC4 CVC4 f7118b2 default sat ✅ 0.02330 0.01100
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.31000 2400.09000
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.12000 2400.01000
STP stp-cryptominisat4 default sat ✅ 0.00893 0.00800
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 88.87250 88.90150
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.00759 0.00600
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.00878 0.00358
Boolector SMT17 final boolector sat ✅ 0.00892 0.00298
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.01379 0.01438
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 86.67440 86.67060
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.01029 0.00993
Q3B Q3B default sat ✅ 7.06269 20.75000
STP stp_st default sat ✅ 0.00876 0.00814
stp_mt default sat ✅ 0.00912 0.00825
Yices2 Yices2-Main default sat ✅ 86.59330 86.58730
Z3 z3-4.5.0 default sat ✅ 0.03262 0.03177
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 0.00856 0.00294
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.06001 0.06019
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 94.39890 94.38420
MinkeyRink Minkeyrink MT_mt sat ✅ 0.01067 0.01074
Minkeyrink ST_st sat ✅ 0.00992 0.00997
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.00871 0.00504
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.00768 0.00525
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.00833 0.00500
Yices2 Yices 2.6.0_default sat ✅ 68.57790 68.57360
Z3 z3-4.7.1_default sat ✅ 0.03463 0.03453
SMT-COMP 2019 0.25 (6/8) Boolector Boolector-wrapped-sq_default sat ✅ 0.01139 0.00676
Poolector-wrapped-sq_default sat ✅ 0.17485 0.11445
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unknown ❌ 2400.03000 2400.03000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 874.31900 874.16000
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.01462 0.01482
MinkeyRink ST-wrapped-sq_default sat ✅ 0.01279 0.01286
Par4 Par4-wrapped-sq_default sat ✅ 0.01096 0.00571
STP STP-2019-wrapped-sq_default sat ✅ 0.01295 0.01309
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.01310 0.01324
stp-minisat-wrapped-sq_default sat ✅ 0.01260 0.01272
stp-mt-wrapped-sq_default sat ✅ 0.01287 0.01303
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.01364 0.01376
stp-riss-wrapped-sq_default sat ✅ 0.01330 0.01343
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.00922 0.00602
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.01307 0.00687
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.00916 0.00615
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.66294 0.66292
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.00980 0.00655
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.03710 0.03710
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 154.42400 154.39600
Boolector Boolector-wrapped-sq_default sat ✅ 0.01524 0.00697
Poolector-wrapped-sq_default sat ✅ 0.17577 0.11536
CVC4 CVC4-sq-final_default unknown ❌ 907.62300 906.79500
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.10000 1200.01000
MathSAT MathSAT5_default.sh sat ✅ 400.63200 400.56000
MinkeyRink MinkeyRink Solver 2020.3.1_default sat ✅ 0.01211 0.01223
MinkeyRink Solver 2020.3_default sat ✅ 0.03740 0.01538
STP STP_default sat ✅ 0.01317 0.01165
STP ++ Mergsat v1_default sat ✅ 0.00984 0.00665
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.01171 0.00355
Z3 z3-4.8.8_default sat ✅ 0.03246 0.03240
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 441.19500 441.18600
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.77000
STP STP 2022.4_default sat ✅ 0.01202 0.01049
STP 2022.4_default sat ✅ 0.01148 0.01122
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.42196 11.85820
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01025 0.00389
Z3-Owl z3-Owl-Final_default sat ✅ 0.69014 0.69019
z3-Owl-Final_default sat ✅ 0.69500 0.69524