Benchmark

non-incremental/QF_BV/Sage2/bench_13240.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size6852797
Compressed Size44066
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 6852789
Compressed Size44053
Max. Term Depth619
Asserts 784
Declared Functions0
Declared Constants4084
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 ite57 not164
=214 let47028 extract9 bvand4
bvor10 bvadd102474 bvmul810 bvudiv136
bvult175 bvule129 bvugt42 bvuge273
bvsle2 bvsge6 bvshl76200 bvlshr34
zero_extend101788

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 20.39930 20.39670
Boolector SMT17 final boolector sat ✅ 12.25580 12.25280
CVC4 CVC4-smtcomp2017-main default sat ✅ 39.66380 75.66650
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01500 599.77000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 4.18073 4.19968
Q3B Q3B default unknown ❌ 600.04300 1799.56000
STP stp_st default unknown ❌ 600.01500 599.96800
stp_mt default sat ✅ 462.91000 1832.73000
Yices2 Yices2-Main default sat ✅ 1.85229 1.85223
Z3 z3-4.5.0 default unknown ❌ 600.09800 599.88000
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 6.79035 6.78960
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 24.30290 24.30270
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1070.20000 1070.03000
MinkeyRink Minkeyrink MT_mt sat ✅ 4.51364 10.83750
Minkeyrink ST_st sat ✅ 7.11822 7.09538
STP STP-CMS-st-2018_default-no-stderr sat ✅ 836.22500 836.22800
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 849.01200 3371.16000
STP-Riss-st-2018_riss-no-stderr sat ✅ 254.72700 254.73300
Yices2 Yices 2.6.0_default sat ✅ 2.40723 2.40716
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.80000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 11.69050 11.68970
Poolector-wrapped-sq_default sat ✅ 14.23030 55.92000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 11.94100 11.93990
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 51.51090 51.50720
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 5.83244 16.45180
MinkeyRink ST-wrapped-sq_default sat ✅ 4.62967 4.62942
Par4 Par4-wrapped-sq_default sat ✅ 1.97343 5.75000
STP STP-2019-wrapped-sq_default sat ✅ 954.14500 954.04400
stp-mergesat-fixed-wrapped-sq_default sat ✅ 559.48900 559.41900
stp-minisat-wrapped-sq_default sat ✅ 1552.49000 1552.29000
stp-mt-wrapped-sq_default sat ✅ 1069.96000 4245.00000
stp-portfolio-fixed-wrapped-sq_default sat ✅ 1626.26000 3273.77000
stp-riss-wrapped-sq_default unknown ❌ 1.80361 1.80371
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 2.08087 2.08061
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 5.46595 5.46594
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 42.11850 42.11870
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.04000 2399.60000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 2.53074 2.53057
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.73000
SMT-COMP 2020 0.44 (5/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.64480 11.64250
Boolector Boolector-wrapped-sq_default sat ✅ 10.73710 10.73090
Poolector-wrapped-sq_default sat ✅ 12.81130 50.10000
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1199.54000
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1200.02000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.68000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.94213 1.94206
MinkeyRink Solver 2020.3_default sat ✅ 2.86049 5.44079
STP STP_default sat ✅ 2.96641 7.81562
STP ++ Mergsat v1_default sat ✅ 2.12657 4.22812
Yices2 Yices 2.6.2 bug fix_default sat ✅ 6.65374 6.65149
Z3 z3-4.8.8_default unknown ❌ 1200.05000 1199.75000
SMT-COMP 2022 0.57 (3/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 10.31460 10.31430
Bitwuzla-wrapped_default sat ✅ 9.89849 9.89854
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.09000 1199.45000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.71000
STP STP 2022.4_default sat ✅ 3.58952 3.58954
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 8.52736 8.52742
Z3++BV z3++bv_0702_default unknown ❌ 1200.05000 1199.40000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.76000
SMT-COMP 2023 0.50 (3/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 9.96923 9.96882
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.65000
STP STP 2022.4_default sat ✅ 3.66270 3.66251
STP 2022.4_default sat ✅ 3.66080 3.66014
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 6.49706 19.52610
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 2.39640 2.39590
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1199.86000
z3-Owl-Final_default unknown ❌ 1200.10000 1199.97000
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 4.60733 4.50536
cvc5 cvc5 sat ✅ 894.04814 893.82652
SMTInterpol SMTInterpol unknown ❌ 206.23836 240.51956
STP STP sat ✅ 4.80399 4.70206
Yices2 Yices2 sat ✅ 5.16865 5.06698
Z3alpha Z3-alpha unknown ❌ 1201.72179 1200.88406
SMT-COMP 2025 0.44 (5/9) Bitwuzla Bitwuzla sat ✅ 4.08829 3.97469
Bitwuzla-MachBV-base sat ✅ 4.69046 4.57472
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 4.80623 4.68721
BVDecide bv_decide sat ✅ 151.03028 150.92799
bv_decide-nokernel sat ✅ 123.38988 123.26983
cvc5 cvc5 sat ✅ 931.09712 930.71191
SMTInterpol SMTInterpol unknown ❌ 187.20880 214.10817
Yices2 Yices2 sat ✅ 3.73055 3.61009
Z3alpha Z3-alpha unknown ❌ 1202.10201 4800.80039
Z3 Z3-alpha-base unknown ❌ 1201.49970 1201.16896
Z3-Owl-base unknown ❌ 1201.49866 1201.23241
z3siri-base unknown ❌ 1201.48930 1201.16633
Z3-Owl Z3-Owl unknown ❌ 1201.79108 1201.41537