Benchmark

non-incremental/QF_BV/Sage2/bench_6821.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size6841998
Compressed Size63790
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 6841990
Compressed Size63778
Max. Term Depth2238
Asserts 1009
Declared Functions0
Declared Constants577
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite205 not178 =436
let142337 extract48 bvand4 bvor195
bvadd102722 bvmul11750 bvult306 bvule163
bvuge282 bvsle3 bvsgt20 bvsge3
bvshl195 bvlshr20 zero_extend26815

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.62 (3/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.01200 599.96400
Boolector SMT17 final boolector unknown ❌ 600.02600 599.95700
CVC4 CVC4-smtcomp2017-main default sat ✅ 39.11630 75.66870
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01500 599.93000
MinkeyRink MinkeyRink 2017.3a default unknown ❌ 600.02400 1208.09000
Q3B Q3B default unknown ❌ 600.07600 1799.50000
STP stp_st default sat ✅ 8.42096 8.41929
stp_mt default sat ✅ 12.55180 22.21960
Yices2 Yices2-Main default sat ✅ 1.36653 1.36599
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.96800
SMT-COMP 2018 0.57 (3/7) Boolector Boolector_default unknown ❌ 1200.03000 1200.01000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 44.89300 44.88180
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.79000
MinkeyRink Minkeyrink MT_mt unknown ❌ 1200.08000 4769.08000
Minkeyrink ST_st unknown ❌ 1200.02000 1199.95000
STP STP-CMS-st-2018_default-no-stderr sat ✅ 5.01331 5.01353
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 5.36424 7.03573
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.01000 1199.86000
Yices2 Yices 2.6.0_default sat ✅ 1.92746 1.92730
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.74000
SMT-COMP 2019 0.25 (6/8) Boolector Boolector-wrapped-sq_default unknown ❌ 2400.08000 2399.82000
Poolector-wrapped-sq_default unknown ❌ 2400.09000 9512.60000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unknown ❌ 2400.02000 2400.04000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 44.06420 44.06330
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1803.77000 7165.07000
MinkeyRink ST-wrapped-sq_default unknown ❌ 2400.09000 2399.92000
Par4 Par4-wrapped-sq_default sat ✅ 1.75187 5.04000
STP STP-2019-wrapped-sq_default sat ✅ 5.32023 5.31938
stp-mergesat-fixed-wrapped-sq_default sat ✅ 2031.46000 2031.09000
stp-minisat-wrapped-sq_default unknown ❌ 2400.05000 2399.86000
stp-mt-wrapped-sq_default sat ✅ 5.55054 6.80178
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.03000 4715.00000
stp-riss-wrapped-sq_default unknown ❌ 5.09769 5.09774
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.69033 1.69025
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.21992 1.21983
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.98963 1.98960
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2400.03000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 1.45399 1.45395
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1146.18000 1146.05000
SMT-COMP 2021 0.75 (1/4) Bitwuzla Bitwuzla-fixed_default unknown ❌ 1200.01000 1199.83000
MathSAT mathsat-5.6.6_default unknown ❌ 1200.02000 1199.83000
STP STP 2021.0_default unknown ❌ 1200.11000 4761.38000
Z3 z3-4.8.11_default sat ✅ 419.03500 419.02100
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default unknown ❌ 1200.02000 1199.87000
Bitwuzla-wrapped_default unknown ❌ 1200.09000 1199.98000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 8.55312 8.54859
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.07000 1199.98000
STP STP 2022.4_default sat ✅ 1.21479 1.21467
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.58627 1.58597
Z3++BV z3++bv_0702_default sat ✅ 50.90900 50.90960
Z3 z3-4.8.17_default sat ✅ 300.16700 300.12900
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 6.23807 6.23742
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 28.12700 28.12080
STP STP 2022.4_default sat ✅ 60.95050 60.94520
STP 2022.4_default sat ✅ 61.40630 61.37440
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1257.53000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.59977 1.59958
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.02000 1199.99000
z3-Owl-Final_default sat ✅ 472.80000 472.66000
SMT-COMP 2025 0.56 (4/9) Bitwuzla Bitwuzla sat ✅ 2.71217 2.59417
Bitwuzla-MachBV-base sat ✅ 1.06834 0.95013
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.20697 1.08168
BVDecide bv_decide unknown ❌ 1201.88435 1201.72177
bv_decide-nokernel unknown ❌ 1201.89152 1201.85698
cvc5 cvc5 sat ✅ 4.68359 4.55358
SMTInterpol SMTInterpol unknown ❌ 1201.56149 1233.15841
Yices2 Yices2 sat ✅ 1.22416 1.10439
Z3alpha Z3-alpha unknown ❌ 1201.00550 4800.34226
Z3 Z3-alpha-base unknown ❌ 1201.31576 1201.02252
Z3-Owl-base unknown ❌ 1201.30321 1201.04081
z3siri-base unknown ❌ 1201.31259 1201.08966
Z3-Owl Z3-Owl unknown ❌ 1201.75570 1201.05261