Benchmark

non-incremental/QF_BV/Sage2/bench_9571.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1628029
Compressed Size16060
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1628021
Compressed Size16052
Max. Term Depth1053
Asserts 345
Declared Functions0
Declared Constants345
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite123 not105 =115
let36962 extract3 bvand18 bvadd23714
bvmul299 bvult170 bvule47 bvugt27
bvuge108 bvlshr48 zero_extend12529

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 3.53096 3.53026
Boolector SMT17 final boolector unsat ✅ 3.13216 3.13073
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.12023 3.42366
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.24091 1.23540
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.24807 0.24703
Q3B Q3B default unknown ❌ 600.07900 798.55000
STP stp_st default unsat ✅ 0.21843 0.21759
stp_mt default unsat ✅ 0.22488 0.22161
Yices2 Yices2-Main default unsat ✅ 0.24332 0.24186
Z3 z3-4.5.0 default unknown ❌ 600.01700 599.96800
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 0.39720 0.39706
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.78338 1.78347
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.99509 0.99621
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.24803 0.24807
Minkeyrink ST_st unsat ✅ 0.25056 0.25040
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.44728 0.44743
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.46709 0.59652
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.41850 0.41855
Yices2 Yices 2.6.0_default unsat ✅ 0.24393 0.24386
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1199.98000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 4.14204 4.14182
Poolector-wrapped-sq_default unsat ✅ 2.90597 13.91850
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 2.58069 2.58051
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 9.47732 9.47659
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.42146 0.42160
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.41835 0.41845
Par4 Par4-wrapped-sq_default unsat ✅ 0.25585 0.00594
STP STP-2019-wrapped-sq_default unsat ✅ 0.21333 0.21369
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20853 0.20871
stp-minisat-wrapped-sq_default unsat ✅ 0.20717 0.20739
stp-mt-wrapped-sq_default unsat ✅ 0.21586 0.21691
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 0.35263 0.33264
stp-riss-wrapped-sq_default unsat ✅ 0.21050 0.21076
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.21821 0.21821
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.21757 0.21761
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.21833 0.21835
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.05000 2399.99000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.21777 0.21778
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.01000 2399.75000
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.08086 3.08068
Bitwuzla-wrapped_default unsat ✅ 2.59479 2.59470
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 640.86200 640.67800
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67431 0.67423
STP STP 2022.4_default unsat ✅ 0.13486 0.13490
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.25641 0.25634
Z3++BV z3++bv_0702_default unknown ❌ 1200.06000 1199.89000
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.93000
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.44768 3.44784
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.82000
STP STP 2022.4_default unsat ✅ 0.13513 0.13521
STP 2022.4_default unsat ✅ 0.13544 0.13547
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 14.75710 37.48360
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.25368 0.25361
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.06000 1199.82000
z3-Owl-Final_default unsat ✅ 872.24100 872.13300
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.83589 0.73522
cvc5 cvc5 unsat ✅ 286.21868 285.98219
SMTInterpol SMTInterpol unsat ✅ 15.94046 41.54795
STP STP unsat ✅ 1.78037 1.68039
Yices2 Yices2 unsat ✅ 0.36657 0.26658
Z3alpha Z3-alpha unknown ❌ 1201.71467 1200.72883
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 2.08257 1.94790
Bitwuzla-MachBV-base unsat ✅ 0.62904 0.50050
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.61852 0.49646
BVDecide bv_decide unsat ✅ 158.24587 158.03297
bv_decide-nokernel unsat ✅ 31.50910 31.34683
cvc5 cvc5 unknown ❌ 1201.78435 1201.02030
SMTInterpol SMTInterpol unsat ✅ 6.66714 14.40986
Yices2 Yices2 unsat ✅ 0.39823 0.28392
Z3alpha Z3-alpha unsat ✅ 128.40152 509.97464
Z3 Z3-alpha-base unknown ❌ 1201.37386 1201.04205
Z3-Owl-base unknown ❌ 1201.38582 1201.18385
z3siri-base unknown ❌ 1201.38699 1201.11923
Z3-Owl Z3-Owl unknown ❌ 1201.78974 1201.28221