Benchmark

non-incremental/QF_BV/Sage2/bench_3548.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3599988
Compressed Size32779
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3599980
Compressed Size32767
Max. Term Depth727
Asserts 745
Declared Functions0
Declared Constants190
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite44 not167 =292
let77876 extract43 bvand2 bvor66
bvadd57933 bvmul7225 bvult136 bvule112
bvugt10 bvuge218 bvsgt20 bvshl66
bvlshr20 zero_extend12266

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 4.24567 4.24446
Boolector SMT17 final boolector unsat ✅ 42.77770 42.77750
CVC4 CVC4-smtcomp2017-main default unsat ✅ 405.26300 812.47000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01900 599.94000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 2.12690 2.11263
Q3B Q3B default unknown ❌ 600.05100 1799.73000
STP stp_st default unsat ✅ 2.91903 2.91796
stp_mt default unsat ✅ 3.39843 8.75802
Yices2 Yices2-Main default unsat ✅ 0.25818 0.25683
Z3 z3-4.5.0 default unknown ❌ 600.01400 599.97400
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 2.48943 2.48926
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 142.63600 142.63600
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 719.68800 719.66300
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.41838 3.84913
Minkeyrink ST_st unsat ✅ 2.63819 2.63830
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 2.87768 2.87722
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 2.51733 7.84130
STP-Riss-st-2018_riss-no-stderr unsat ✅ 2.40553 2.40568
Yices2 Yices 2.6.0_default unsat ✅ 0.28221 0.28214
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.87000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 3.95810 3.95811
Poolector-wrapped-sq_default unsat ✅ 4.62761 17.81030
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 20.17490 20.17340
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 11.14100 11.14130
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.92761 2.02139
MinkeyRink ST-wrapped-sq_default unsat ✅ 2.72521 2.72499
Par4 Par4-wrapped-sq_default unsat ✅ 0.25816 0.00579
STP STP-2019-wrapped-sq_default unsat ✅ 1.56882 1.56870
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 8.63722 8.63695
stp-minisat-wrapped-sq_default unsat ✅ 2.46941 2.45396
stp-mt-wrapped-sq_default unsat ✅ 1.38528 3.20629
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 8.43649 11.09040
stp-riss-wrapped-sq_default unknown ❌ 0.73750 0.73774
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.24583 0.24584
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36187 0.36187
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.25758 0.25759
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.04000 2399.95000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.25900 0.25900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.83000
SMT-COMP 2020 0.33 (6/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 5.18962 5.18970
Boolector Boolector-wrapped-sq_default unsat ✅ 4.16499 4.16043
Poolector-wrapped-sq_default unsat ✅ 1.88338 7.06000
CVC4 CVC4-sq-final_default unsat ✅ 7.35217 7.35217
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1199.95000
MathSAT MathSAT5_default.sh unknown ❌ 1200.11000 1199.86000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.48642 0.48664
MinkeyRink Solver 2020.3_default unsat ✅ 1.69287 5.20696
STP STP_default unsat ✅ 2.26737 5.84185
STP ++ Mergsat v1_default unsat ✅ 11.29240 11.29400
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.28390 0.28385
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.98000
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 4.99974 4.99881
MathSAT mathsat-5.6.6_default unknown ❌ 1200.04000 1199.70000
STP STP 2021.0_default unsat ✅ 2.64288 7.43830
Z3 z3-4.8.11_default unsat ✅ 28.43160 28.43130
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.48133 1.48093
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 7.12182 7.12251
STP STP 2022.4_default unsat ✅ 0.54271 0.54273
STP 2022.4_default unsat ✅ 0.54644 0.54646
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 127.59300 166.83400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.32130 0.32125
Z3-Owl z3-Owl-Final_default unsat ✅ 51.05310 51.02540
z3-Owl-Final_default unsat ✅ 31.63790 31.63470
SMT-COMP 2025 0.44 (5/9) Bitwuzla Bitwuzla unsat ✅ 0.80459 0.67652
Bitwuzla-MachBV-base unsat ✅ 0.65286 0.53856
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 4.55820 4.44343
BVDecide bv_decide unsat ✅ 504.43651 504.14235
bv_decide-nokernel unsat ✅ 78.13849 77.97306
cvc5 cvc5 unsat ✅ 4.44233 4.32278
SMTInterpol SMTInterpol unknown ❌ 1201.48916 1233.53804
Yices2 Yices2 unsat ✅ 0.47406 0.35316
Z3alpha Z3-alpha unknown ❌ 1201.00454 4800.80668
Z3 Z3-alpha-base unknown ❌ 1201.26837 1201.00913
Z3-Owl-base unknown ❌ 1201.26247 1200.93922
z3siri-base unknown ❌ 1201.26048 1200.99496
Z3-Owl Z3-Owl unknown ❌ 1201.76555 1201.01285