Benchmark

non-incremental/QF_BV/Sage2/bench_13581.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size632977
Compressed Size48848
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 632969
Compressed Size48837
Max. Term Depth2819
Asserts 1092
Declared Functions0
Declared Constants768
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite512 not525 =1375
let12958 bvor256 bvadd4249 bvmul1411
bvult40 bvule40 bvugt40 bvuge43
bvsle24 bvsgt41 bvshl256 bvlshr1200
zero_extend4037

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.62 (3/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 127.01200 127.01600
Boolector SMT17 final boolector unknown ❌ 600.01900 599.97000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.10200 1206.21000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.07900 599.92000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.55770 1.56105
Q3B Q3B default unknown ❌ 600.04100 1799.47000
STP stp_st default unknown ❌ 600.04800 599.91900
stp_mt default unknown ❌ 600.07300 1908.61000
Yices2 Yices2-Main default sat ✅ 7.79425 7.79252
Z3 z3-4.5.0 default unknown ❌ 600.01200 599.93000
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default sat ✅ 89.11930 89.10460
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 18.27340 18.27190
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.88000
MinkeyRink Minkeyrink MT_mt sat ✅ 1.37297 3.79246
Minkeyrink ST_st sat ✅ 1.70654 1.70180
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.10000 1200.00000
STP-CMS-mt-2018_multicore-no-stderr unknown ❌ 1200.05000 4767.68000
STP-Riss-st-2018_riss-no-stderr sat ✅ 72.65020 72.65270
Yices2 Yices 2.6.0_default sat ✅ 6.30411 6.30312
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.88000
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.88756 0.88725
Boolector Boolector-wrapped-sq_default sat ✅ 58.30070 58.30010
Poolector-wrapped-sq_default sat ✅ 69.03560 272.95000
CVC4 CVC4-sq-final_default sat ✅ 104.84200 104.82700
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.87000
MathSAT MathSAT5_default.sh sat ✅ 29.80110 29.79780
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.61394 0.60882
MinkeyRink Solver 2020.3_default sat ✅ 1.57645 4.41149
STP STP_default sat ✅ 440.98500 1748.01000
STP ++ Mergsat v1_default sat ✅ 226.18700 226.14100
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1022.86000 1022.65000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.17000
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.87159 0.87140
MathSAT mathsat-5.6.6_default sat ✅ 51.35580 51.34450
STP STP 2021.0_default sat ✅ 451.02300 1762.75000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.65000
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 29.75230 29.74080
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 39.56450 39.56460
STP STP 2022.4_default sat ✅ 1.62907 1.62899
STP 2022.4_default sat ✅ 1.64675 1.64448
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1251.03000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 6.69766 6.69744
Z3-Owl z3-Owl-Final_default sat ✅ 240.13900 240.09000
z3-Owl-Final_default sat ✅ 69.59550 69.47000
SMT-COMP 2024 0.50 (3/6) Bitwuzla Bitwuzla sat ✅ 2.70091 2.59956
cvc5 cvc5 sat ✅ 33.60613 33.50610
SMTInterpol SMTInterpol unknown ❌ 1201.71693 1238.44957
STP STP sat ✅ 2.38568 2.28504
Yices2 Yices2 unknown ❌ 1201.22528 1200.58475
Z3alpha Z3-alpha unknown ❌ 1201.71227 1201.09702
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 1.08126 0.95819
Bitwuzla-MachBV-base sat ✅ 1.58616 1.45615
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.13622 1.00531
BVDecide bv_decide sat ✅ 41.55942 41.42717
bv_decide-nokernel sat ✅ 38.74916 38.59480
cvc5 cvc5 sat ✅ 16.95208 16.81723
SMTInterpol SMTInterpol unknown ❌ 1201.45059 1229.85799
Yices2 Yices2 sat ✅ 0.45118 0.32684
Z3alpha Z3-alpha sat ✅ 906.23882 3621.19028
Z3 Z3-alpha-base unknown ❌ 1201.33087 1200.97066
Z3-Owl-base unknown ❌ 1201.28964 1201.05585
z3siri-base unknown ❌ 1201.30746 1200.99329
Z3-Owl Z3-Owl sat ✅ 192.84588 192.70486