Benchmark
non-incremental/QF_BV/20190311-bv-term-small-rw-Noetzli/bv-term-small-rw_1499.smt2
Publications: "Syntax-Guided Rewrite Rule Enumeration for SMT Solvers" by A. Noetzli, A. Reynolds, H. Barbosa, A. Niemetz, M. Preiner, C. Barrett, and C. Tinelli, SAT 2019.
| Benchmark |
|---|
| Size | 744 |
| Compressed Size | 440 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2019-07-07 |
| Generated By | Andres Noetzli, Andrew Reynolds, Haniel Barbosa, Aina Niemetz, Mathias Preiner, Clark Barrett, Cesare Tinelli |
| Generated On | 2018-11-08 00:00:00 |
| Generator | CVC4 |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 736 |
| Compressed Size | 438 |
| Max. Term Depth | 5 |
| Asserts | 1 |
| Declared Functions | 0 |
| Declared Constants | 2 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2019
|
|
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.00930
|
0.00630
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.17837
|
0.11567
|
| |
Boolector-ReasonLS |
boolector-ReasonLS-wrapped-sq_default |
unsat ✅
|
34.99280
|
34.99200
|
| |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unsat ✅
|
1.54389
|
1.54405
|
| |
MinkeyRink |
MinkeyRink MT-wrapped-sq_default |
unsat ✅
|
5.11151
|
19.95310
|
| |
|
MinkeyRink ST-wrapped-sq_default |
unsat ✅
|
6.26061
|
6.26049
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
1.80237
|
5.25000
|
| |
STP |
STP-2019-wrapped-sq_default |
unsat ✅
|
8.26175
|
8.26149
|
| |
|
stp-mergesat-fixed-wrapped-sq_default |
unsat ✅
|
14.88950
|
14.88990
|
| |
|
stp-minisat-wrapped-sq_default |
unsat ✅
|
2.04118
|
2.04120
|
| |
|
stp-mt-wrapped-sq_default |
unsat ✅
|
4.27519
|
16.66390
|
| |
|
stp-portfolio-fixed-wrapped-sq_default |
unsat ✅
|
15.10990
|
25.35400
|
| |
|
stp-riss-wrapped-sq_default |
unknown ❌
|
0.08951
|
0.08970
|
| |
Yices2 |
Yices 2.6.2-wrapped-sq_default |
unsat ✅
|
0.01365
|
0.00608
|
| |
|
Yices 2.6.2 Cadical-wrapped-sq_default |
unsat ✅
|
0.00879
|
0.00549
|
| |
|
Yices 2.6.2 Cryptominisat-wrapped-sq_default |
unsat ✅
|
0.00916
|
0.00558
|
| |
|
Yices 2.6.2 MCSAT BV-wrapped-sq_default |
unsat ✅
|
3.54227
|
3.54219
|
| |
|
Yices 2.6.2 new bvsolver-wrapped-sq_default |
unsat ✅
|
0.01013
|
0.00577
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
unsat ✅
|
1.49079
|
1.49061
|
|
SMT-COMP 2020
|
0.11 (8/9) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.02206
|
0.00490
|
| |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.01727
|
0.00689
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.17574
|
0.11395
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
15.32180
|
15.32130
|
| |
LazyBV2Int |
LazyBV2Int20200523_default.sh |
unknown ❌
|
1200.01000
|
1199.82000
|
| |
MathSAT |
MathSAT5_default.sh |
unsat ✅
|
93.55100
|
93.54970
|
| |
MinkeyRink |
MinkeyRink Solver 2020.3.1_default |
unsat ✅
|
0.01191
|
0.01202
|
| |
|
MinkeyRink Solver 2020.3_default |
unsat ✅
|
0.03483
|
0.01289
|
| |
STP |
STP_default |
unsat ✅
|
0.01221
|
0.01211
|
| |
|
STP ++ Mergsat v1_default |
unsat ✅
|
0.01091
|
0.00660
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
0.01716
|
0.00361
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
2.19661
|
2.19634
|
|
SMT-COMP 2021
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.01269
|
0.00457
|
| |
MathSAT |
mathsat-5.6.6_default |
unsat ✅
|
95.21880
|
95.18000
|
| |
STP |
STP 2021.0_default |
unsat ✅
|
0.01216
|
0.01229
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
2.17145
|
4.27127
|
|
SMT-COMP 2022
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.01400
|
0.00462
|
| |
|
Bitwuzla-wrapped_default |
unsat ✅
|
0.01185
|
0.00475
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
2.11004
|
2.11037
|
| |
MathSAT |
MathSAT-5.6.8_default |
unsat ✅
|
100.24700
|
100.23700
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.01246
|
0.01052
|
| |
Yices2 |
Yices 2.6.2 for SMTCOMP 2021_default |
unsat ✅
|
0.01163
|
0.00349
|
| |
Z3++BV |
z3++bv_0702_default |
unsat ✅
|
0.01554
|
0.01459
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
182.86500
|
182.86100
|
|
SMT-COMP 2023
|
0.17 (5/6) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.02317
|
0.02308
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unsat ✅
|
20.24290
|
20.23730
|
| |
STP |
STP 2022.4_default |
unsat ✅
|
0.01109
|
0.01030
|
| |
|
STP 2022.4_default |
unsat ✅
|
0.01030
|
0.01033
|
| |
UltimateEliminator |
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
4.38250
|
11.46410
|
| |
Yices2 |
Yices 2 for SMTCOMP 2023_default |
unsat ✅
|
0.01089
|
0.00347
|
| |
Z3-Owl |
z3-Owl-Final_default |
unsat ✅
|
0.68665
|
0.68671
|
| |
|
z3-Owl-Final_default |
unsat ✅
|
0.68718
|
0.68739
|
|
SMT-COMP 2025
|
0.11 (8/9) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
0.32531
|
0.20124
|
| |
|
Bitwuzla-MachBV-base |
unsat ✅
|
0.28174
|
0.15671
|
| |
Bitwuzla-MachBV |
Bitwuzla-MachBV |
unsat ✅
|
0.34853
|
0.22654
|
| |
BVDecide |
bv_decide |
unsat ✅
|
18.75803
|
18.63789
|
| |
|
bv_decide-nokernel |
unsat ✅
|
16.30433
|
16.15965
|
| |
cvc5 |
cvc5 |
unsat ✅
|
13.47953
|
13.35796
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
0.52062
|
0.57544
|
| |
Yices2 |
Yices2 |
unsat ✅
|
0.28710
|
0.15907
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
0.39683
|
0.26864
|
| |
Z3 |
Z3-alpha-base |
unsat ✅
|
0.31026
|
0.18249
|
| |
|
Z3-Owl-base |
unsat ✅
|
0.30203
|
0.17763
|
| |
|
z3siri-base |
unsat ✅
|
0.30032
|
0.16784
|
| |
Z3-Owl |
Z3-Owl |
unsat ✅
|
0.80721
|
0.68774
|