Benchmark
non-incremental/BV/wintersteiger/fmsd13/ranking/filesys_smbmrx_smbxchng.c.smt2
Software ranking function synthesis problems.
These benchmarks stem from an evaluation described in Wintersteiger, Hamadi, de Moura: Efficiently solving quantified bit-vector formulas, FMSD 42(1), 2013.
The software models that were used are from a previous evaluation of termination proving tools described in Cook, Kroening, Ruemmer, Wintersteiger: Ranking Function Synthesis for Bit-Vector Relations, TACAS 2010.
| Benchmark |
|---|
| Size | 1634 |
| Compressed Size | 626 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2015-07-02 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 1626 |
| Compressed Size | 606 |
| Max. Term Depth | 13 |
| Asserts | 1 |
| Declared Functions | 0 |
| Declared Constants | 0 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
not | 3 |
and | 1 |
=> | 1 |
= | 5 |
forall | 6 |
exists | 1 |
BitVec | 7 |
bvadd | 1 |
bvmul | 2 |
bvslt | 1 |
zero_extend | 3 |
sign_extend | 2 |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2017
|
0.25 (3/4) |
Boolector |
Boolector SMT17 final boolector |
unsat ✅
|
57.19910
|
96.47540
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
548.19900
|
531.30300
|
| |
|
CVC4-smtcomp2017-main default |
unknown ❌
|
600.10300
|
582.17000
|
| |
Q3B |
Q3B default |
unsat ✅
|
0.18428
|
0.12797
|
| |
Z3 |
z3-4.5.0 default |
unknown ❌
|
600.01300
|
600.04300
|
| |
|
z3-4.5.0 default |
unknown ❌
|
600.08100
|
600.03500
|
|
SMT-COMP 2018
|
0.25 (3/4) |
Boolector |
Boolector_default |
unsat ✅
|
0.26672
|
0.49718
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unknown ❌
|
0.06601
|
0.06642
|
| |
|
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.02481
|
0.02493
|
| |
Q3B |
Q3B_default |
unsat ✅
|
0.05733
|
0.14006
|
| |
Z3 |
z3-4.7.1_default |
unknown ❌
|
1200.07000
|
1199.92000
|
| |
|
z3-4.7.1_default |
unknown ❌
|
1200.10000
|
1199.96000
|
|
SMT-COMP 2019
|
0.17 (5/6) |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
0.09852
|
0.16684
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
0.42648
|
0.28925
|
| |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unsat ✅
|
0.03104
|
0.03135
|
| |
|
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.02865
|
0.02896
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.03858
|
0.00571
|
| |
Q3B |
Q3B-wrapped-sq_default |
unsat ✅
|
0.04600
|
0.09623
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default |
unknown ❌
|
2.32392
|
3.34119
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
unsat ✅
|
0.41801
|
0.41799
|
|
SMT-COMP 2020
|
0.40 (3/5) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
0.45216
|
0.83408
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
0.02894
|
0.02919
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.03782
|
0.00680
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.3_s_default |
unknown ❌
|
2.40043
|
3.51269
|
| |
Z3 |
z3-4.8.8_default |
unknown ❌
|
1200.01000
|
1199.98000
|
|
SMT-COMP 2022
|
0.25 (6/8) |
Bitwuzla |
Bitwuzla-wrapped_default |
unsat ✅
|
4.10261
|
4.10252
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
0.02796
|
0.02838
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.06249
|
0.01168
|
| |
Q3B |
Q3B_default |
unsat ✅
|
0.07011
|
0.12922
|
| |
Q3B-pBNN |
Q3B-pBDD SMT-COMP 2022 final_default |
unknown ❌
|
1200.10000
|
1200.03000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.7-wrapped_default |
unknown ❌
|
2.98117
|
5.00430
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unsat ✅
|
0.10503
|
0.10507
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
3.03761
|
3.03925
|
|
SMT-COMP 2023
|
0.17 (5/6) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
12.04140
|
12.04050
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unsat ✅
|
0.02843
|
0.02892
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
0.04415
|
0.00637
|
| |
Q3B |
Q3B_default |
unsat ✅
|
0.06996
|
0.12753
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.9_default |
unknown ❌
|
3.04334
|
4.88627
|
| |
|
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
4.28085
|
11.47220
|
| |
YicesQS |
yicesQS-2022-07-02-optim-under10_default |
unsat ✅
|
0.10854
|
0.10716
|
|
SMT-COMP 2025
|
0.60 (2/5) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
58.98350
|
58.85298
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.32573
|
0.20722
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
0.50314
|
0.60361
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT |
unknown ❌
|
1.98773
|
4.08907
|
| |
YicesQS |
YicesQS |
unknown ❌
|
1201.79029
|
1201.04318
|