Benchmark
non-incremental/UFNIA/lahiri-cav09-storm-queries/usbsamp_bug_example_2_1_8_2.smt2
Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise
Detection of Concurrency Errors in Systems Code Using SMT Solvers, in
Computer Aided Verification (CAV '09), Springer Verlag, February 2009
<http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
| Benchmark |
|---|
| Size | 1874936 |
| Compressed Size | 195191 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2009-08-02 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 1874928 |
| Compressed Size | 195199 |
| Max. Term Depth | 1000 |
| Asserts | 19 |
| Declared Functions | 281 |
| Declared Constants | 6141 |
| Declared Sorts | 3 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
true | 3243 |
false | 1 |
not | 315 |
or | 68 |
and | 1003 |
=> | 17799 |
= | 10337 |
distinct | 2 |
forall | 851 |
exists | 3 |
let | 497 |
Int | 448 |
+ | 101 |
- | 65 |
* | 13 |
< | 91 |
<= | 97 |
> | 48 |
>= | 13 |
| |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT Evaluation 2013
|
0.50 (1/2) |
CVC3 |
CVC3-SMT-COMP-2010 default |
unknown ❌
|
—
|
—
|
| |
|
CVC3-SMT-COMP-2011 default |
unknown ❌
|
—
|
—
|
| |
|
CVC3-SMT-COMP-2012 default |
unknown ❌
|
—
|
—
|
| |
Z3 |
Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default |
unsat ✅
|
20.16340
|
—
|
| |
|
Z3-SMT-COMP-2011 default |
unsat ✅
|
5.30972
|
—
|
|
SMT-COMP 2014
|
0.33 (2/3) |
CVC3 |
CVC3 default |
unknown ❌
|
2401.33000
|
2401.92000
|
| |
CVC4 |
CVC4 f7118b2 default |
unsat ✅
|
372.42600
|
372.42300
|
| |
Z3 |
Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default |
unsat ✅
|
17.32820
|
17.32240
|
|
SMT-COMP 2015
|
0.33 (2/3) |
CVC3 |
CVC3 default |
unknown ❌
|
2401.94000
|
2402.93000
|
| |
CVC4 |
CVC4-master-2015-06-15-9b32405-main default |
unsat ✅
|
1062.56000
|
1059.05000
|
| |
|
CVC4-experimental-2015-06-15-ff5745a-main default |
unsat ✅
|
1091.43000
|
1059.99000
|
| |
Z3 |
z3 4.4.0 default |
unsat ✅
|
25.77910
|
25.79010
|
|
SMT-COMP 2016
|
|
CVC4 |
CVC4-master-2016-05-27-cfef263-main default |
unsat ✅
|
827.48800
|
558.24000
|
| |
Vampire |
vampire_smt_4.1 vampire_smtcomp |
unsat ✅
|
732.33400
|
736.29700
|
| |
|
vampire_smt_4.1_parallel vampire_smtcomp |
unsat ✅
|
63.71600
|
249.01000
|
| |
Z3 |
z3-4.4.1 default |
unsat ✅
|
23.61220
|
23.62690
|
|
SMT-COMP 2017
|
0.33 (2/3) |
CVC4 |
CVC4-smtcomp2017-main default |
unknown ❌
|
600.02900
|
340.68000
|
| |
Vampire |
vampire4.2-smt vampire |
unsat ✅
|
49.18440
|
153.63000
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
23.88900
|
23.88400
|
|
SMT-COMP 2018
|
0.67 (1/3) |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unknown ❌
|
1200.10000
|
620.00400
|
| |
Vampire |
vampire-4.3-smt_vampire_smtcomp |
unknown ❌
|
1200.06000
|
4767.28000
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
4.25311
|
4.25292
|
|
SMT-COMP 2019
|
0.50 (3/6) |
Alt-Ergo |
Alt-Ergo-SMTComp-2019-wrapped-sq_default |
unknown ❌
|
182.09300
|
723.11000
|
| |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unknown ❌
|
2400.05000
|
1829.62000
|
| |
|
CVC4-SymBreak_03_06_2019-wrapped-sq_default |
unknown ❌
|
2400.11000
|
1537.97000
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
6.81669
|
13.57000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default |
unknown ❌
|
2.47689
|
3.38924
|
| |
|
UltimateEliminator+Yices-2.6.1-wrapped-sq_default |
unknown ❌
|
2.33350
|
3.25677
|
| |
Vampire |
vampire-4.4-smtcomp-wrapped-sq_default |
unknown ❌
|
2400.07000
|
9513.18000
|
| |
|
vampire-4.3-smt_vampire_smtcomp |
unsat ✅
|
395.01800
|
1561.15000
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
unsat ✅
|
4.41146
|
4.41127
|
| |
|
z3-4.7.1_default |
unsat ✅
|
6.11453
|
6.11379
|
|
SMT-COMP 2020
|
0.50 (3/6) |
Alt-Ergo |
Alt-Ergo-SMTComp-2020_default |
unknown ❌
|
163.93900
|
650.68000
|
| |
CVC4 |
CVC4-sq-final_default |
unknown ❌
|
1200.04000
|
532.28000
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
4.20681
|
8.33000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.3_s_default |
unknown ❌
|
2.45749
|
3.47007
|
| |
Vampire |
vampire_smt_4.5_vampire_smtcomp |
unsat ✅
|
302.11200
|
1152.62000
|
| |
|
vampire-4.3-smt_vampire_smtcomp |
unsat ✅
|
309.97900
|
1224.97000
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
4.36815
|
4.36780
|
|
SMT-COMP 2022
|
0.60 (2/5) |
CVC4 |
CVC4-sq-final_default |
unknown ❌
|
1200.54000
|
627.08700
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unknown ❌
|
1200.11000
|
647.00000
|
| |
UltimateEliminator |
UltimateEliminator+MathSAT-5.6.7-wrapped_default |
unknown ❌
|
2.80342
|
4.74826
|
| |
Vampire |
vampire_4.7_smt_fix-wrapped_vampire_smtcomp |
unsat ✅
|
399.96100
|
1578.93000
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
13.65090
|
13.65320
|